What's on "their" mind: Evaluating collaborative systems using team mental models

Vincent Mancuso; Katherine Hamilton; Eric McMillan; Rachel Tesler; Susan Mohammed; Michael McNeese

doi:10.1177/1071181311551267

What's on "their" mind: Evaluating collaborative systems using team mental models

Vincent Mancuso, Katherine Hamilton, Eric McMillan, Rachel Tesler, Susan Mohammed, Michael McNeese

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

6 Scopus citations

Abstract

In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.

Original language	English (US)
Title of host publication	Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011
Pages	1284-1288
Number of pages	5
DOIs	https://doi.org/10.1177/1071181311551267
State	Published - Nov 28 2011
Event	55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011 - Las Vegas, NV, United States Duration: Sep 19 2011 → Sep 23 2011

Publication series

Name	Proceedings of the Human Factors and Ergonomics Society
ISSN (Print)	1071-1813

Other

Other	55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011
Country/Territory	United States
City	Las Vegas, NV
Period	9/19/11 → 9/23/11

All Science Journal Classification (ASJC) codes

Human Factors and Ergonomics

Access to Document

10.1177/1071181311551267

Cite this

Mancuso, V., Hamilton, K., McMillan, E., Tesler, R., Mohammed, S., & McNeese, M. (2011). What's on "their" mind: Evaluating collaborative systems using team mental models. In Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011 (pp. 1284-1288). (Proceedings of the Human Factors and Ergonomics Society). https://doi.org/10.1177/1071181311551267

@inproceedings{62e41b704d6540519a4b0a900d8d0c1b,

title = "What's on {"}their{"} mind: Evaluating collaborative systems using team mental models",

abstract = "In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.",

author = "Vincent Mancuso and Katherine Hamilton and Eric McMillan and Rachel Tesler and Susan Mohammed and Michael McNeese",

year = "2011",

month = nov,

day = "28",

doi = "10.1177/1071181311551267",

language = "English (US)",

isbn = "9780945289395",

series = "Proceedings of the Human Factors and Ergonomics Society",

pages = "1284--1288",

booktitle = "Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011",

note = "55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011 ; Conference date: 19-09-2011 Through 23-09-2011",

}

Mancuso, V, Hamilton, K, McMillan, E, Tesler, R, Mohammed, S & McNeese, M 2011, What's on "their" mind: Evaluating collaborative systems using team mental models. in Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011. Proceedings of the Human Factors and Ergonomics Society, pp. 1284-1288, 55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011, Las Vegas, NV, United States, 9/19/11. https://doi.org/10.1177/1071181311551267

What's on "their" mind: Evaluating collaborative systems using team mental models. / Mancuso, Vincent; Hamilton, Katherine; McMillan, Eric et al.
Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011. 2011. p. 1284-1288 (Proceedings of the Human Factors and Ergonomics Society).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - What's on "their" mind

T2 - 55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011

AU - Mancuso, Vincent

AU - Hamilton, Katherine

AU - McMillan, Eric

AU - Tesler, Rachel

AU - Mohammed, Susan

AU - McNeese, Michael

PY - 2011/11/28

Y1 - 2011/11/28

N2 - In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.

AB - In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.

UR - http://www.scopus.com/inward/record.url?scp=81855161423&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=81855161423&partnerID=8YFLogxK

U2 - 10.1177/1071181311551267

DO - 10.1177/1071181311551267

M3 - Conference contribution

AN - SCOPUS:81855161423

SN - 9780945289395

T3 - Proceedings of the Human Factors and Ergonomics Society

SP - 1284

EP - 1288

BT - Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011

Y2 - 19 September 2011 through 23 September 2011

ER -

What's on "their" mind: Evaluating collaborative systems using team mental models

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this