TY - JOUR
T1 - Vero
T2 - An accessible method for studying human–AI teamwork
AU - Schecter, Aaron
AU - Hohenstein, Jess
AU - Larson, Lindsay
AU - Harris, Alexa
AU - Hou, Tsung Yu
AU - Lee, Wen Ying
AU - Lauharatanahirun, Nina
AU - DeChurch, Leslie
AU - Contractor, Noshir
AU - Jung, Malte
N1 - Publisher Copyright:
© 2022 The Authors
PY - 2023/4
Y1 - 2023/4
N2 - Despite the recognized need to prepare for a future of human–AI collaboration, the technical skills necessary to develop and deploy AI systems are considerable, making such research difficult to perform without specialized knowledge. To make human–AI collaboration research more accessible, we developed a novel experimental method that combines a standard video conferencing platform, a set of animations, and Wizard of Oz methods to simulate a group interaction with an AI teammate. Through a case study, we demonstrate the flexibility and ease of deployment of this approach. We also provide evidence that the method creates a highly believable experience of interacting with an AI agent. By detailing this method, we hope that researchers regardless of background can replicate it to more easily answer questions that will inform the design and development of future human–AI collaboration technologies.
AB - Despite the recognized need to prepare for a future of human–AI collaboration, the technical skills necessary to develop and deploy AI systems are considerable, making such research difficult to perform without specialized knowledge. To make human–AI collaboration research more accessible, we developed a novel experimental method that combines a standard video conferencing platform, a set of animations, and Wizard of Oz methods to simulate a group interaction with an AI teammate. Through a case study, we demonstrate the flexibility and ease of deployment of this approach. We also provide evidence that the method creates a highly believable experience of interacting with an AI agent. By detailing this method, we hope that researchers regardless of background can replicate it to more easily answer questions that will inform the design and development of future human–AI collaboration technologies.
UR - http://www.scopus.com/inward/record.url?scp=85144820265&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85144820265&partnerID=8YFLogxK
U2 - 10.1016/j.chb.2022.107606
DO - 10.1016/j.chb.2022.107606
M3 - Article
AN - SCOPUS:85144820265
SN - 0747-5632
VL - 141
JO - Computers in Human Behavior
JF - Computers in Human Behavior
M1 - 107606
ER -