TY - GEN
T1 - An experimental refinement of computational models of human-robot teams
AU - Ma, Lanssie
AU - Ye, Sean
AU - Ijtsma, Martijn
AU - Feigh, Karen
AU - Pritchett, Amy
N1 - Funding Information:
The authors would like to thank NASA Ames and Jessica Marquez for supporting this work through Grant #NNX17AB08G as well as contributors and developers of WMC. We would also like to thank our undergrad research assistants Yeseul Heo and Emma Wilson for their contributions.
Publisher Copyright:
© 2020, American Institute of Aeronautics and Astronautics Inc, AIAA. All rights reserved.
PY - 2020
Y1 - 2020
N2 - This work aims to investigate methods to effectively design human-robot teams using computational working and simulation paired with a human-in-the-loop experiment (HITL). This HITL relates human-robot teaming fluency metrics (human idle time, robot idle time, and concurrent activity) to perceived workload. We also present a computational simulation that is able to predict these fluency metrics. We modeled an on-orbit maintenance scenario where participants interacted with either a robot capable of fetching and inspecting or just inspecting. To mimic a real space scenario, we also tested the differences between having participants listen to all mission control commands and confirmations versus omitting this dialogue. We found that participants rated a robot capable of fetching as a significantly better teammate even if this caused a slower overall scenario with less work for themselves. Robot idle time and concurrent activity were good predictors of how participants perceived the robot. However, more human idle time did not always correlate to lower perceived workload. Computational predictions of the relative effects different work allocations were confirmed by the experiment. Further, bootstrapping analysis demonstrated how the computational models can be further improved from HITL results, both in terms of refining estimates of specific activities and in terms of identifying other important effects to incorporate, such as communication times and the time to transition between actions.
AB - This work aims to investigate methods to effectively design human-robot teams using computational working and simulation paired with a human-in-the-loop experiment (HITL). This HITL relates human-robot teaming fluency metrics (human idle time, robot idle time, and concurrent activity) to perceived workload. We also present a computational simulation that is able to predict these fluency metrics. We modeled an on-orbit maintenance scenario where participants interacted with either a robot capable of fetching and inspecting or just inspecting. To mimic a real space scenario, we also tested the differences between having participants listen to all mission control commands and confirmations versus omitting this dialogue. We found that participants rated a robot capable of fetching as a significantly better teammate even if this caused a slower overall scenario with less work for themselves. Robot idle time and concurrent activity were good predictors of how participants perceived the robot. However, more human idle time did not always correlate to lower perceived workload. Computational predictions of the relative effects different work allocations were confirmed by the experiment. Further, bootstrapping analysis demonstrated how the computational models can be further improved from HITL results, both in terms of refining estimates of specific activities and in terms of identifying other important effects to incorporate, such as communication times and the time to transition between actions.
UR - http://www.scopus.com/inward/record.url?scp=85092420907&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85092420907&partnerID=8YFLogxK
U2 - 10.2514/6.2020-1650
DO - 10.2514/6.2020-1650
M3 - Conference contribution
AN - SCOPUS:85092420907
SN - 9781624105951
T3 - AIAA Scitech 2020 Forum
BT - AIAA Scitech 2020 Forum
PB - American Institute of Aeronautics and Astronautics Inc, AIAA
T2 - AIAA Scitech Forum, 2020
Y2 - 6 January 2020 through 10 January 2020
ER -