How the experts do it: Assessing and explaining agent behaviors in real-time strategy games

Jonathan Dodge, Sean Penney, Claudia Hilderbrand, Andrew Anderson, Margaret Burnett

Research output: Chapter in Book/Report/Conference proceedingConference contribution

24 Scopus citations

Abstract

How should an AI-based explanation system explain an agent's complex behavior to ordinary end users who have no background in AI? Answering this question is an active research area, for if an AI-based explanation system could effectively explain intelligent agents' behavior, it could enable the end users to understand, assess, and appropriately trust (or distrust) the agents attempting to help them. To provide insights into this question, we turned to human expert explainers in the real-time strategy domain -"shoutcasters"- to understand (1) how they foraged in an evolving strategy game in real time, (2) how they assessed the players' behaviors, and (3) how they constructed pertinent and timely explanations out of their insights and delivered them to their audience. The results provided insights into shoutcasters' foraging strategies for gleaning information necessary to assess and explain the players; a characterization of the types of implicit questions shoutcasters answered; and implications for creating explanations by using the patterns and abstraction levels these human experts revealed.

Original languageEnglish (US)
Title of host publicationCHI 2018 - Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
Subtitle of host publicationEngage with CHI
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450356206, 9781450356213
DOIs
StatePublished - Apr 20 2018
Event2018 CHI Conference on Human Factors in Computing Systems, CHI 2018 - Montreal, Canada
Duration: Apr 21 2018Apr 26 2018

Publication series

NameConference on Human Factors in Computing Systems - Proceedings
Volume2018-April

Other

Other2018 CHI Conference on Human Factors in Computing Systems, CHI 2018
Country/TerritoryCanada
CityMontreal
Period4/21/184/26/18

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'How the experts do it: Assessing and explaining agent behaviors in real-time strategy games'. Together they form a unique fingerprint.

Cite this