After-Action Review for AI (AAR/AI)

Jonathan Dodge, Roli Khanna, Jed Irvine, Kin Ho Lam, Theresa Mai, Zhengxian Lin, Nicholas Kiddle, Evan Newman, Andrew Anderson, Sai Raja, Caleb Matthews, Christopher Perdriau, Margaret Burnett, Alan Fern

Research output: Contribution to journalReview articlepeer-review

9 Scopus citations

Abstract

Explainable AI is growing in importance as AI pervades modern society, but few have studied how explainable AI can directly support people trying to assess an AI agent. Without a rigorous process, people may approach assessment in ad hoc ways - leading to the possibility of wide variations in assessment of the same agent due only to variations in their processes. AAR, or After-Action Review, is a method some military organizations use to assess human agents, and it has been validated in many domains. Drawing upon this strategy, we derived an After-Action Review for AI (AAR/AI), to organize ways people assess reinforcement learning agents in a sequential decision-making environment. We then investigated what AAR/AI brought to human assessors in two qualitative studies. The first investigated AAR/AI to gather formative information, and the second built upon the results, and also varied the type of explanation (model-free vs. model-based) used in the AAR/AI process. Among the results were the following: (1) participants reporting that AAR/AI helped to organize their thoughts and think logically about the agent, (2) AAR/AI encouraged participants to reason about the agent from a wide range of perspectives, and (3) participants were able to leverage AAR/AI with the model-based explanations to falsify the agent's predictions.

Original languageEnglish (US)
Article number29
JournalACM Transactions on Interactive Intelligent Systems
Volume11
Issue number3-4
DOIs
StatePublished - Aug 31 2021

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'After-Action Review for AI (AAR/AI)'. Together they form a unique fingerprint.

Cite this