Naturalistic dialogue management for noisy speech recognition

Rebecca J. Passonneau, Susan L. Epstein, Tiziana Ligorio

Research output: Contribution to journalArticlepeer-review


With naturalistic dialogue management, a spoken dialogue system behaves as a human would under similar conditions. This paper reports on an experiment to develop naturalistic clarification strategies for noisy speech recognition in the context of spoken dialogue systems. We collected a wizard-of-Oz corpus in which human wizards with access to a rich set of clarification actions made clarification decisions online, based on human-readable versions of system data. The experiment compares an evaluation of calls to a baseline system in a library domain with calls to an enhanced version of the system. The new system has a clarification module based on the wizard data that is a decision tree constructed from three machine-learned models. It replicates the wizards' ability to ground partial understandings of noisy input and to build upon them. The enhanced system has a significantly higher rate of task completion, greater task success and improved efficiency.

Original languageEnglish (US)
Article number6362157
Pages (from-to)928-942
Number of pages15
JournalIEEE Journal on Selected Topics in Signal Processing
Issue number8
StatePublished - 2012

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering


Dive into the research topics of 'Naturalistic dialogue management for noisy speech recognition'. Together they form a unique fingerprint.

Cite this