Engaging spect-actors with multimodal digital puppetry

Céline Coutrix, Giulio Jacucci, Anna Spagnolli, Lingyi Ma, Matti Helin, Gabriela Richard, Lorenza Parisi, Stefano Roveda, Prayag Narula

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

We present Euclide, a multimodal system for live animation of a virtual puppet that is composed of a data glove, MIDI music board, keyboard, and mouse. The paper reports on a field study in which Euclide was used in a science museum to animate visitors as they passed by five different stations. Quantitative and qualitative analysis of several hours of videos served investigation of how the various features of the multimodal system were used by different puppeteers in the unfolding of the sessions. We found that the puppetry was truly multimodal, utilizing several input modalities simultaneously; the structure of sessions followed performative strategies; and the engagement of spectators was co-constructed. The puppeteer uses nonverbal resources (effects) and we examined how they are instrumental to talk as nonverbal turns, verbal accompaniment, and virtual gesturing. These findings allow describing digital puppetry as an emerging promising field of application for HCI that acts as a source of insights applicable in a range of multimodal performative interactive systems.

Original languageEnglish (US)
Title of host publicationNordiCHI 2010
Subtitle of host publicationExtending Boundaries - Proceedings of the 6th Nordic Conference on Human-Computer Interaction
Pages138-147
Number of pages10
DOIs
StatePublished - 2010
Event6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, NordiCHI 2010 - Reykjavik, Iceland
Duration: Oct 16 2010Oct 20 2010

Publication series

NameNordiCHI 2010: Extending Boundaries - Proceedings of the 6th Nordic Conference on Human-Computer Interaction

Other

Other6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, NordiCHI 2010
Country/TerritoryIceland
CityReykjavik
Period10/16/1010/20/10

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Engaging spect-actors with multimodal digital puppetry'. Together they form a unique fingerprint.

Cite this