TY - GEN
T1 - Engaging spect-actors with multimodal digital puppetry
AU - Coutrix, Céline
AU - Jacucci, Giulio
AU - Spagnolli, Anna
AU - Ma, Lingyi
AU - Helin, Matti
AU - Richard, Gabriela
AU - Parisi, Lorenza
AU - Roveda, Stefano
AU - Narula, Prayag
PY - 2010
Y1 - 2010
N2 - We present Euclide, a multimodal system for live animation of a virtual puppet that is composed of a data glove, MIDI music board, keyboard, and mouse. The paper reports on a field study in which Euclide was used in a science museum to animate visitors as they passed by five different stations. Quantitative and qualitative analysis of several hours of videos served investigation of how the various features of the multimodal system were used by different puppeteers in the unfolding of the sessions. We found that the puppetry was truly multimodal, utilizing several input modalities simultaneously; the structure of sessions followed performative strategies; and the engagement of spectators was co-constructed. The puppeteer uses nonverbal resources (effects) and we examined how they are instrumental to talk as nonverbal turns, verbal accompaniment, and virtual gesturing. These findings allow describing digital puppetry as an emerging promising field of application for HCI that acts as a source of insights applicable in a range of multimodal performative interactive systems.
AB - We present Euclide, a multimodal system for live animation of a virtual puppet that is composed of a data glove, MIDI music board, keyboard, and mouse. The paper reports on a field study in which Euclide was used in a science museum to animate visitors as they passed by five different stations. Quantitative and qualitative analysis of several hours of videos served investigation of how the various features of the multimodal system were used by different puppeteers in the unfolding of the sessions. We found that the puppetry was truly multimodal, utilizing several input modalities simultaneously; the structure of sessions followed performative strategies; and the engagement of spectators was co-constructed. The puppeteer uses nonverbal resources (effects) and we examined how they are instrumental to talk as nonverbal turns, verbal accompaniment, and virtual gesturing. These findings allow describing digital puppetry as an emerging promising field of application for HCI that acts as a source of insights applicable in a range of multimodal performative interactive systems.
UR - http://www.scopus.com/inward/record.url?scp=78650106702&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78650106702&partnerID=8YFLogxK
U2 - 10.1145/1868914.1868934
DO - 10.1145/1868914.1868934
M3 - Conference contribution
AN - SCOPUS:78650106702
SN - 9781605589343
T3 - NordiCHI 2010: Extending Boundaries - Proceedings of the 6th Nordic Conference on Human-Computer Interaction
SP - 138
EP - 147
BT - NordiCHI 2010
T2 - 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, NordiCHI 2010
Y2 - 16 October 2010 through 20 October 2010
ER -