Early predicting of student struggles using body language

Matthew L. Dering, Conrad Tucker

Research output: Contribution to journalConference articlepeer-review


The accuracy of RGB-D sensing has enabled many technical achievements in applications such as gamification, task recognition, as well as pedagogical applications. The ability of these sensors to track many body parts simultaneously has introduced a new data modality for analysis. By analyzing body language, this work can predict if a student will struggle in the future, and if an instructor should intervene. To accomplish this, a study is performed to determine how early (after how many seconds) does it become possible to determine if a student will struggle. A simple neural network is proposed which is used to jointly classify body language and predict task performance. By modeling the input as both instances and sequences, a peak F Score of 0.459 was obtained, after observing a student for just two seconds. Finally, an unsupervised method yielded a model which could determine if a student would struggle after just 1 second with 59.9% accuracy.

Original languageEnglish (US)
JournalASEE Annual Conference and Exposition, Conference Proceedings
StatePublished - Jun 24 2017
Event124th ASEE Annual Conference and Exposition - Columbus, United States
Duration: Jun 25 2017Jun 28 2017

All Science Journal Classification (ASJC) codes

  • General Engineering


Dive into the research topics of 'Early predicting of student struggles using body language'. Together they form a unique fingerprint.

Cite this