TY - JOUR
T1 - Beyond remote control
T2 - Exploring natural gesture inputs for smart TV systems
AU - Wu, Huiyue
AU - Yang, Liuqingqing
AU - Fu, Shengqian
AU - Zhang, Xiaolong Luke
N1 - Funding Information:
The authors would like to thank the anonymous reviewers for their insightful comments. This work was supported by the National Natural Science Foundation of China under Grant No. 61772564, 61772468, 61202344 and the funding offered by the China Scholarship Council (CSC).
Publisher Copyright:
© 2019 - IOS Press and the authors. All rights reserved.
PY - 2019
Y1 - 2019
N2 - This paper reports on work that explores natural gesture inputs from end-users for television use in a typical living room setting. First, we derive a set of 19 user-defined freehand gestures for regular TV control tasks. This study helps us to determine the gestures preferred by TV viewers and reduce the risk of developing an unusable, ineffective system. Then, based on this user-defined gesture set, we propose a unified framework to address specific problems in a complex real-world TV viewing environment, including 1) the automatic exclusion of many meaningless daily actions by TV viewers, 2) the capability to recognize both static and dynamic gestures simultaneously, as well as one- and two-handed gestures simultaneously, and 3) the continuous recognition of multiple dynamic gestures in the air (e.g., a channel switching gesture for channel 127). Experimental results show that our approach allows users to interact with TV-based applications more flexibly and effectively, with improved user experience and user satisfaction. Finally, we highlight the implications of our work for the design and development of related freehand gesture applications.
AB - This paper reports on work that explores natural gesture inputs from end-users for television use in a typical living room setting. First, we derive a set of 19 user-defined freehand gestures for regular TV control tasks. This study helps us to determine the gestures preferred by TV viewers and reduce the risk of developing an unusable, ineffective system. Then, based on this user-defined gesture set, we propose a unified framework to address specific problems in a complex real-world TV viewing environment, including 1) the automatic exclusion of many meaningless daily actions by TV viewers, 2) the capability to recognize both static and dynamic gestures simultaneously, as well as one- and two-handed gestures simultaneously, and 3) the continuous recognition of multiple dynamic gestures in the air (e.g., a channel switching gesture for channel 127). Experimental results show that our approach allows users to interact with TV-based applications more flexibly and effectively, with improved user experience and user satisfaction. Finally, we highlight the implications of our work for the design and development of related freehand gesture applications.
UR - http://www.scopus.com/inward/record.url?scp=85069650545&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85069650545&partnerID=8YFLogxK
U2 - 10.3233/AIS-190528
DO - 10.3233/AIS-190528
M3 - Article
AN - SCOPUS:85069650545
SN - 1876-1364
VL - 11
SP - 335
EP - 354
JO - Journal of Ambient Intelligence and Smart Environments
JF - Journal of Ambient Intelligence and Smart Environments
IS - 4
ER -