Virtual Reality for Evaluating Prosthetic Hand Control Strategies: A Preliminary Report

Jason Xie, Xiaogang Hu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Improving prosthetic hand functionality is critical in reducing abandonment rates and improving the amputee's quality of life. Techniques such as joint force estimation and gesture recognition using myoelectric signals could enable more realistic control of the prosthetic hand. To accelerate the translation of these advanced control strategies from lab to clinic, We created a virtual prosthetic control environment that enables rich user interactions and dexterity evaluation. The virtual environment is made of two parts, namely the Unity scene for rendering and user interaction, and a Python back-end to support accurate physics simulation and communication with control algorithms. By utilizing the built-in tracking capabilities of a virtual reality headset, the user can visualize and manipulate a virtual hand without additional motion tracking setups. In the virtual environment, we demonstrate actuation of the prosthetic hand through decoded EMG signal streaming, hand tracking, and the use of a VR controller. By providing a flexible platform to investigate different control modalities, we believe that our virtual environment will allow for faster experimentation and further progress in clinical translation.

Original languageEnglish (US)
Title of host publication43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6263-6266
Number of pages4
ISBN (Electronic)9781728111797
DOIs
StatePublished - 2021
Event43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021 - Virtual, Online, Mexico
Duration: Nov 1 2021Nov 5 2021

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
ISSN (Print)1557-170X

Conference

Conference43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
Country/TerritoryMexico
CityVirtual, Online
Period11/1/2111/5/21

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint

Dive into the research topics of 'Virtual Reality for Evaluating Prosthetic Hand Control Strategies: A Preliminary Report'. Together they form a unique fingerprint.

Cite this