Abstract

This paper explores the need for individualized feedback in medical simulation training for procedures such as endotracheal intubations and colonoscopies. Current pass-fail assessments lack the specificity required for skill refinement, leading to potential complications in critical procedures. This experiment investigates the application of visual hand tracking technology, specifically Google's MediaPipe, to offer quantitative feedback. Using a wooden hand model on a linear motor with a depth camera, this experiment explores tracking hand movements in real time. Google's MediaPipe software tracks 3D hand motions, generating data points for analysis. Results demonstrated consistent patterns in hand movements corresponding to linear motor actions. Total distance traveled by each point of interest and error analysis, averaging 3.1 mm, provided insights into the accuracy of visually measured hand movements. Visual hand tracking, such as MediaPipe, may prove to be a promising tool for refining operator techniques in critical medical procedures. The experiment explores the technology's accuracy and underscores its potential application in medical training, addressing a gap in current practices and emphasizing the importance of tailored feedback for improved patient outcomes.

Original languageEnglish (US)
Title of host publicationProceedings of the 2024 Design of Medical Devices Conference, DMD 2024
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791887752
DOIs
StatePublished - 2024
Event2024 Design of Medical Devices Conference, DMD 2024 - Minneapolis, United States
Duration: Apr 8 2024Apr 10 2024

Publication series

NameProceedings of the 2024 Design of Medical Devices Conference, DMD 2024

Conference

Conference2024 Design of Medical Devices Conference, DMD 2024
Country/TerritoryUnited States
CityMinneapolis
Period4/8/244/10/24

All Science Journal Classification (ASJC) codes

  • Biomedical Engineering
  • Medicine (miscellaneous)

Fingerprint

Dive into the research topics of 'ACCURACY OF MEDIAPIPE VISUAL HAND TRACKING FOR USE IN MEDICAL TRAINING PROCEDURES'. Together they form a unique fingerprint.

Cite this