TY - GEN
T1 - Using learning curves to assess resident surgical skill acquisition
T2 - 58th International Annual Meeting of the Human Factors and Ergonomics Society, HFES 2014
AU - Kim, Inki
AU - Miller, Scarlett R.
AU - Freivalds, Andris
N1 - Publisher Copyright:
Copyright 2014 Human Factors and Ergonomics Society.
PY - 2014
Y1 - 2014
N2 - While there has been a wealth of performance criteria proposed and validated for objective assessment of surgical skills, only less than one third of the metrics are adopted in clinical practice, and even fewer are used for medical examination. This is due in part to the fact that the evaluation criteria proposed are focused on the task-centered outcomes which are not generalizable to broader sets of emerging surgical procedures. With increasing pressure from the media, regulatory bodies, and patients, to scrutinize physician performance, generalized standard criteria for assessing surgical performance are needed. This can be realized only if Multivariate Performance Criteria (MPC) are defined with respect to inherent human capabilities, rather than to transient task conditions, and if these criteria become related and prioritized consistently. In light of this, the current study proposes a method for relating and prioritizing the multivariate criteria through the use of Learning Curves. To this end, ten desired capabilities were identified from a Task Analysis of the Central Venous Catheter (CVC) placement procedure. In the preliminary study, motion tracking of video footage for six medical residents, taken at the beginning, middle, and end of a three-months-long training session, was used to confirm learning of the desired capabilities. Specifically, the economy of motion, eye-hand coordination, motion stability, and visual detection were tracked and quantified according to the defined metrics. Among them, both economy of motion and eye-hand coordination had a statistically significant learning effect (p<0.05) with the different learning rates-eye-hand coordination needed more training to reach a plateau. Our results imply that eye-hand coordination is relatively more comprehensive capability and requires to set higher priority in training. The current method can contribute to establishing hierarchical structures in MPC based on learning curves, ultimately building a standard system of performance. The results of this proceeding have implications for using learning curves to assess medical skill performance in a systematic manner.
AB - While there has been a wealth of performance criteria proposed and validated for objective assessment of surgical skills, only less than one third of the metrics are adopted in clinical practice, and even fewer are used for medical examination. This is due in part to the fact that the evaluation criteria proposed are focused on the task-centered outcomes which are not generalizable to broader sets of emerging surgical procedures. With increasing pressure from the media, regulatory bodies, and patients, to scrutinize physician performance, generalized standard criteria for assessing surgical performance are needed. This can be realized only if Multivariate Performance Criteria (MPC) are defined with respect to inherent human capabilities, rather than to transient task conditions, and if these criteria become related and prioritized consistently. In light of this, the current study proposes a method for relating and prioritizing the multivariate criteria through the use of Learning Curves. To this end, ten desired capabilities were identified from a Task Analysis of the Central Venous Catheter (CVC) placement procedure. In the preliminary study, motion tracking of video footage for six medical residents, taken at the beginning, middle, and end of a three-months-long training session, was used to confirm learning of the desired capabilities. Specifically, the economy of motion, eye-hand coordination, motion stability, and visual detection were tracked and quantified according to the defined metrics. Among them, both economy of motion and eye-hand coordination had a statistically significant learning effect (p<0.05) with the different learning rates-eye-hand coordination needed more training to reach a plateau. Our results imply that eye-hand coordination is relatively more comprehensive capability and requires to set higher priority in training. The current method can contribute to establishing hierarchical structures in MPC based on learning curves, ultimately building a standard system of performance. The results of this proceeding have implications for using learning curves to assess medical skill performance in a systematic manner.
UR - http://www.scopus.com/inward/record.url?scp=84957714802&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84957714802&partnerID=8YFLogxK
U2 - 10.1177/1541931214581489
DO - 10.1177/1541931214581489
M3 - Conference contribution
AN - SCOPUS:84957714802
T3 - Proceedings of the Human Factors and Ergonomics Society
SP - 2350
EP - 2354
BT - 2014 International Annual Meeting of the Human Factors and Ergonomics Society, HFES 2014
PB - Human Factors an Ergonomics Society Inc.
Y2 - 27 October 2014 through 31 October 2014
ER -