Using Patient Care Quality Measures to Assess Educational Outcomes

Susan R. Swing, Sandra Schneider, Ken Bizovi, Dane Chapman, Louis G. Graff, Cherri Hobgood, Thomas Lukens, Martha J. Radford, Arthur Sanders, Rebecca Smith-Coggins, Linda Spillane, Laura Hruska, Robert L. Wears

Research output: Contribution to journalArticlepeer-review

22 Scopus citations


Objectives: To report the results of a project designed to develop and implement a prototype methodology for identifying candidate patient care quality measures for potential use in assessing the outcomes and effectiveness of graduate medical education in emergency medicine. Methods: A workgroup composed of experts in emergency medicine residency education and patient care quality measurement was convened. Workgroup members performed a modified Delphi process that included iterative review of potential measures; individual expert rating of the measures on four dimensions, including measures quality of care and educational effectiveness; development of consensus on measures to be retained; external stakeholder rating of measures followed by a final workgroup review; and a post hoc stratification of measures. The workgroup completed a structured exercise to examine the linkage of patient care process and outcome measures to educational effectiveness. Results: The workgroup selected 62 measures for inclusion in its final set, including 43 measures for 21 clinical conditions, eight medication measures, seven measures for procedures, and four measures for department efficiency. Twenty-six measures met the more stringent criteria applied post hoc to further stratify and prioritize measures for development. Nineteen of these measures received high ratings from 75% of the workgroup and external stakeholder raters on importance for care in the ED, measures quality of care, and measures educational effectiveness; the majority of the raters considered these indicators feasible to measure. The workgroup utilized a simple framework for exploring the relationship of residency program educational activities, competencies from the six Accreditation Council for Graduate Medical Education general competency domains, patient care quality measures, and external factors that could intervene to affect care quality. Conclusions: Numerous patient care quality measures have potential for use in assessing the educational effectiveness and performance of graduate medical education programs in emergency medicine. The measures identified in this report can be used as a starter set for further development, implementation, and study. Implementation of the measures, especially for high-stakes use, will require resolution of significant measurement issues.

Original languageEnglish (US)
Pages (from-to)463-473
Number of pages11
JournalAcademic Emergency Medicine
Issue number5
StatePublished - May 2007

All Science Journal Classification (ASJC) codes

  • Emergency Medicine


Dive into the research topics of 'Using Patient Care Quality Measures to Assess Educational Outcomes'. Together they form a unique fingerprint.

Cite this