TY - JOUR
T1 - Repeat
T2 - A framework to assess empirical reproducibility in biomedical research
AU - McIntosh, Leslie D.
AU - Juehne, Anthony
AU - Vitale, Cynthia R.H.
AU - Liu, Xiaoyan
AU - Alcoser, Rosalia
AU - Lukas, J. Christian
AU - Evanoff, Bradley
N1 - Funding Information:
Research reported in this paper was supported by the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number UL1TR000448 and UL1TR000448-09S1. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Publisher Copyright:
© 2017 The Author(s).
PY - 2017/9/18
Y1 - 2017/9/18
N2 - Background: The reproducibility of research is essential to rigorous science, yet significant concerns of the reliability and verifiability of biomedical research have been recently highlighted. Ongoing efforts across several domains of science and policy are working to clarify the fundamental characteristics of reproducibility and to enhance the transparency and accessibility of research. Methods: The aim of the proceeding work is to develop an assessment tool operationalizing key concepts of research transparency in the biomedical domain, specifically for secondary biomedical data research using electronic health record data. The tool (RepeAT) was developed through a multi-phase process that involved coding and extracting recommendations and practices for improving reproducibility from publications and reports across the biomedical and statistical sciences, field testing the instrument, and refining variables. Results: RepeAT includes 119 unique variables grouped into five categories (research design and aim, database and data collection methods, data mining and data cleaning, data analysis, data sharing and documentation). Preliminary results in manually processing 40 scientific manuscripts indicate components of the proposed framework with strong inter-rater reliability, as well as directions for further research and refinement of RepeAT. Conclusions: The use of RepeAT may allow the biomedical community to have a better understanding of the current practices of research transparency and accessibility among principal investigators. Common adoption of RepeAT may improve reporting of research practices and the availability of research outputs. Additionally, use of RepeAT will facilitate comparisons of research transparency and accessibility across domains and institutions.
AB - Background: The reproducibility of research is essential to rigorous science, yet significant concerns of the reliability and verifiability of biomedical research have been recently highlighted. Ongoing efforts across several domains of science and policy are working to clarify the fundamental characteristics of reproducibility and to enhance the transparency and accessibility of research. Methods: The aim of the proceeding work is to develop an assessment tool operationalizing key concepts of research transparency in the biomedical domain, specifically for secondary biomedical data research using electronic health record data. The tool (RepeAT) was developed through a multi-phase process that involved coding and extracting recommendations and practices for improving reproducibility from publications and reports across the biomedical and statistical sciences, field testing the instrument, and refining variables. Results: RepeAT includes 119 unique variables grouped into five categories (research design and aim, database and data collection methods, data mining and data cleaning, data analysis, data sharing and documentation). Preliminary results in manually processing 40 scientific manuscripts indicate components of the proposed framework with strong inter-rater reliability, as well as directions for further research and refinement of RepeAT. Conclusions: The use of RepeAT may allow the biomedical community to have a better understanding of the current practices of research transparency and accessibility among principal investigators. Common adoption of RepeAT may improve reporting of research practices and the availability of research outputs. Additionally, use of RepeAT will facilitate comparisons of research transparency and accessibility across domains and institutions.
UR - http://www.scopus.com/inward/record.url?scp=85029593391&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85029593391&partnerID=8YFLogxK
U2 - 10.1186/s12874-017-0377-6
DO - 10.1186/s12874-017-0377-6
M3 - Article
C2 - 28923006
AN - SCOPUS:85029593391
SN - 1471-2288
VL - 17
JO - BMC Medical Research Methodology
JF - BMC Medical Research Methodology
IS - 1
M1 - 143
ER -