TY - JOUR
T1 - Making the Most of it
T2 - Application of Planned Missingness Design to Increase the Efficiency of Diagnostic Assessment
AU - Shapiro, Zvi R.
AU - Huang-Pollock, Cynthia
AU - Graham, John W.
AU - Neely, Kristina
N1 - Funding Information:
This study was supported by the National Center for Advancing Translational Sciences, Grant KL2 TR000126 and TR002015. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Author A, Author B, Author C, and Author D declare that they have no conflict of interest.
Publisher Copyright:
© 2020, This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.
PY - 2020/6/1
Y1 - 2020/6/1
N2 - Multimethod assessment is recommended as “best practice” in clinical assessment and is often implemented through the combined use of symptom rating scales and structured interviews. While this approach increases confidence in the validity of assessment, it also increases burden, expense, and leads to the accumulation of redundant information. To address this problem, we evaluate the use of a planned missingness design within the framework of adult Attention Deficit/Hyperactivity Disorder (ADHD) assessment. In a sample of 169 young adults, we fit a two-method measurement (TMM) model using ADHD symptoms obtained from rating scales and a structured diagnostic interview. Based on an estimated 8:1 differential between the cost of conducting an in-person diagnostic interview vs. completing questionnaires online, we conducted a series of Monte Carlo simulations to determine the utility of combining TMM with a planned missingness design. We find that even when costs are kept constant, statistical power of the TMM/planned missingness design was equal to the power that would have been obtained had nearly twice the number of participants with complete data been recruited. Conversely, costs could be decreased by 20–25%, while maintaining statistical power equivalent to a design with complete data. Our results suggest the TMM design is a promising technique for reducing the cost and burden of diagnostic assessment within research settings.
AB - Multimethod assessment is recommended as “best practice” in clinical assessment and is often implemented through the combined use of symptom rating scales and structured interviews. While this approach increases confidence in the validity of assessment, it also increases burden, expense, and leads to the accumulation of redundant information. To address this problem, we evaluate the use of a planned missingness design within the framework of adult Attention Deficit/Hyperactivity Disorder (ADHD) assessment. In a sample of 169 young adults, we fit a two-method measurement (TMM) model using ADHD symptoms obtained from rating scales and a structured diagnostic interview. Based on an estimated 8:1 differential between the cost of conducting an in-person diagnostic interview vs. completing questionnaires online, we conducted a series of Monte Carlo simulations to determine the utility of combining TMM with a planned missingness design. We find that even when costs are kept constant, statistical power of the TMM/planned missingness design was equal to the power that would have been obtained had nearly twice the number of participants with complete data been recruited. Conversely, costs could be decreased by 20–25%, while maintaining statistical power equivalent to a design with complete data. Our results suggest the TMM design is a promising technique for reducing the cost and burden of diagnostic assessment within research settings.
UR - http://www.scopus.com/inward/record.url?scp=85078629330&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85078629330&partnerID=8YFLogxK
U2 - 10.1007/s10862-019-09780-9
DO - 10.1007/s10862-019-09780-9
M3 - Article
C2 - 32523240
AN - SCOPUS:85078629330
SN - 0882-2689
VL - 42
SP - 314
EP - 327
JO - Journal of Psychopathology and Behavioral Assessment
JF - Journal of Psychopathology and Behavioral Assessment
IS - 2
ER -