TY - JOUR
T1 - Some prognostic models for traumatic brain injury were not valid
AU - Hukkelhoven, Chantal W.P.M.
AU - Rampen, Anneke J.J.
AU - Maas, Andrew I.R.
AU - Farace, Elana
AU - Habbema, J. Dik F.
AU - Marmarou, Anthony
AU - Marshall, Lawrence F.
AU - Murray, Gordon D.
AU - Steyerberg, Ewout W.
N1 - Funding Information:
The authors gratefully acknowledge the significant amount of work performed by all investigators originally involved in the data collection of the Tirilazad studies, the International Selfotel study, the EBIC Core Data Survey, and the Traumatic Coma Data Bank; without this extensive body of work, the present validation studies could not have been performed. The authors express their gratitude to Marja van Gemerden for secretarial and administrative assistance in preparation of the manuscript. Grant support was provided by NIH NS042691-01A1.
PY - 2006/2
Y1 - 2006/2
N2 - Objective: Various prognostic models have been developed to predict outcome after traumatic brain injury (TBI). We aimed to determine the validity of six models that used baseline clinical and computed tomographic characteristics to predict mortality or unfavorable outcome at 6 months or later after severe or moderate TBI. Study Design and Setting: The validity was studied in two selected series of TBI patients enrolled in clinical trials (Tirilazad trials; n = 2,269; International Selfotel Trial; n = 409) and in two unselected series of patients consecutively admitted to participating centers (European Brain Injury Consortium [EBIC] survey; n = 796; Traumatic Coma Data Bank; n = 746). Validity was indicated by discriminative ability (AUC) and calibration (Hosmer-Lemeshow goodness-of-fit test). Results: The models varied in number of predictors (four to seven) and in development technique (two prediction trees and four logistic regression models). Discriminative ability varied widely (AUC: .61-.89), but calibration was poor for most models. Better discrimination was observed for logistic regression models compared with trees, and for models including more predictors. Further, discrimination was better when tested on unselected series that contained more heterogeneous populations. Conclusion: Our findings emphasize the need for external validation of prognostic models. The satisfactory discrimination indicates that logistic regression models, developed on large samples, can be used for classifying TBI patients according to prognostic risk.
AB - Objective: Various prognostic models have been developed to predict outcome after traumatic brain injury (TBI). We aimed to determine the validity of six models that used baseline clinical and computed tomographic characteristics to predict mortality or unfavorable outcome at 6 months or later after severe or moderate TBI. Study Design and Setting: The validity was studied in two selected series of TBI patients enrolled in clinical trials (Tirilazad trials; n = 2,269; International Selfotel Trial; n = 409) and in two unselected series of patients consecutively admitted to participating centers (European Brain Injury Consortium [EBIC] survey; n = 796; Traumatic Coma Data Bank; n = 746). Validity was indicated by discriminative ability (AUC) and calibration (Hosmer-Lemeshow goodness-of-fit test). Results: The models varied in number of predictors (four to seven) and in development technique (two prediction trees and four logistic regression models). Discriminative ability varied widely (AUC: .61-.89), but calibration was poor for most models. Better discrimination was observed for logistic regression models compared with trees, and for models including more predictors. Further, discrimination was better when tested on unselected series that contained more heterogeneous populations. Conclusion: Our findings emphasize the need for external validation of prognostic models. The satisfactory discrimination indicates that logistic regression models, developed on large samples, can be used for classifying TBI patients according to prognostic risk.
UR - http://www.scopus.com/inward/record.url?scp=30944455273&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=30944455273&partnerID=8YFLogxK
U2 - 10.1016/j.jclinepi.2005.06.009
DO - 10.1016/j.jclinepi.2005.06.009
M3 - Article
C2 - 16426948
AN - SCOPUS:30944455273
SN - 0895-4356
VL - 59
SP - 132
EP - 143
JO - Journal of Clinical Epidemiology
JF - Journal of Clinical Epidemiology
IS - 2
ER -