Does Adding a Measure of Social Vulnerability to a Surgical Risk Calculator Improve Its Performance?

Background: Emerging literature suggests that measures of social vulnerability should be incorporated into surgical risk calculators. The Social Vulnerability Index (SVI) is a measure designed by the CDC that encompasses 15 socioeconomic and demographic variables at the census tract level. We examined whether adding the SVI into a parsimonious surgical risk calculator would improve model performance. Study Design: The eight-variable Surgical Risk Preoperative Assessment System (SURPAS), developed using the entire American College of Surgeons (ACS) NSQIP database, was applied to local ACS-NSQIP data from 2012 to 2018 to predict 12 postoperative outcomes. Patient addresses were geocoded and used to estimate the SVI, which was then added to the model as a ninth predictor variable. Brier scores and c-indices were compared for the models with and without the SVI. Results: The analysis included 31,222 patients from five hospitals. Brier scores were identical for eight outcomes and improved by only one to two points in the fourth decimal place for four outcomes with addition of the SVI. Similarly, c-indices were not significantly different (p values ranged from 0.15 to 0.96). Of note, the SVI was associated with most of the eight SURPAS predictor variables, suggesting that SURPAS may already indirectly capture this important risk factor. Conclusion: The eight-variable SURPAS prediction model was not significantly improved by adding the SVI, showing that this parsimonious tool functions well without including a measure of social vulnerability.