Predicting the Postoperative Outcome of Percutaneous Nephrolithotomy with Machine Learning System: Software Validation and Comparative Analysis with Guy's Stone Score and the CROES Nomogram

Purpose: To validate the output of a machine learning-based software as an intelligible interface for predicting multiple outcomes after percutaneous nephrolithotomy (PCNL). We compared the performance of this system with Guy's stone score (GSS) and the Clinical Research Office of Endourological Society (CROES) nomogram. Patients and Methods: Data from 146 adult patients (87 males, 59%) who underwent PCNL at our institute were used. To validate the system, accuracy of the software for predicting each postoperative outcome was compared with the actual outcome. Similarly, preoperative data were analyzed with GSS and CROES nomograms to determine stone-free status as predicted by these nomograms. A receiver operating characteristic (ROC) curve was generated for each scoring system, and the area under the ROC curve (AUC) was calculated and used to assess the predictive performance of all three models. Results: Overall stone-free rate was 72.6% (106/146). Forty of 146 patients (27.4%) were scheduled for 42 ancillary procedures (extracorporeal shockwave lithotripsy [SWL] [n = 31] or repeat PCNL [n = 11]) to manage residual renal stones. Overall, the machine learning system predicted the PCNL outcomes with an accuracy ranging between 80% and 95.1%. For predicting the stone-free status, the AUC for the software (0.915) was significantly larger than the AUC for GSS (0.615) or CROES nomograms (0.621) (p < 0.001). Conclusion: At the internal institutional level, the machine learning-based software was a promising tool for recording, processing, and predicting outcomes after PCNL. Validation of this system against an external dataset is highly recommended before its widespread application.