TY - JOUR
T1 - Machine learning with monotonic constraint for geotechnical engineering applications
T2 - an example of slope stability prediction
AU - Pei, Te
AU - Qiu, Tong
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2023.
PY - 2024/6
Y1 - 2024/6
N2 - Machine learning (ML) algorithms have been widely applied to analyze geotechnical engineering problems due to recent advances in data science. However, flexible ML models trained with limited data can exhibit unexpected behaviors, leading to low interpretability and physical inconsistency, thus, reducing the reliability and robustness of ML models for risk forecasting and engineering applications. As input features for geotechnical engineering applications often represent physical parameters following intrinsic and often monotonic relationships, incorporating monotonicity into ML models can help ensure the physical realism of model outputs. In this study, monotonicity was introduced as a soft constraint into artificial neural network (ANN) models, and their results were compared with several benchmark ML models. During the training process, data augmentation and point-wise gradient were used to evaluate the monotonicity of model predictions, and monotonicity violations were minimized through a modified loss function. A compilation of slope stability case histories from the literature was used for model development, benchmarking their performance, and evaluating the effects of monotonicity constraints. Cross-validation procedures were used for all model performance evaluations to reduce bias in sample selections. Results showed that unconstrained ML models produced predictions that violate monotonicity in many parts of the input space. However, by adding monotonicity constraints into ANN models, monotonicity violations were effectively reduced while maintaining relatively high performance, thus providing a more robust and interpretable prediction. Using slope stability prediction as a proxy, the methods developed in this study to incorporate monotonicity constraints into ML models can be applied to many geotechnical engineering applications. The proposed approach enhances the reliability and interpretability of ML models, resulting in more accurate and consistent outcomes for real-world applications.
AB - Machine learning (ML) algorithms have been widely applied to analyze geotechnical engineering problems due to recent advances in data science. However, flexible ML models trained with limited data can exhibit unexpected behaviors, leading to low interpretability and physical inconsistency, thus, reducing the reliability and robustness of ML models for risk forecasting and engineering applications. As input features for geotechnical engineering applications often represent physical parameters following intrinsic and often monotonic relationships, incorporating monotonicity into ML models can help ensure the physical realism of model outputs. In this study, monotonicity was introduced as a soft constraint into artificial neural network (ANN) models, and their results were compared with several benchmark ML models. During the training process, data augmentation and point-wise gradient were used to evaluate the monotonicity of model predictions, and monotonicity violations were minimized through a modified loss function. A compilation of slope stability case histories from the literature was used for model development, benchmarking their performance, and evaluating the effects of monotonicity constraints. Cross-validation procedures were used for all model performance evaluations to reduce bias in sample selections. Results showed that unconstrained ML models produced predictions that violate monotonicity in many parts of the input space. However, by adding monotonicity constraints into ANN models, monotonicity violations were effectively reduced while maintaining relatively high performance, thus providing a more robust and interpretable prediction. Using slope stability prediction as a proxy, the methods developed in this study to incorporate monotonicity constraints into ML models can be applied to many geotechnical engineering applications. The proposed approach enhances the reliability and interpretability of ML models, resulting in more accurate and consistent outcomes for real-world applications.
UR - http://www.scopus.com/inward/record.url?scp=85177882132&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85177882132&partnerID=8YFLogxK
U2 - 10.1007/s11440-023-02117-7
DO - 10.1007/s11440-023-02117-7
M3 - Article
AN - SCOPUS:85177882132
SN - 1861-1125
VL - 19
SP - 3863
EP - 3882
JO - Acta Geotechnica
JF - Acta Geotechnica
IS - 6
ER -