TY - GEN
T1 - On using standard residuals as a metric of kriging model quality
AU - Congdon, Christopher D.
AU - Martin, Jay D.
PY - 2007
Y1 - 2007
N2 - An interpolating kriging model, though it will always return the observations exactly, may not provide a good representation of the computer simulation at other values within the input domain. Without access to additional and potentially costly validation observations, it is difficult to determine if a kriging model is a good representation of the original computer model. One method to determine the predictive quality of a kriging model is to use leave-one-out cross-validation. A second difficulty with creating kriging models is a lack of diagnostic tests to determine how to improve the kriging model to result in a better estimation of the original computer model. This paper presents developments of diagnostic tools for creating kriging models. A computationally efficient form for the leave-one-out cross-validation residual and the variance at the left out location is presented. The standardized residuals can then be used to test if all of the observations appear to come from the Gaussian spatial process specified by the kriging model. This lack of fit may be the result of: 1) erroneous data, 2) the form of the kriging model is not sufficient to estimate the observations as a Gaussian process, 3) or the range of the model is not well represented by a single spatial random process. Two practical examples are provided to demonstrate how to interpret the results and make decisions on how to improve the predictive capability of the kriging model. The first example is a one-dimensional adiabatic flame temperature calculation. The second problem is a two-dimensional Branin test function.
AB - An interpolating kriging model, though it will always return the observations exactly, may not provide a good representation of the computer simulation at other values within the input domain. Without access to additional and potentially costly validation observations, it is difficult to determine if a kriging model is a good representation of the original computer model. One method to determine the predictive quality of a kriging model is to use leave-one-out cross-validation. A second difficulty with creating kriging models is a lack of diagnostic tests to determine how to improve the kriging model to result in a better estimation of the original computer model. This paper presents developments of diagnostic tools for creating kriging models. A computationally efficient form for the leave-one-out cross-validation residual and the variance at the left out location is presented. The standardized residuals can then be used to test if all of the observations appear to come from the Gaussian spatial process specified by the kriging model. This lack of fit may be the result of: 1) erroneous data, 2) the form of the kriging model is not sufficient to estimate the observations as a Gaussian process, 3) or the range of the model is not well represented by a single spatial random process. Two practical examples are provided to demonstrate how to interpret the results and make decisions on how to improve the predictive capability of the kriging model. The first example is a one-dimensional adiabatic flame temperature calculation. The second problem is a two-dimensional Branin test function.
UR - https://www.scopus.com/pages/publications/34547547977
UR - https://www.scopus.com/pages/publications/34547547977#tab=citedBy
M3 - Conference contribution
AN - SCOPUS:34547547977
SN - 1563478927
SN - 9781563478925
T3 - Collection of Technical Papers - AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference
SP - 2801
EP - 2814
BT - Collection of Technical Papers - 48th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference
T2 - 48th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference
Y2 - 23 April 2007 through 26 April 2007
ER -