TY - JOUR

T1 - Smoothing can systematically bias small samples of one-dimensional biomechanical continua

AU - Pataky, Todd C.

AU - Robinson, Mark A.

AU - Vanrenterghem, Jos

AU - Challis, John H.

N1 - Publisher Copyright:
© 2018 Elsevier Ltd

PY - 2019/1/3

Y1 - 2019/1/3

N2 - The quality with which smoothing algorithms perform is often assessed in simulation by starting with a known 1D datum, adding noise, smoothing the noisy data, then quantifying the difference between the smoothed data and known datum, often using mean-square error (MSE). While effectively summarizing overall difference, MSE fails to capture localized, one-sided errors. This paper describes how smoothing noisy 1D data using a variety of algorithms can introduce systematic bias, and quantifies this bias using the false positive rate (FPR): the probability that a smoothing algorithm will yield a dataset whose 1D mean differs significantly from its true 1D datum. A simulation study was conducted involving six 1D datum continua, and four smoothing algorithms whose parameters were systematically manipulated along with sample size and noise amplitude. Approximately ten million simulation iterations were evaluated. FPRs were calculated at α=0.05, based on the calculated smoothness of the resulting datasets. Results showed that FPRs were much higher than the expected value of α and in many cases approached 100%. FPRs were highest with aggressive smoothing parameters, large sample sizes and small noise amplitudes, irrespective of both smoothing algorithm and the 1D datum. These results suggest that smoothing 1D biomechanical data can introduce statistical bias with relatively high probability. The implications are experiment-specific because the biomechanical meaning of 1D changes can vary vastly between datasets. Smoothing-induced bias should be a cause for general concern when small 1D changes have non-trivial biomechanical consequences.

AB - The quality with which smoothing algorithms perform is often assessed in simulation by starting with a known 1D datum, adding noise, smoothing the noisy data, then quantifying the difference between the smoothed data and known datum, often using mean-square error (MSE). While effectively summarizing overall difference, MSE fails to capture localized, one-sided errors. This paper describes how smoothing noisy 1D data using a variety of algorithms can introduce systematic bias, and quantifies this bias using the false positive rate (FPR): the probability that a smoothing algorithm will yield a dataset whose 1D mean differs significantly from its true 1D datum. A simulation study was conducted involving six 1D datum continua, and four smoothing algorithms whose parameters were systematically manipulated along with sample size and noise amplitude. Approximately ten million simulation iterations were evaluated. FPRs were calculated at α=0.05, based on the calculated smoothness of the resulting datasets. Results showed that FPRs were much higher than the expected value of α and in many cases approached 100%. FPRs were highest with aggressive smoothing parameters, large sample sizes and small noise amplitudes, irrespective of both smoothing algorithm and the 1D datum. These results suggest that smoothing 1D biomechanical data can introduce statistical bias with relatively high probability. The implications are experiment-specific because the biomechanical meaning of 1D changes can vary vastly between datasets. Smoothing-induced bias should be a cause for general concern when small 1D changes have non-trivial biomechanical consequences.

UR - http://www.scopus.com/inward/record.url?scp=85056828701&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056828701&partnerID=8YFLogxK

U2 - 10.1016/j.jbiomech.2018.11.002

DO - 10.1016/j.jbiomech.2018.11.002

M3 - Article

C2 - 30471793

AN - SCOPUS:85056828701

SN - 0021-9290

VL - 82

SP - 330

EP - 336

JO - Journal of Biomechanics

JF - Journal of Biomechanics

ER -