smoothEM: A new approach for the simultaneous assessment of smooth patterns and spikes

We consider functional data where an underlying smooth curve is composed not just with errors, but also with irregular spikes. We propose an approach that, combining regularized spline smoothing and an Expectation-Maximization (EM) algorithm, allows one to both identify spikes and estimate the smooth component. Imposing some assumptions on the error distribution, we prove consistency of EM estimates. Next, we demonstrate the performance of our proposal on finite samples and its robustness to assumptions violations through simulations. Finally, we apply it to data on the annual heatwave index in the US and on weekly electricity consumption in Ireland. In both data sets, we are able to characterize underlying smooth trends and to pinpoint irregular/extreme behaviors.