TY - JOUR
T1 - Daytime arctic cloud detection based on multi-angle satellite data with case studies
AU - Shi, Tao
AU - Yu, Bin
AU - Clothiaux, Eugene E.
AU - Braverman, Amy J.
N1 - Funding Information:
Tao Shi is Assistant Professor, Department of Statistics, Ohio State University, Columbus, OH 43210 (E-mail: taoshi@stat.osu.edu). Bin Yu is Professor, Department of Statistics, University of California, Berkeley, CA 94720 (E-mail: binyu@stat.berkeley.edu). Eugene E. Clothiaux is Associate Professor, Department of Meteorology, Pennsylvania State University, University Park, PA 16802 (E-mail: cloth@essc.psu.edu). Amy J. Braverman is Statistician and Senior Member, Information Systems and Computer Science, Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA 91109 (E-mail: Amy.Braverman@jpl.nasa.gov). This research was supported in part by National Science Foundation grants FD01-12731 (Yu), CCR-0106656 (Shi and Yu), DMS-03036508 (Shi and Yu), and DMS-0605165 (Yu) and ARO grant W911NF-05-1-0104 (Yu). It was also supported in part by a Miller Foundation Professorship to Yu in Spring 2004. Clothiaux was supported by National Aeronautics and Space Administration (NASA) grant NNG04GL93G and Jet Propulsion Laboratory contract 1259588. Braverman’s work was performed at the Jet Propulsion Laboratory, California Institute of Technology, under contract with the NASA. MISR data were obtained at the courtesy of the NASA Langley Research Center Atmospheric Sciences Data Center. The results given in Section 4.2 are courtesy of Guilherme Rocha, a doctoral degree student of Bin Yu at the University of California, Berkeley. The authors thank L. Di Girolamo, D. J. Diner, R. Davies, and R. Kahn for helpful discussions and suggestions, and especially Dominic Mazzoni of the Jet Propulsion Laboratory for sharing, adapting, and expertly supporting his software package MISRLEARN for our use in this study. All of the expert labeled data for this study were produced using his MISRLEARN software package. The full version of this article is available online at www.stat.berkeley.edu/∼binyu/publications.html.
PY - 2008/6
Y1 - 2008/6
N2 - Global climate models predict that the strongest dependences of surface air temperatures on increasing atmospheric carbon dioxide levels will occur in the Arctic. A systematic study of these dependences requires accurate Arctic-wide measurements, especially of cloud coverage. Thus cloud detection in the Arctic is extremely important, but it is also challenging because of the similar remote sensing characteristics of clouds and ice- and snow-covered surfaces. This article proposes two new operational Arctic cloud detection algorithms using Mulfiangle Imaging SpectroRadiometer (MISR) imagery. The key idea is to identify cloud-free surface pixels in the imagery instead of cloudy pixels as in the existing MISR operational algorithms. Through extensive exploratory data analysis and using domain knowledge, three physically useful features to differentiate surface pixels from cloudy pixels have been identified. The first algorithm, enhanced linear correlation matching (ELCM), thresholds the features with either fixed or data-adaptive cutoff values. Probability labels are obtained by using ELCM labels as training data for Fisher's quadratic discriminant analysis (QDA), leading to the second (ELCM-QDA) algorithm. Both algorithms are automated and computationally efficient for operational processing of the massive MISR data set. Based on 5 million expert-labeled pixels, ELCM results are significantly in terms of both accuracy (92%) and coverage (100%) compared with two MISR operational algorithms, one with an accuracy of 80% and coverage of 27% and the other with an accuracy of 83% and a coverage of 70%. The ELCM-QDA probability prediction is also consistent with the expert labels and is more informative. In conclusion, ELCM and ELCM-QDA provide the best performance to date among all available operational algorithms using MISR data.
AB - Global climate models predict that the strongest dependences of surface air temperatures on increasing atmospheric carbon dioxide levels will occur in the Arctic. A systematic study of these dependences requires accurate Arctic-wide measurements, especially of cloud coverage. Thus cloud detection in the Arctic is extremely important, but it is also challenging because of the similar remote sensing characteristics of clouds and ice- and snow-covered surfaces. This article proposes two new operational Arctic cloud detection algorithms using Mulfiangle Imaging SpectroRadiometer (MISR) imagery. The key idea is to identify cloud-free surface pixels in the imagery instead of cloudy pixels as in the existing MISR operational algorithms. Through extensive exploratory data analysis and using domain knowledge, three physically useful features to differentiate surface pixels from cloudy pixels have been identified. The first algorithm, enhanced linear correlation matching (ELCM), thresholds the features with either fixed or data-adaptive cutoff values. Probability labels are obtained by using ELCM labels as training data for Fisher's quadratic discriminant analysis (QDA), leading to the second (ELCM-QDA) algorithm. Both algorithms are automated and computationally efficient for operational processing of the massive MISR data set. Based on 5 million expert-labeled pixels, ELCM results are significantly in terms of both accuracy (92%) and coverage (100%) compared with two MISR operational algorithms, one with an accuracy of 80% and coverage of 27% and the other with an accuracy of 83% and a coverage of 70%. The ELCM-QDA probability prediction is also consistent with the expert labels and is more informative. In conclusion, ELCM and ELCM-QDA provide the best performance to date among all available operational algorithms using MISR data.
UR - http://www.scopus.com/inward/record.url?scp=49549087932&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=49549087932&partnerID=8YFLogxK
U2 - 10.1198/016214507000001283
DO - 10.1198/016214507000001283
M3 - Article
AN - SCOPUS:49549087932
SN - 0162-1459
VL - 103
SP - 584
EP - 593
JO - Journal of the American Statistical Association
JF - Journal of the American Statistical Association
IS - 482
ER -