A ROBUST CONSISTENT INFORMATION CRITERION FOR MODEL SELECTION BASED ON EMPIRICAL LIKELIHOOD

Chixiang Chen, Ming Wang, Rongling Wu, Runze Li

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Conventional likelihood-based information criteria for model selection rely on the assumed distribution of the data. However, for complex data, specifying this underlying distribution turns out to be challenging, and existing criteria may be limited and not sufficiently general to handle various model-selection problems. Here, we propose a robust and consistent model-selection criterion based on the empirical likelihood function, which is data driven. In particular, this framework adopts plug-in estimators that can be achieved by solving external estimating equations not limited to the empirical likelihood. This avoids potential computational-convergence issues and allows for versatile applications, such as generalized linear models, generalized estimating equations, and penalized regressions. The proposed criterion is derived initially from the asymptotic expansion of the marginal likelihood under a variable-selection framework, but more importantly, the consistent model-selection property is established in a general context. Extensive simulation studies confirm that the proposed model-selection criterion outperforms traditional criteria. Finally, an application to the Atherosclerosis Risk in Communities Study illustrates the practical value of the proposed framework.

Original languageEnglish (US)
Pages (from-to)1205-1223
Number of pages19
JournalStatistica Sinica
Volume32
Issue number3
DOIs
StatePublished - Jul 2022

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Cite this