Block-Wise Variable Selection for Clustering Via Latent States of Mixture Models

Beomseok Seo, Lin Lin, Jia Li

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Mixture modeling is a major paradigm for clustering in statistics. In this article, we develop a new block-wise variable selection method for clustering by exploiting the latent states of the hidden Markov model on variable blocks or the Gaussian mixture model. The variable blocks are formed by depth-first-search on a dendrogram created based on the mutual information between any pair of variables. It is demonstrated that the latent states of the variable blocks together with the mixture model parameters can represent the original data effectively and much more compactly. We thus cluster the data using the latent states and select variables according to the relationship between the states and the clusters. As true class labels are unknown in the unsupervised setting, we first generate more refined clusters, namely, semi-clusters, for variable selection and then determine the final clusters based on the dimension reduced data. Experiments on simulated and real data show that the new method is highly competitive in terms of clustering accuracy compared with several widely used methods. Supplementary materials for this article are available online.

Original languageEnglish (US)
Pages (from-to)138-150
Number of pages13
JournalJournal of Computational and Graphical Statistics
Volume31
Issue number1
DOIs
StatePublished - 2022

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Statistics, Probability and Uncertainty
  • Discrete Mathematics and Combinatorics

Fingerprint

Dive into the research topics of 'Block-Wise Variable Selection for Clustering Via Latent States of Mixture Models'. Together they form a unique fingerprint.

Cite this