Semi-supervised dimensionality reduction for analyzing high-dimensional data with constraints

Su Yan, Sofien Bouaziz, Dongwon Lee, Jesse Barlow

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

In this paper, we present a novel semi-supervised dimensionality reduction technique to address the problems of inefficient learning and costly computation in coping with high-dimensional data. Our method named the dual subspace projections (DSP) embeds high-dimensional data in an optimal low-dimensional space, which is learned with a few user-supplied constraints and the structure of input data. The method projects data into two different subspaces respectively the kernel space and the original input space. Each projection is designed to enforce one type of constraints and projections in the two subspaces interact with each other to satisfy constraints maximally and preserve the intrinsic data structure. Compared to existing techniques, our method has the following advantages: (1) it benefits from constraints even when only a few are available; (2) it is robust and free from overfitting; and (3) it handles nonlinearly separable data, but learns a linear data transformation. As a conclusion, our method can be easily generalized to new data points and is efficient in dealing with large datasets. An empirical study using real data validates our claims so that significant improvements in learning accuracy can be obtained after the DSP-based dimensionality reduction is applied to high-dimensional data.

Original languageEnglish (US)
Pages (from-to)114-124
Number of pages11
JournalNeurocomputing
Volume76
Issue number1
DOIs
StatePublished - Jan 15 2012

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Semi-supervised dimensionality reduction for analyzing high-dimensional data with constraints'. Together they form a unique fingerprint.

Cite this