SVM decision boundary based discriminative subspace induction

Jiayong Zhang, Yanxi Liu

Research output: Contribution to journalArticlepeer-review

16 Scopus citations


We study the problem of linear dimension reduction for classification, with a focus on sufficient dimension reduction, i.e., finding subspaces without loss of discrimination power. First, we formulate the concept of sufficient subspace for classification in parallel terms as for regression. Then we present a new method to estimate the smallest sufficient subspace based on an improvement of decision boundary analysis (DBA). The main idea is to combine DBA with support vector machines (SVM) to overcome the inherent difficulty of DBA in small sample size situations while keeping DBA's estimation simplicity. The compact representation of SVM boundary results in a significant gain in both speed and accuracy over previous DBA implementations. Alternatively, this technique can be viewed as a way to reduce the run-time complexity of SVM itself. Comparative experiments on one simulated and four real-world benchmark datasets highlight the superior performance of the proposed approach.

Original languageEnglish (US)
Pages (from-to)1746-1758
Number of pages13
JournalPattern Recognition
Issue number10
StatePublished - Oct 2005

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'SVM decision boundary based discriminative subspace induction'. Together they form a unique fingerprint.

Cite this