A Deterministic Annealing Approach for Parsimonious Design of Piecewise Regression Models

Ajit V. Rao, David J. Miller, Kenneth Rose, Alien Gersho

Research output: Contribution to journalArticlepeer-review

47 Scopus citations


A new learning algorithm is proposed for piecewise regression modeling. It employs the technique of deterministic annealing to design space partition regression functions. While the performance of traditional space partition regression functions such as CART and MARS is limited by a simple tree-structured partition and by a hierarchical approach for design the deterministic annealing algorithm enables the joint optimization of a more powerful piecewise structure based on a Voronoi partition. The new method is demonstrated to achieve consistent performance improvements over regular CART as well as over its extension to allow arbitrary hyperplane boundaries. Comparison tests on several benchmark data sets from the regression literature are provided.

Original languageEnglish (US)
Pages (from-to)159-173
Number of pages15
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Issue number2
StatePublished - 1999

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics


Dive into the research topics of 'A Deterministic Annealing Approach for Parsimonious Design of Piecewise Regression Models'. Together they form a unique fingerprint.

Cite this