Deterministic annealing for trellis quantizer and HMM design using Baum-Welch re-estimation

D. Miller, K. Rose, P. A. Chou

Research output: Contribution to journalArticlepeer-review

10 Scopus citations


The deterministic annealing algorithm for data clustering is extended to address the trellis quantizer design problem. The approach is derived within information theory and probability theory, using the principle of maximum entropy to induce a distribution over all possible path encodings of the training set. The resulting method is intimately connected to estimation procedures on Markov chains. Performance gains over known methods are obtained for memoryless, multimodal scalar sources as well as for the vector Gaussian and Laplacian sources. The method is also suggested for an estimation problem in hidden Markov models. For a Gaussian mixture state example, this approach achieves a greater likelihood value than the best result of standard Baum-Welch re-estimation, based on numerous initializations within the data.

Original languageEnglish (US)
Article number389482
Pages (from-to)V261-V264
JournalICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
StatePublished - 1994

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Electrical and Electronic Engineering


Dive into the research topics of 'Deterministic annealing for trellis quantizer and HMM design using Baum-Welch re-estimation'. Together they form a unique fingerprint.

Cite this