Truncated squarers with constant and variable correction

E. George Walters, Michael J. Schulte, Mark G. Arnold

Research output: Contribution to journalConference articlepeer-review

16 Scopus citations

Abstract

This paper describes truncated squarers, which are specialized squarers with a portion of the squaring matrix eliminated. Rounding error and errors due to matrix reduction are quantified and analyzed. Constant and variable correction techniques are presented that minimize either the mean error or the maximum absolute error as required by the application. Area and delay estimates are presented for a number of designs, as well as error statistics obtained both analytically and numerically by exhaustive simulation. As an example, one design of a 16-bit truncated squarer using constant correction is 10.1 % faster and requires 27.9 % less area than a comparable standard squarer with true rounding. The range of error for this truncated squarer is - 0.892 to + 0.625 ulps, compared to ±0.5 ulps for the standard squarer.

Original languageEnglish (US)
Article number05
Pages (from-to)40-50
Number of pages11
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume5559
DOIs
StatePublished - 2004
EventAdvanced Signal Processing Algorithms, Architectures, and Implementations XIV - Denver, CO, United States
Duration: Aug 4 2004Aug 6 2004

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Truncated squarers with constant and variable correction'. Together they form a unique fingerprint.

Cite this