Classical information theory

Research output: Chapter in Book/Report/Conference proceedingChapter


We begin with the definition of information gained by knowing that an event A has occurred: (1) (A dual point of view is also useful (although more evasive), where is the amount of information needed to specify event A.) Here and below stands for the underlying probability distribution. So the rarer an event A, the more information we gain if we know it has occurred. (More broadly, the rarer an event A, the more impact it will have. For example, the unlikely event that occurred in 1938 when fishermen caught a coelacanth - a prehistoric fish believed to be extinct - required a significant change to beliefs about evolution and biology. On the other hand, the likely event of catching a herring or a tuna would hardly imply any change in theories.)

Original languageEnglish (US)
Title of host publicationQuantum Information, Computation and Cryptography
Subtitle of host publicationAn Introductory Survey of Theory, Technology and Experiments
EditorsFabio Benatti
Number of pages32
StatePublished - Sep 1 2010

Publication series

NameLecture Notes in Physics
ISSN (Print)0075-8450

All Science Journal Classification (ASJC) codes

  • Physics and Astronomy (miscellaneous)


Dive into the research topics of 'Classical information theory'. Together they form a unique fingerprint.

Cite this