TY - CHAP
T1 - Classical information theory
AU - Suhov, Y.
PY - 2010/9/1
Y1 - 2010/9/1
N2 - We begin with the definition of information gained by knowing that an event A has occurred: (1) (A dual point of view is also useful (although more evasive), where is the amount of information needed to specify event A.) Here and below stands for the underlying probability distribution. So the rarer an event A, the more information we gain if we know it has occurred. (More broadly, the rarer an event A, the more impact it will have. For example, the unlikely event that occurred in 1938 when fishermen caught a coelacanth - a prehistoric fish believed to be extinct - required a significant change to beliefs about evolution and biology. On the other hand, the likely event of catching a herring or a tuna would hardly imply any change in theories.)
AB - We begin with the definition of information gained by knowing that an event A has occurred: (1) (A dual point of view is also useful (although more evasive), where is the amount of information needed to specify event A.) Here and below stands for the underlying probability distribution. So the rarer an event A, the more information we gain if we know it has occurred. (More broadly, the rarer an event A, the more impact it will have. For example, the unlikely event that occurred in 1938 when fishermen caught a coelacanth - a prehistoric fish believed to be extinct - required a significant change to beliefs about evolution and biology. On the other hand, the likely event of catching a herring or a tuna would hardly imply any change in theories.)
UR - http://www.scopus.com/inward/record.url?scp=77956050466&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77956050466&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-11914-9_2
DO - 10.1007/978-3-642-11914-9_2
M3 - Chapter
AN - SCOPUS:77956050466
SN - 9783642119132
T3 - Lecture Notes in Physics
SP - 33
EP - 64
BT - Quantum Information, Computation and Cryptography
A2 - Benatti, Fabio
ER -