Information theory studies the transmission, processing, extraction, and utilization of information. Abstractly, information can be thought of as the resolution of uncertainty. In the case of communication of … 展开

Information theory is based on probability theory and statistics, where quantified information is usually described in terms of bits. Information theory often concerns itself with measures of … 展开

Intelligence uses and secrecy applications
Information theoretic concepts apply to cryptography and cryptanalysis. Turing's information unit, the ban, was used in the Ultra project, … 展开

The classic work
• Shannon, C.E. (1948), "A Mathematical Theory of Communication", Bell System Technical Journal, 27, pp. … 展开

The landmark event establishing the discipline of information theory and bringing it to immediate worldwide attention was the … 展开

Coding theory is one of the most important and direct applications of information theory. It can be subdivided into source coding theory and channel coding theory. Using a statistical … 展开

• Mathematics portal
• Algorithmic probability
• Bayesian inference
• Communication theory
• Constructor theory – a generalization of information theory that includes quantum information 展开