This is a list of information theory topics, by Wikipedia page.
- A Mathematical Theory of Communication
- algorithmic information theory
- arithmetic encoding
- channel capacity
- Communication Theory of Secrecy Systems
- conditional entropy
- conditional quantum entropy
- confusion and diffusion
- cross entropy
- data compression
- entropy encoding
- Fisher information
- Hick's law
- Hirchman uncertainty
- Huffman encoding
- information bottleneck method
- information entropy
- information theoretic security
- information theory
- joint entropy
- Kullback-Leibler divergence
- lossless data compression
- negentropy
- principle of maximum entropy
- quantum information science
- range encoding
- redundancy
- Rényi entropy
- self-information
- Shannon limit
- Shannon's law
- Shannon's theorem
Famous quotes containing the words index, information, theory and/or articles:
“Exile as a mode of genius no longer exists; in place of Joyce we have the fragments of work appearing in Index on Censorship.”
—Nadine Gordimer (b. 1923)
“Rejecting all organs of information ... but my senses, I rid myself of the Pyrrhonisms with which an indulgence in speculations hyperphysical and antiphysical so uselessly occupy and disquiet the mind.”
—Thomas Jefferson (1743–1826)
“every subjective phenomenon is essentially connected with a single point of view, and it seems inevitable that an objective, physical theory will abandon that point of view.”
—Thomas Nagel (b. 1938)
“A dwarf who brings a standard along with him to measure his own size—take my word, is a dwarf in more articles than one.”
—Laurence Sterne (1713–1768)