This is a list of information theory topics, by Wikipedia page.
- A Mathematical Theory of Communication
- algorithmic information theory
- arithmetic encoding
- channel capacity
- Communication Theory of Secrecy Systems
- conditional entropy
- conditional quantum entropy
- confusion and diffusion
- cross entropy
- data compression
- entropy encoding
- Fisher information
- Hick's law
- Hirchman uncertainty
- Huffman encoding
- information bottleneck method
- information entropy
- information theoretic security
- information theory
- joint entropy
- Kullback-Leibler divergence
- lossless data compression
- negentropy
- principle of maximum entropy
- quantum information science
- range encoding
- redundancy
- Rényi entropy
- self-information
- Shannon limit
- Shannon's law
- Shannon's theorem
Famous quotes containing the words index, information, theory and/or articles:
“Exile as a mode of genius no longer exists; in place of Joyce we have the fragments of work appearing in Index on Censorship.”
—Nadine Gordimer (b. 1923)
“English literature is a kind of training in social ethics.... English trains you to handle a body of information in a way that is conducive to action.”
—Marilyn Butler (b. 1937)
“If my theory of relativity is proven correct, Germany will claim me as a German and France will declare that I am a citizen of the world. Should my theory prove untrue, France will say that I am a German and Germany will declare that I am a Jew.”
—Albert Einstein (1879–1955)
“A dwarf who brings a standard along with him to measure his own size—take my word, is a dwarf in more articles than one.”
—Laurence Sterne (1713–1768)