This is a list of information theory topics, by Wikipedia page.
- A Mathematical Theory of Communication
- algorithmic information theory
- arithmetic encoding
- channel capacity
- Communication Theory of Secrecy Systems
- conditional entropy
- conditional quantum entropy
- confusion and diffusion
- cross entropy
- data compression
- entropy encoding
- Fisher information
- Hick's law
- Hirchman uncertainty
- Huffman encoding
- information bottleneck method
- information entropy
- information theoretic security
- information theory
- joint entropy
- Kullback-Leibler divergence
- lossless data compression
- negentropy
- principle of maximum entropy
- quantum information science
- range encoding
- redundancy
- Rényi entropy
- self-information
- Shannon limit
- Shannon's law
- Shannon's theorem
Famous quotes containing the words index, information, theory and/or articles:
“Exile as a mode of genius no longer exists; in place of Joyce we have the fragments of work appearing in Index on Censorship.”
—Nadine Gordimer (b. 1923)
“Computers are good at swift, accurate computation and at storing great masses of information. The brain, on the other hand, is not as efficient a number cruncher and its memory is often highly fallible; a basic inexactness is built into its design. The brain’s strong point is its flexibility. It is unsurpassed at making shrewd guesses and at grasping the total meaning of information presented to it.”
—Jeremy Campbell (b. 1931)
“We commonly say that the rich man can speak the truth, can afford honesty, can afford independence of opinion and action;—and that is the theory of nobility. But it is the rich man in a true sense, that is to say, not the man of large income and large expenditure, but solely the man whose outlay is less than his income and is steadily kept so.”
—Ralph Waldo Emerson (1803–1882)
“It was not sufficient for the disquiet of our minds that we disputed at the end of seventeen hundred years upon the articles of our own religion, but we must likewise introduce into our quarrels those of the Chinese. This dispute, however, was not productive of any great disturbances, but it served more than any other to characterize that busy, contentious, and jarring spirit which prevails in our climates.”
—Voltaire [François Marie Arouet] (1694–1778)