Data Compression - Theory

Theory

The theoretical background of compression is provided by information theory (which is closely related to algorithmic information theory) for lossless compression, and by rate–distortion theory for lossy compression. These fields of study were essentially created by Claude Shannon, who published fundamental papers on the topic in the late 1940s and early 1950s. Coding theory is also related. The idea of data compression is deeply connected with statistical inference.

Read more about this topic:  Data Compression

Famous quotes containing the word theory:

    The theory of the Communists may be summed up in the single sentence: Abolition of private property.
    Karl Marx (1818–1883)

    Everything to which we concede existence is a posit from the standpoint of a description of the theory-building process, and simultaneously real from the standpoint of the theory that is being built. Nor let us look down on the standpoint of the theory as make-believe; for we can never do better than occupy the standpoint of some theory or other, the best we can muster at the time.
    Willard Van Orman Quine (b. 1908)

    Won’t this whole instinct matter bear revision?
    Won’t almost any theory bear revision?
    To err is human, not to, animal.
    Robert Frost (1874–1963)