Joint Entropy - Relations To Other Entropy Measures

Relations To Other Entropy Measures

Joint entropy is used in the definition of conditional entropy

and mutual information

In quantum information theory, the joint entropy is generalized into the joint quantum entropy.

Read more about this topic:  Joint Entropy

Famous quotes containing the words relations, entropy and/or measures:

    Consciousness, we shall find, is reducible to relations between objects, and objects we shall find to be reducible to relations between different states of consciousness; and neither point of view is more nearly ultimate than the other.
    —T.S. (Thomas Stearns)

    Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.
    Václav Havel (b. 1936)

    To have the fear of God before our eyes, and, in our mutual dealings with each other, to govern our actions by the eternal measures of right and wrong:MThe first of these will comprehend the duties of religion;Mthe second, those of morality, which are so inseparably connected together, that you cannot divide these two tables ... without breaking and mutually destroying them both.
    Laurence Sterne (1713–1768)