Definition
The joint entropy of two variables and is defined as
where and are particular values of and, respectively, is the probability of these values occurring together, and is defined to be 0 if .
For more than two variables this expands to
where are particular values of, respectively, is the probability of these values occurring together, and is defined to be 0 if .
Read more about this topic: Joint Entropy
Famous quotes containing the word definition:
“Was man made stupid to see his own stupidity?
Is God by definition indifferent, beyond us all?
Is the eternal truth man’s fighting soul
Wherein the Beast ravens in its own avidity?”
—Richard Eberhart (b. 1904)
“It’s a rare parent who can see his or her child clearly and objectively. At a school board meeting I attended . . . the only definition of a gifted child on which everyone in the audience could agree was “mine.””
—Jane Adams (20th century)
“One definition of man is “an intelligence served by organs.””
—Ralph Waldo Emerson (1803–1882)