Definition
The joint entropy of two variables and is defined as
where and are particular values of and, respectively, is the probability of these values occurring together, and is defined to be 0 if .
For more than two variables this expands to
where are particular values of, respectively, is the probability of these values occurring together, and is defined to be 0 if .
Read more about this topic: Joint Entropy
Famous quotes containing the word definition:
“... if, as women, we accept a philosophy of history that asserts that women are by definition assimilated into the male universal, that we can understand our past through a male lensif we are unaware that women even have a historywe live our lives similarly unanchored, drifting in response to a veering wind of myth and bias.”
—Adrienne Rich (b. 1929)
“One definition of man is an intelligence served by organs.”
—Ralph Waldo Emerson (18031882)
“According to our social pyramid, all men who feel displaced racially, culturally, and/or because of economic hardships will turn on those whom they feel they can order and humiliate, usually women, children, and animalsjust as they have been ordered and humiliated by those privileged few who are in power. However, this definition does not explain why there are privileged men who behave this way toward women.”
—Ana Castillo (b. 1953)