Conditional Entropy (equivocation)
Given a particular value of a random variable, the conditional entropy of given is defined as:
where is the conditional probability of given .
The conditional entropy of given, also called the equivocation of about is then given by:
A basic property of the conditional entropy is that:
Read more about this topic: Quantities Of Information
Famous quotes containing the words conditional and/or entropy:
“The population of the world is a conditional population; these are not the best, but the best that could live in the existing state of soils, gases, animals, and morals: the best that could yet live; there shall be a better, please God.”
—Ralph Waldo Emerson (1803–1882)
“Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.”
—Václav Havel (b. 1936)