Conditional Entropy (equivocation)
Given a particular value of a random variable, the conditional entropy of given is defined as:
where is the conditional probability of given .
The conditional entropy of given, also called the equivocation of about is then given by:
A basic property of the conditional entropy is that:
Read more about this topic: Quantities Of Information
Famous quotes containing the words conditional and/or entropy:
“Conditional love is love that is turned off and on....Some parents only show their love after a child has done something that pleases them. “I love you, honey, for cleaning your room!” Children who think they need to earn love become people pleasers, or perfectionists. Those who are raised on conditional love never really feel loved.”
—Louise Hart (20th century)
“Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.”
—Václav Havel (b. 1936)