Other Properties
For any and :
, where is the mutual information between and .
where is the mutual information between and .
For independent and :
Although the specific-conditional entropy, can be either lesser or greater than, can never exceed when is the uniform distribution.
Read more about this topic: Conditional Entropy
Famous quotes containing the word properties:
“The reason why men enter into society, is the preservation of their property; and the end why they choose and authorize a legislative, is, that there may be laws made, and rules set, as guards and fences to the properties of all the members of the society: to limit the power, and moderate the dominion, of every part and member of the society.”
—John Locke (1632–1704)
“A drop of water has the properties of the sea, but cannot exhibit a storm. There is beauty of a concert, as well as of a flute; strength of a host, as well as of a hero.”
—Ralph Waldo Emerson (1803–1882)