Other Properties
For any and :
, where is the mutual information between and .
where is the mutual information between and .
For independent and :
Although the specific-conditional entropy, can be either lesser or greater than, can never exceed when is the uniform distribution.
Read more about this topic: Conditional Entropy
Famous quotes containing the word properties:
“A drop of water has the properties of the sea, but cannot exhibit a storm. There is beauty of a concert, as well as of a flute; strength of a host, as well as of a hero.”
—Ralph Waldo Emerson (1803–1882)
“The reason why men enter into society, is the preservation of their property; and the end why they choose and authorize a legislative, is, that there may be laws made, and rules set, as guards and fences to the properties of all the members of the society: to limit the power, and moderate the dominion, of every part and member of the society.”
—John Locke (1632–1704)