Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate, information, loss, sensitive, dependence, initial and/or conditions:
“Strange that the vanity which accompanies beauty—excusable, perhaps, when there is such great beauty, or at any rate understandable—should persist after the beauty was gone.”
—Mary A. [Elizabeth, Countess Von] Arnim (1866–1941)
“I was brought up to believe that the only thing worth doing was to add to the sum of accurate information in the world.”
—Margaret Mead (1901–1978)
“...to many a mother’s heart has come the disappointment of a loss of power, a limitation of influence when early manhood takes the boy from the home, or when even before that time, in school, or where he touches the great world and begins to be bewildered with its controversies, trade and economics and politics make their imprint even while his lips are dewy with his mother’s kiss.”
—J. Ellen Foster (1840–1910)
“A million years of sensitive men dying for their dreams. For what? So you can swim and dance and play.”
—David Duncan (b.1913)
“As, therefore, we can have no dependence upon morality without religion;Mso, on the other hand, there is nothing better to be expected from religion without morality;Mnevertheless, ‘tis no prodigy to see a man whose real moral character stands very low, who yet entertains the highest notion of himself, in the light of a religious man.”
—Laurence Sterne (1713–1768)
“No punishment has ever possessed enough power of deterrence to prevent the commission of crimes. On the contrary, whatever the punishment, once a specific crime has appeared for the first time, its reappearance is more likely than its initial emergence could ever have been.”
—Hannah Arendt (1906–1975)
“My dear young friend ... civilization has absolutely no need of nobility or heroism. These things are symptoms of political inefficiency. In a properly organized society like ours, nobody has any opportunities for being noble or heroic. Conditions have got to be thoroughly unstable before the occasion can arise.”
—Aldous Huxley (1894–1963)