Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate, information, loss, sensitive, dependence, initial and/or conditions:
“As a novelist, I cannot occupy myself with “characters,” or at any rate central ones, who lack panache, in one or another sense, who would be incapable of a major action or a major passion, or who have not a touch of the ambiguity, the ultimate unaccountability, the enlarging mistiness of persons “in history.” History, as more austerely I now know it, is not romantic. But I am.”
—Elizabeth Bowen (1899–1973)
“The family circle has widened. The worldpool of information fathered by the electric media—movies, Telstar, flight—far surpasses any possible influence mom and dad can now bring to bear. Character no longer is shaped by only two earnest, fumbling experts. Now all the world’s a sage.”
—Marshall McLuhan (1911–1980)
“No need to be sentimental to mourn the loss of Paradise.”
—Mason Cooley (b. 1927)
“The hand I burned and whose skin is shriveled like that of a mummy’s is less sensitive than the other to cold or heat. My soul is the same; it passed through fire.”
—Gustave Flaubert (1821–1880)
“... dependence upon material possessions inevitably results in the destruction of human character.”
—Agnes E. Meyer (1887–1970)
“Capital is a result of labor, and is used by labor to assist it in further production. Labor is the active and initial force, and labor is therefore the employer of capital.”
—Henry George (1839–1897)
“What is Americanism? Every one has a different answer. Some people say it is never to submit to the dictation of a King. Others say Americanism is the pride of liberty and the defence of an insult to the flag with their gore. When some half-developed person tramples on that flag, we should be ready to pour out the blood of the nation, they say. But do we not sit in silence when that flag waves over living conditions which should be an insult to all patriotism?”
—Anna Howard Shaw (1847–1919)