Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate of, rate, information, loss, sensitive, dependence, initial and/or conditions:
“We all run on two clocks. One is the outside clock, which ticks away our decades and brings us ceaselessly to the dry season. The other is the inside clock, where you are your own timekeeper and determine your own chronology, your own internal weather and your own rate of living. Sometimes the inner clock runs itself out long before the outer one, and you see a dead man going through the motions of living.”
—Max Lerner (b. 1902)
““Terence, this is stupid stuff:
You eat your victuals fast enough;
There can’t be much amiss, ‘tis clear,
To see the rate you drink your beer.”
—A.E. (Alfred Edward)
“The real, then, is that which, sooner or later, information and reasoning would finally result in, and which is therefore independent of the vagaries of me and you. Thus, the very origin of the conception of reality shows that this conception essentially involves the notion of a COMMUNITY, without definite limits, and capable of a definite increase of knowledge.”
—Charles Sanders Peirce (1839–1914)
“I have always observed, when there is as much sour as sweet in a compliment, that an Englishman is eternally at a loss within himself, whether to take it, or let it alone: a Frenchman never is.”
—Laurence Sterne (1713–1768)
“The cultivation of one set of faculties tends to the disuse of others. The loss of one faculty sharpens others; the blind are sensitive in touch. Has not the extreme cultivation of the commercial faculty permitted others as essential to national life, to be blighted by disease?”
—J. Ellen Foster (1840–1910)
“... the whole Wilsonian buncombe ... its ideational hollowness, its ludicrous strutting and bombast, its heavy dependence upon greasy and meaningless words, its frequent descents to mere sound and fury, signifying nothing.”
—H.L. (Henry Lewis)
“Capital is a result of labor, and is used by labor to assist it in further production. Labor is the active and initial force, and labor is therefore the employer of capital.”
—Henry George (1839–1897)
“... we have every reason to rejoice when there are so many gains and when favorable conditions abound on every hand. The end is not yet in sight, but it can not be far away. The road before us is shorter than the road behind.”
—Lucy Stone (1818–1893)