Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate, information, loss, sensitive, dependence, initial and/or conditions:
“If we became students of Malcolm X, we would not have young black men out there killing each other like they’re killing each other now. Young black men would not be impregnating young black women at the rate going on now. We’d not have the drugs we have now, or the alcoholism.”
—Spike Lee (b. 1956)
“Computers are good at swift, accurate computation and at storing great masses of information. The brain, on the other hand, is not as efficient a number cruncher and its memory is often highly fallible; a basic inexactness is built into its design. The brain’s strong point is its flexibility. It is unsurpassed at making shrewd guesses and at grasping the total meaning of information presented to it.”
—Jeremy Campbell (b. 1931)
“A little cooling down of animal excitability and instinct, a little loss of animal toughness, a little irritable weakness and descent of the pain-threshold, will bring the worm at the core of all our usual springs of delight into full view, and turn us into melancholy metaphysicians.”
—William James (1842–1910)
“A million years of sensitive men dying for their dreams. For what? So you can swim and dance and play.”
—David Duncan (b.1913)
“The more the specific feelings of being under obligation range themselves under a supreme principle of human dependence the clearer and more fertile will be the realization of the concept, indispensable to all true culture, of service; from the service of God down to the simple social relationship as between employer and employee.”
—Johan Huizinga (1872–1945)
“For those parents from lower-class and minority communities ... [who] have had minimal experience in negotiating dominant, external institutions or have had negative and hostile contact with social service agencies, their initial approaches to the school are often overwhelming and difficult. Not only does the school feel like an alien environment with incomprehensible norms and structures, but the families often do not feel entitled to make demands or force disagreements.”
—Sara Lawrence Lightfoot (20th century)
“For it is not possible to join serpentine wisdom with columbine innocency, except men know exactly all the conditions of the serpent: his baseness and going upon his belly, his volubility and lubricity, his envy and sting, and the rest; that is, all forms and natures of evil: for without this, virtue lieth open and unfenced.”
—Francis Bacon (1561–1626)