Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate of, rate, information, loss, sensitive, dependence, initial and/or conditions:
“At this very moment,... the most frightful horrors are taking place in every corner of the world. People are being crushed, slashed, disembowelled, mangled; their dead bodies rot and their eyes decay with the rest. Screams of pain and fear go pulsing through the air at the rate of eleven hundred feet per second. After travelling for three seconds they are perfectly inaudible. These are distressing facts; but do we enjoy life any the less because of them? Most certainly we do not.”
—Aldous Huxley (1894–1963)
“All of us failed to match our dreams of perfection. So I rate us on the basis of our splendid failure to do the impossible.”
—William Faulkner (1897–1962)
“Information networks straddle the world. Nothing remains concealed. But the sheer volume of information dissolves the information. We are unable to take it all in.”
—Günther Grass (b. 1927)
“If but some vengeful god would call to me
From up the sky, and laugh: “Thou suffering thing,
Know that thy sorrow is my ecstasy,
That thy love’s loss is my hate’s profiting!””
—Thomas Hardy (1840–1928)
“Compared to other parents, remarried parents seem more desirous of their child’s approval, more alert to the child’s emotional state, and more sensitive in their parent-child relations. Perhaps this is the result of heightened empathy for the child’s suffering, perhaps it is a guilt reaction; in either case, it gives the child a potent weapon—the power to disrupt the new household and come between parent and the new spouse.”
—Letty Cottin Pogrebin (20th century)
“This immediate dependence of language upon nature, this conversion of an outward phenomenon into a type of somewhat in human life, never loses its power to affect us. It is this which gives that piquancy to the conversation of a strong-natured farmer or backwoodsman, which all men relish.”
—Ralph Waldo Emerson (1803–1882)
“Capital is a result of labor, and is used by labor to assist it in further production. Labor is the active and initial force, and labor is therefore the employer of capital.”
—Henry George (1839–1897)
“For it is not possible to join serpentine wisdom with columbine innocency, except men know exactly all the conditions of the serpent: his baseness and going upon his belly, his volubility and lubricity, his envy and sting, and the rest; that is, all forms and natures of evil: for without this, virtue lieth open and unfenced.”
—Francis Bacon (1561–1626)