Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate, information, loss, sensitive, dependence, initial and/or conditions:
“If you could choose your parents,... we would rather have a mother who felt a sense of guilt—at any rate who felt responsible, and felt that if things went wrong it was probably her fault—we’d rather have that than a mother who immediately turned to an outside thing to explain everything, and said it was due to the thunderstorm last night or some quite outside phenomenon and didn’t take responsibility for anything.”
—D.W. Winnicott (20th century)
“The information links are like nerves that pervade and help to animate the human organism. The sensors and monitors are analogous to the human senses that put us in touch with the world. Data bases correspond to memory; the information processors perform the function of human reasoning and comprehension. Once the postmodern infrastructure is reasonably integrated, it will greatly exceed human intelligence in reach, acuity, capacity, and precision.”
—Albert Borgman, U.S. educator, author. Crossing the Postmodern Divide, ch. 4, University of Chicago Press (1992)
“Nothing that grieves us can be called little: by the eternal laws of proportion a child’s loss of a doll and a king’s loss of a crown are events of the same size.”
—Mark Twain [Samuel Langhorne Clemens] (1835–1910)
“Every poem of value must have a residue [of language].... It cannot be exhausted because our lives are not long enough to do so. Indeed, in the greatest poetry, the residue may seem to increase as our experience increases—that is, as we become more sensitive to the particular ignitions in its language. We return to a poem not because of its symbolic [or sociological] value, but because of the waste, or subversion, or difficulty, or consolation of its provision.”
—William Logan, U.S. educator. “Condition of the Individual Talent,” The Sewanee Review, p. 93, Winter 1994.
“The invalid is a parasite on society. In a certain state it is indecent to go on living. To vegetate on in cowardly dependence on physicians and medicaments after the meaning of life, the right to life, has been lost ought to entail the profound contempt of society.”
—Friedrich Nietzsche (1844–1900)
“Capital is a result of labor, and is used by labor to assist it in further production. Labor is the active and initial force, and labor is therefore the employer of capital.”
—Henry George (1839–1897)
“Technological change defines the horizon of our material world as it shapes the limiting conditions of what is possible and what is barely imaginable. It erodes ... assumptions about the nature of our reality, the “pattern” in which we dwell, and lays open new choices.”
—Shoshana Zuboff (b. 1951)