Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate, information, loss, sensitive, dependence, initial and/or conditions:
“You are more than entitled not to know what the word ‘performative’ means. It is a new word and an ugly word, and perhaps it does not mean anything very much. But at any rate there is one thing in its favor, it is not a profound word.”
—J.L. (John Langshaw)
“We hear a great deal of lamentation these days about writers having all taken themselves to the colleges and universities where they live decorously instead of going out and getting firsthand information about life. The fact is that anybody who has survived his childhood has enough information about life to last him the rest of his days.”
—Flannery O’Connor (1925–1964)
“No amount of skill on the part of the actress can make up for the loss of youth.”
—Ellen Terry (1847–1928)
“Quintilian [educational writer in Rome about A.D. 100] hoped that teachers would be sensitive to individual differences of temperament and ability. . . . Beating, he thought, was usually unnecessary. A teacher who had made the effort to understand his pupil’s individual needs and character could probably dispense with it: “I will content myself with saying that children are helpless and easily victimized, and that therefore no one should be given unlimited power over them.””
—C. John Sommerville (20th century)
“... dependence upon material possessions inevitably results in the destruction of human character.”
—Agnes E. Meyer (1887–1970)
“No punishment has ever possessed enough power of deterrence to prevent the commission of crimes. On the contrary, whatever the punishment, once a specific crime has appeared for the first time, its reappearance is more likely than its initial emergence could ever have been.”
—Hannah Arendt (1906–1975)
“Among the laws controlling human societies there is one more precise and clearer, it seems to me, than all the others. If men are to remain civilized or to become civilized, the art of association must develop and improve among them at the same speed as equality of conditions spreads.”
—Alexis de Tocqueville (1805–1859)