Law of Large Numbers
Common intuition suggests that if a fair coin is tossed many times, then roughly half of the time it will turn up heads, and the other half it will turn up tails. Furthermore, the more often the coin is tossed, the more likely it should be that the ratio of the number of heads to the number of tails will approach unity. Modern probability provides a formal version of this intuitive idea, known as the law of large numbers. This law is remarkable because it is not assumed in the foundations of probability theory, but instead emerges out of these foundations as a theorem. Since it links theoretically derived probabilities to their actual frequency of occurrence in the real world, the law of large numbers is considered as a pillar in the history of statistical theory and has had widespread influence.
The law of large numbers (LLN) states that the sample average
of a sequence of independent and identically distributed random variables converges towards their common expectation, provided that the expectation of is finite.
It is in the different forms of convergence of random variables that separates the weak and the strong law of large numbers
It follows from the LLN that if an event of probability p is observed repeatedly during independent experiments, the ratio of the observed frequency of that event to the total number of repetitions converges towards p.
For example, if are independent Bernoulli random variables taking values 1 with probability p and 0 with probability 1-p, then for all i, so that converges to p almost surely.
Read more about this topic: Probability Theory
Famous quotes containing the words law of, law, large and/or numbers:
“To expect to increase prices and then to maintain them at a higher level by means of a plan which must of necessity increase production while decreasing consumption is to fly in the face of an economic law as well established as any law of nature.”
—Calvin Coolidge (1872–1933)
“The only law was that enforced by the Creek Lighthorsemen and the U.S. deputy marshals who paid rare and brief visits; or the “two volumes of common law” that every man carried strapped to his thighs.”
—State of Oklahoma, U.S. relief program (1935-1943)
“O thou undaunted daughter of desires!
By all thy dower of lights and fires;
By all the eagle in thee, all the dove;
By all thy lives and deaths of love;
By thy large draughts of intellectual day,
And by thy thirsts of love more large then they;
By all thy brim-fill’d Bowls of fierce desire,
By thy last Morning’s draught of liquid fire;
By the full kingdom of that final kiss
That seiz’d thy parting Soul, and seal’d thee his;”
—Richard Crashaw (1613?–1649)
“I had a feeling that out there, there were very poor people who didn’t have enough to eat. But they wore wonderfully colored rags and did musical numbers up and down the streets together.”
—Jill Robinson (b. 1936)