Sample Standard Deviation - Rapid Calculation Methods

Rapid Calculation Methods

It has been suggested that this article be merged into Algorithms for calculating variance. (Discuss)

The following two formulas can represent a running (continuous) standard deviation. A set of two power sums s1 and s2 are computed over a set of N values of x, denoted as x1, ..., xN:

Given the results of these three running summations, the values N, s1, s2 can be used at any time to compute the current value of the running standard deviation:

Where :

Similarly for sample standard deviation,

In a computer implementation, as the three sj sums become large, we need to consider round-off error, arithmetic overflow, and arithmetic underflow. The method below calculates the running sums method with reduced rounding errors. This is a "one pass" algorithm for calculating variance of n samples without the need to store prior data during the calculation. Applying this method to a time series will result in successive values of standard deviation corresponding to n data points as n grows larger with each new sample, rather than a constant-width sliding window calculation.

For k = 1, ..., n:

\begin{align} A_0 &= 0\\ A_k &= A_{k-1}+\frac{x_k-A_{k-1}}{k} \end{align}

where A is the mean value.

\begin{align} Q_0 &= 0\\ Q_k &= Q_{k-1}+\frac{k-1}{k} (x_k-A_{k-1})^2 = Q_{k-1}+ (x_k-A_{k-1})(x_k-A_k) \end{align}

Sample variance:

Population variance:

Read more about this topic:  Sample Standard Deviation

Famous quotes containing the words rapid, calculation and/or methods:

    “It now appears that the negro race is, more than any other, susceptible of rapid civilization. The emancipation is observed, in the islands, to have wrought for the negro a benefit as sudden as when a thermometer is brought out of the shade into the sun. It has given him eyes and ears.”
    —Ralph Waldo Emerson (1803–1882)

    “Common sense is the measure of the possible; it is composed of experience and prevision; it is calculation appled to life.”
    —Henri-Frédéric Amiel (1821–1881)

    “I believe in women; and in their right to their own best possibilities in every department of life. I believe that the methods of dress practiced among women are a marked hindrance to the realization of these possibilities, and should be scorned or persuaded out of society.”
    —Elizabeth Stuart Phelps (1844–1911)