Consistent Estimator - Establishing Consistency

Establishing Consistency

The notion of asymptotic consistency is very close, almost synonymous to the notion of convergence in probability. As such, any theorem, lemma, or property which establishes convergence in probability may be used to prove the consistency. Many such tools exist:

  • In order to demonstrate consistency directly from the definition one can use the inequality
\Pr\!\big \leq \frac{\operatorname{E}\big}{\varepsilon},

the most common choice for function h being either the absolute value (in which case it is known as Markov inequality), or the quadratic function (respectively Chebychev's inequality).

  • Another useful result is the continuous mapping theorem: if Tn is consistent for θ and g(·) is a real-valued function continuous at point θ, then g(Tn) will be consistent for g(θ):
T_n\ \xrightarrow{p}\ \theta\ \quad\Rightarrow\quad g(T_n)\ \xrightarrow{p}\ g(\theta)
  • Slutsky’s theorem can be used to combine several different estimators, or an estimator with a non-random covergent sequence. If Tn →pα, and Sn →pβ, then
\begin{align} & T_n + S_n \ \xrightarrow{p}\ \alpha+\beta, \\ & T_n S_n \ \xrightarrow{p}\ \alpha \beta, \\ & T_n / S_n \ \xrightarrow{p}\ \alpha/\beta, \text{ provided that }\beta\neq0 \end{align}
  • If estimator Tn is given by an explicit formula, then most likely the formula will employ sums of random variables, and then the law of large numbers can be used: for a sequence {Xn} of random variables and under suitable conditions,
  • If estimator Tn is defined implicitly, for example as a value that maximizes certain objective function (see extremum estimator), then a more complicated argument involving stochastic equicontinuity has to be used.

Read more about this topic:  Consistent Estimator

Famous quotes containing the words establishing and/or consistency:

    “The conclusion suggested by these arguments might be called the paradox of theorizing. It asserts that if the terms and the general principles of a scientific theory serve their purpose, i. e., if they establish the definite connections among observable phenomena, then they can be dispensed with since any chain of laws and interpretive statements establishing such a connection should then be replaceable by a law which directly links observational antecedents to observational consequents.”
    —C.G. (Carl Gustav)

    “The lawyer’s truth is not Truth, but consistency or a consistent expediency.”
    —Henry David Thoreau (1817–1862)