Integration By Substitution - Application in Probability

Application in Probability

Substitution can be used to answer the following important question in probability: given a random variable with probability density and another random variable related to by the equation, what is the probability density for ?

It is easiest to answer this question by first answering a slightly different question: what is the probability that takes a value in some particular subset ? Denote this probability . Of course, if has probability density then the answer is

but this isn't really useful because we don't know p_y; it's what we're trying to find in the first place. We can make progress by considering the problem in the variable . takes a value in S whenever X takes a value in, so

Changing from variable x to y gives

$P(Y \in S) = \int_{\Phi^{-1}(S)} p_x(x)~dx = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy.$

Combining this with our first equation gives

$\int_S p_y(y)~dy = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy$

$p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|.$

In the case where and depend on several uncorrelated variables, i.e., and, can be found by substitution in several variables discussed above. The result is

$p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\det \left \right|.$

Read more about this topic: Integration By Substitution

Famous quotes containing the words application and/or probability:

“Most people, no doubt, when they espouse human rights, make their own mental reservations about the proper application of the word “human.””
—Suzanne Lafollette (1893–1983)

“Legends of prediction are common throughout the whole Household of Man. Gods speak, spirits speak, computers speak. Oracular ambiguity or statistical probability provides loopholes, and discrepancies are expunged by Faith.”
—Ursula K. Le Guin (b. 1929)