Probability Density Function - Dependent Variables and Change of Variables

Dependent Variables and Change of Variables

If the probability density function of a random variable X is given as fX(x), it is possible (but often not necessary; see below) to calculate the probability density function of some variable Y = g(X). This is also called a “change of variable” and is in practice used to generate a random variable of arbitrary shape fg(X) = fY using a known (for instance uniform) random number generator.

If the function g is monotonic, then the resulting density function is

Here g−1 denotes the inverse function.

This follows from the fact that the probability contained in a differential area must be invariant under change of variables. That is,

or

For functions which are not monotonic the probability density function for y is

where n(y) is the number of solutions in x for the equation g(x) = y, and g−1k(y) are these solutions.

It is tempting to think that in order to find the expected value E(g(X)) one must first find the probability density fg(X) of the new random variable Y = g(X). However, rather than computing

one may find instead

The values of the two integrals are the same in all cases in which both X and g(X) actually have probability density functions. It is not necessary that g be a one-to-one function. In some cases the latter integral is computed much more easily than the former.

Read more about this topic:  Probability Density Function

Famous quotes containing the words dependent, variables and/or change:

    Realism holds that things known may continue to exist unaltered when they are not known, or that things may pass in and out of the cognitive relation without prejudice to their reality, or that the existence of a thing is not correlated with or dependent upon the fact that anybody experiences it, perceives it, conceives it, or is in any way aware of it.
    William Pepperell Montague (1842–1910)

    The variables of quantification, ‘something,’ ‘nothing,’ ‘everything,’ range over our whole ontology, whatever it may be; and we are convicted of a particular ontological presupposition if, and only if, the alleged presuppositum has to be reckoned among the entities over which our variables range in order to render one of our affirmations true.
    Willard Van Orman Quine (b. 1908)

    I acknowledge that the balance I have achieved between work and family roles comes at a cost, and every day I must weigh whether I live with that cost happily or guiltily, or whether some other lifestyle entails trade-offs I might accept more readily. It is always my choice: to change what I cannot tolerate, or tolerate what I cannot—or will not—change.
    Melinda M. Marshall (20th century)