Multivariate Normal Distribution - Drawing Values From The Distribution

Drawing Values From The Distribution

A widely used method for drawing a random vector x from the N-dimensional multivariate normal distribution with mean vector μ and covariance matrix Σ works as follows:

  1. Find any real matrix A such that A AT = Σ. When Σ is positive-definite, the Cholesky decomposition is typically used, and the extended form of this decomposition can be always be used (as the covariance matrix may be only positive semi-definite) in both cases a suitable matrix A is obtained. An alternative is to use the matrix A = UΛ½ obtained from a spectral decomposition Σ = UΛUT of Σ. The former approach is more computationally straightforward but the matrices A change for different orderings of the elements of the random vector, while the latter approach gives matrices that are related by simple re-orderings. In theory both approaches give equally good ways of determining a suitable matrix A, but there are differences in compuation time.
  2. Let z = (z1, …, zN)T be a vector whose components are N independent standard normal variates (which can be generated, for example, by using the Box–Muller transform).
  3. Let x be μ + Az. This has the desired distribution due to the affine transformation property.

Read more about this topic:  Multivariate Normal Distribution

Famous quotes containing the words drawing, values and/or distribution:

    “In the drawing room [of the Queen’s palace] hung a Venus and Cupid by Michaelangelo, in which, instead of a bit of drapery, the painter has placed Cupid’s foot between Venus’s thighs. Queen Caroline asked General Guise, an old connoisseur, if it was not a very fine piece? He replied “Madam, the painter was a fool, for he has placed the foot where the hand should be.””
    —Horace Walpole (1717–1797)

    “What we often take to be family values—the work ethic, honesty, clean living, marital fidelity, and individual responsibility—are in fact social, religious, or cultural values. To be sure, these values are transmitted by parents to their children and are familial in that sense. They do not, however, originate within the family. It is the value of close relationships with other family members, and the importance of these bonds relative to other needs.”
    —David Elkind (20th century)

    “In this distribution of functions, the scholar is the delegated intellect. In the right state, he is, Man Thinking. In the degenerate state, when the victim of society, he tends to become a mere thinker, or, still worse, the parrot of other men’s thinking.”
    —Ralph Waldo Emerson (1803–1882)