Multivariate Normal Distribution - Drawing Values From The Distribution

Drawing Values From The Distribution

A widely used method for drawing a random vector x from the N-dimensional multivariate normal distribution with mean vector μ and covariance matrix Σ works as follows:

  1. Find any real matrix A such that A AT = Σ. When Σ is positive-definite, the Cholesky decomposition is typically used, and the extended form of this decomposition can be always be used (as the covariance matrix may be only positive semi-definite) in both cases a suitable matrix A is obtained. An alternative is to use the matrix A = UΛ½ obtained from a spectral decomposition Σ = UΛUT of Σ. The former approach is more computationally straightforward but the matrices A change for different orderings of the elements of the random vector, while the latter approach gives matrices that are related by simple re-orderings. In theory both approaches give equally good ways of determining a suitable matrix A, but there are differences in compuation time.
  2. Let z = (z1, …, zN)T be a vector whose components are N independent standard normal variates (which can be generated, for example, by using the Box–Muller transform).
  3. Let x be μ + Az. This has the desired distribution due to the affine transformation property.

Read more about this topic:  Multivariate Normal Distribution

Famous quotes containing the words drawing, values and/or distribution:

    “My Christian friends, in bonds of love, whose hearts in sweetest union join,
    Your friendship’s like a drawing band, yet we must take the parting hand.
    Your company’s sweet, your union dear; Your words delightful to my ear,
    Yet when I see that we must part, You draw like cords around my heart.”
    —John Blain (18th century)

    “During our twenties...we act toward the new adulthood the way sociologists tell us new waves of immigrants acted on becoming Americans: we adopt the host culture’s values in an exaggerated and rigid fashion until we can rethink them and make them our own. Our idea of what adults are and what we’re supposed to be is composed of outdated childhood concepts brought forward.”
    —Roger Gould (20th century)

    “There is the illusion of time, which is very deep; who has disposed of it? Mor come to the conviction that what seems the succession of thought is only the distribution of wholes into causal series.”
    —Ralph Waldo Emerson (1803–1882)