Multivariate Normal Distribution - Drawing Values From The Distribution

Drawing Values From The Distribution

A widely used method for drawing a random vector x from the N-dimensional multivariate normal distribution with mean vector μ and covariance matrix Σ works as follows:

  1. Find any real matrix A such that A AT = Σ. When Σ is positive-definite, the Cholesky decomposition is typically used, and the extended form of this decomposition can be always be used (as the covariance matrix may be only positive semi-definite) in both cases a suitable matrix A is obtained. An alternative is to use the matrix A = UΛ½ obtained from a spectral decomposition Σ = UΛUT of Σ. The former approach is more computationally straightforward but the matrices A change for different orderings of the elements of the random vector, while the latter approach gives matrices that are related by simple re-orderings. In theory both approaches give equally good ways of determining a suitable matrix A, but there are differences in compuation time.
  2. Let z = (z1, …, zN)T be a vector whose components are N independent standard normal variates (which can be generated, for example, by using the Box–Muller transform).
  3. Let x be μ + Az. This has the desired distribution due to the affine transformation property.

Read more about this topic:  Multivariate Normal Distribution

Famous quotes containing the words drawing, values and/or distribution:

    “Painting dissolves the forms at its command, or tends to; it melts them into color. Drawing, on the other hand, goes about resolving forms, giving edge and essence to things. To see shapes clearly, one outlines them—whether on paper or in the mind. Therefore, Michelangelo, a profoundly cultivated man, called drawing the basis of all knowledge whatsoever.”
    —Alexander Eliot (b. 1919)

    “Parents ought, through their own behavior and the values by which they live, to provide direction for their children. But they need to rid themselves of the idea that there are surefire methods which, when well applied, will produce certain predictable results. Whatever we do with and for our children ought to flow from our understanding of and our feelings for the particular situation and the relation we wish to exist between us and our child.”
    —Bruno Bettelheim (20th century)

    “Classical and romantic: private language of a family quarrel, a dead dispute over the distribution of emphasis between man and nature.”
    —Cyril Connolly (1903–1974)