Multivariate Normal Distribution - Drawing Values From The Distribution

Drawing Values From The Distribution

A widely used method for drawing a random vector x from the N-dimensional multivariate normal distribution with mean vector μ and covariance matrix Σ works as follows:

  1. Find any real matrix A such that A AT = Σ. When Σ is positive-definite, the Cholesky decomposition is typically used, and the extended form of this decomposition can be always be used (as the covariance matrix may be only positive semi-definite) in both cases a suitable matrix A is obtained. An alternative is to use the matrix A = UΛ½ obtained from a spectral decomposition Σ = UΛUT of Σ. The former approach is more computationally straightforward but the matrices A change for different orderings of the elements of the random vector, while the latter approach gives matrices that are related by simple re-orderings. In theory both approaches give equally good ways of determining a suitable matrix A, but there are differences in compuation time.
  2. Let z = (z1, …, zN)T be a vector whose components are N independent standard normal variates (which can be generated, for example, by using the Box–Muller transform).
  3. Let x be μ + Az. This has the desired distribution due to the affine transformation property.

Read more about this topic:  Multivariate Normal Distribution

Famous quotes containing the words drawing, values and/or distribution:

    “For later in the vast gloom of cities, only there you learn
    How the ideas were good only because they had to die,
    Leaving you alone and skinless, a drawing by Vesalius.”
    —John Ashbery (b. 1927)

    “Today so much rebellion is aimless and demoralizing precisely because children have no values to challenge. Teenage rebellion is a testing process in which young people try out various values in order to make them their own. But during those years of trial, error, embarrassment, a child needs family standards to fall back on, reliable habits of thought and feeling that provide security and protection.”
    —Neil Kurshan (20th century)

    “My topic for Army reunions ... this summer: How to prepare for war in time of peace. Not by fortifications, by navies, or by standing armies. But by policies which will add to the happiness and the comfort of all our people and which will tend to the distribution of intelligence [and] wealth equally among all. Our strength is a contented and intelligent community.”
    —Rutherford Birchard Hayes (1822–1893)