Math 2.0

Statistics Definition

Multivariate normal distribution

Builds on Normal distributionRandom variable

Definition

Let k≥1k \ge 1 and let X=(X1,…,Xk)𝖳X = (X_1, \dots, X_k)^{\mathsf{T}} be a random vector in ℝk\mathbb{R}^k. Then XX is multivariate normal if there exist μ∈ℝk\mu \in \mathbb{R}^k, an integer ℓ≥1\ell \ge 1 and a real k×ℓk \times \ell matrix AA with this property. There is a vector Z=(Z1,…,Zℓ)𝖳Z = (Z_1, \dots, Z_\ell)^{\mathsf{T}} of independent 𝒩(0,1)\mathcal{N}(0, 1) random variables with X=AZ+μ.X = AZ + \mu. Then the law of XX depends only on μ\mu and on Σ=AA𝖳\Sigma = AA^{\mathsf{T}}. It is written 𝒩k(μ,Σ)\mathcal{N}_k(\mu, \Sigma).

Remarks

Here μ\mu is the mean vector, with μi=E[Xi]\mu_i = E[X_i], and Σ\Sigma is the covariance matrix, with Σij=Cov⁡(Xi,Xj)\Sigma_{ij} = \operatorname{Cov}(X_i, X_j). An equivalent condition: XX is multivariate normal if and only if a𝖳Xa^{\mathsf{T}} X has a normal distribution for each a∈ℝka \in \mathbb{R}^k. Here a constant counts as normal with variance 00. If Σ\Sigma is positive definite, XX has the density f(x)=1(2π)kdet⁡Σexp⁡(−12(x−μ)𝖳Σ−1(x−μ)),x∈ℝk.f(x) = \frac{1}{\sqrt{(2\pi)^k \det \Sigma}} \exp\left(-\tfrac{1}{2} (x - \mu)^{\mathsf{T}} \Sigma^{-1} (x - \mu)\right), \quad x \in \mathbb{R}^k. The components of a multivariate normal vector are independent if and only if they are uncorrelated, that is, if Σ\Sigma is diagonal.

Reading path

To understand this page from the ground up, read these 47 pages in order. The foundations come first.

  1. Construction of the reals from Cauchy sequences concept
  2. Element definition
  3. Integers object
  4. Ordered field definition
  5. Proposition concept
  6. Random experiment concept
  7. Rational numbers object
  8. Real numbers object
  9. Set definition
  10. Ring of integers statement
  11. Disjunction definition
  12. Implication definition
  13. Predicate definition
  14. Ordered pair definition
  15. Union definition
  16. Sample space definition
  17. The rationals form a field statement
  18. Existential quantifier definition
  19. Universal quantifier definition
  20. Cartesian product definition
  21. Subset definition
  22. The rationals form an ordered field statement
  23. Uniqueness quantifier definition
  24. Binary relation definition
  25. Universal set definition
  26. Order on the reals definition
  27. Power set definition
  28. Complement definition
  29. Function definition
  30. Interval definition
  31. Indicator function definition
  32. Preimage of a set definition
  33. Sigma-algebra definition
  34. Event definition
  35. Borel sigma-algebra definition
  36. Probability axioms concept
  37. Probability measure definition
  38. Probability distribution definition
  39. Dirac measure definition
  40. Probability space definition
  41. Random variable definition
  42. Cumulative distribution function definition
  43. Random variable with a density definition
  44. Probability density function definition
  45. Density of the normal distribution definition
  46. Normal distribution definition
  47. Multivariate normal distribution definition

Where this leads

10 pages build on this one.

Further reading

  1. Web https://en.wikipedia.org/wiki/Multivariate_normal_distribution, Normal random vector
  2. Web https://en.wikipedia.org/wiki/Multivariate_normal_distribution, Non-degenerate case
About this page
Tag0G558GJQMW
URIm2://0G558GJQMW
Kinddefinition
WritingW1 stated
MSC62H05
DefinesMultivariate normal distribution
UsesNormal distribution, Random variable

Markdown · JSON · Edit on GitHub

What this page needs for W2

  • edge instance_of in: one example (0 of 1)
  • edge not_instance_of in: one non-example that fails one clause (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

Used by