Math 2.0

Statistics Definition

Multivariate analysis of variance

Builds on Analysis of varianceMultivariate normal distributionStatistical hypothesis testDeterminantTrace of a matrixInvertible matrix

Definition

Let g≥2g \ge 2 and p≥1p \ge 1 be integers. For i=1,…,gi = 1, \ldots, g and j=1,…,nij = 1, \ldots, n_i, let XijX_{ij} be independent random vectors in ℝp\R^p with Xij∼Np(μi,Σ)X_{ij} \sim N_p(\mu_i, \Sigma), a multivariate normal distribution with unknown μi\mu_i and unknown common Σ\Sigma. Let N=n1+⋯+ngN = n_1 + \cdots + n_g, let Xˉi\bar X_i be the mean of group ii and Xˉ\bar X the mean of all NN observations. The between-group and within-group matrices are B=∑i=1gni(Xˉi−Xˉ)(Xˉi−Xˉ)T,W=∑i=1g∑j=1ni(Xij−Xˉi)(Xij−Xˉi)T.B = \sum_{i=1}^g n_i (\bar X_i - \bar X)(\bar X_i - \bar X)^T, \qquad W = \sum_{i=1}^g \sum_{j=1}^{n_i} (X_{ij} - \bar X_i)(X_{ij} - \bar X_i)^T. One-way multivariate analysis of variance is the test of H0 ⁣:μ1=⋯=μgH_0 \colon \mu_1 = \cdots = \mu_g by a statistic that depends on the eigenvalues of W−1BW^{-1} B. The standard statistics are:

  1. Wilks' lambda Λ=det⁡W/det⁡(W+B)\Lambda = \det W / \det(W + B), which rejects for small values.
  2. Pillai's trace tr⁡(B(B+W)−1)\tr(B (B + W)^{-1}).
  3. The Hotelling–Lawley trace tr⁡(W−1B)\tr(W^{-1} B).
  4. Roy's largest root, the largest eigenvalue of W−1BW^{-1} B.

Remarks

The matrix WW is invertible with probability 11 when N−g≥pN - g \ge p and Σ\Sigma is positive definite. Example: for p=1p = 1, BB and WW are the between and within sums of squares of the one-way analysis of variance. Then Λ=W/(W+B)\Lambda = W/(W + B), a decreasing function of the usual FF statistic, so MANOVA reduces to ANOVA. Non-example: with p=5p = 5 responses and g=3g = 3 groups of 22 observations each, N−g=3<pN - g = 3 < p, so WW has rank at most 33, is not invertible, and Λ=0\Lambda = 0 whatever the data. For g=2g = 2 the four statistics are equivalent to Hotelling's T2T^2 statistic.

Reading path

To understand this page from the ground up, read these 55 pages in order. The foundations come first.

  1. Analysis of variance concept
  2. Construction of the reals from Cauchy sequences concept
  3. Determinant concept
  4. Element definition
  5. Integers object
  6. Invertible matrix concept
  7. Multivariate normal distribution concept
  8. Ordered field definition
  9. Proposition concept
  10. Random experiment concept
  11. Rational numbers object
  12. Real numbers object
  13. Trace of a matrix concept
  14. Set definition
  15. Ring of integers statement
  16. Disjunction definition
  17. Implication definition
  18. Predicate definition
  19. Ordered pair definition
  20. Union definition
  21. Existential quantifier definition
  22. Universal quantifier definition
  23. Sample space definition
  24. The rationals form a field statement
  25. Cartesian product definition
  26. Subset definition
  27. Uniqueness quantifier definition
  28. The rationals form an ordered field statement
  29. Binary relation definition
  30. Universal set definition
  31. Power set definition
  32. Order on the reals definition
  33. Function definition
  34. Complement definition
  35. Interval definition
  36. Preimage of a set definition
  37. Sigma-algebra definition
  38. Event definition
  39. Borel sigma-algebra definition
  40. Probability axioms concept
  41. Probability measure definition
  42. Probability distribution definition
  43. Probability space definition
  44. Conditional probability definition
  45. Random variable definition
  46. Independence of two events definition
  47. Law of a random variable definition
  48. Mutual independence of events definition
  49. Identically distributed random variables definition
  50. Independent sigma-algebras definition
  51. Independence of random variables definition
  52. Independent and identically distributed random variables definition
  53. Statistic definition
  54. Statistical hypothesis test concept
  55. Multivariate analysis of variance definition

Further reading

  1. Web https://en.wikipedia.org/wiki/Multivariate_analysis_of_variance
About this page
Tag849ASYBYJ6
URIm2://849ASYBYJ6
Kinddefinition
WritingW0 stub
MSC62H15, 62J10
DefinesMultivariate analysis of variance
UsesAnalysis of variance, Multivariate normal distribution, Statistical hypothesis test, Determinant, Trace of a matrix, Invertible matrix

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.