Statistics Hypothesis testing Theorem
Wilks' theorem
Builds on Likelihood-ratio testChi-squared distributionConvergence in distributionIndependent and identically distributed random variables
Statement
Let be i.i.d. with density , where lies in an open set . Assume the standard regularity conditions for the asymptotic normality of the maximum likelihood estimator, with a positive definite Fisher information. Let be the set of whose first coordinates equal fixed values, with . Let be the likelihood-ratio statistic of based on . If the true lies in , then converges in distribution to the chi-squared distribution with degrees of freedom as .
Remarks
The number is the difference between the dimension of and the dimension of . Proof idea: expand the log-likelihood to second order around the unrestricted and the restricted maximum likelihood estimates. The difference becomes a quadratic form in an asymptotically normal vector, which has a limiting chi-squared law with degrees of freedom. Example: for an i.i.d. sample and , here and , so one rejects when exceeds the quantile of . The hypothesis that the true parameter is an interior point matters. For a variance component tested at the boundary value , the limit law is a mixture of and rather than .
Going deeper
For a student
This is why likelihood-ratio tests are used everywhere: one computes and compares it with a chi-squared quantile. The score test and the Wald test have the same limiting chi-squared law under the null hypothesis, and the three tests are asymptotically equivalent. The theorem needs regularity: smooth densities, identifiability, and a true parameter in the interior of the parameter set. It is an asymptotic statement, so for small samples the chi-squared approximation can be poor.
Reading path
To understand this page from the ground up, read these 80 pages in order. The foundations come first.
- Construction of the reals from Cauchy sequences concept
- Element definition
- Integers object
- Likelihood-ratio test concept
- Ordered field definition
- Proposition concept
- Random experiment concept
- Rational numbers object
- Real numbers object
- Set definition
- Ring of integers statement
- Disjunction definition
- Implication definition
- Predicate definition
- Ordered pair definition
- Union definition
- Sample space definition
- Existential quantifier definition
- The rationals form a field statement
- Universal quantifier definition
- Cartesian product definition
- Subset definition
- The rationals form an ordered field statement
- Uniqueness quantifier definition
- Binary relation definition
- Universal set definition
- Order on the reals definition
- Power set definition
- Complement definition
- Function definition
- Interval definition
- Indicator function definition
- Injective function definition
- Preimage of a set definition
- Sigma-algebra definition
- Countable set definition
- Event definition
- Borel sigma-algebra definition
- Probability axioms concept
- Probability measure definition
- Dirac measure definition
- Probability distribution definition
- Probability space definition
- Conditional probability definition
- Random variable definition
- Discrete random variable definition
- Cumulative distribution function definition
- Independence of two events definition
- Law of a random variable definition
- Random variable with a density definition
- Convergence in distribution definition
- Joint probability distribution definition
- Independence of two random variables definition
- Mutual independence of events definition
- Expected value definition
- Probability density function definition
- Identically distributed random variables definition
- Marginal distribution definition
- Variance definition
- Independent sigma-algebras definition
- Linearity of expectation statement
- Density of the normal distribution definition
- Exponential distribution definition
- Independence means the joint law is the product of the marginals statement
- Independence of random variables definition
- Covariance definition
- Normal distribution definition
- Gamma distribution definition
- Expectation of a product of independent random variables statement
- Variance of a sum statement
- Independent and identically distributed random variables definition
- Independent random variables are uncorrelated statement
- Statistic definition
- Variance of a sum of independent random variables statement
- Estimator definition
- Sample mean definition
- Bias of an estimator definition
- Sample variance definition
- Chi-squared distribution definition
- Wilks' theorem statement
Further reading
About this page
| Tag | WQPB6GXD0M |
|---|---|
| URI | m2://WQPB6GXD0M |
| Kind | statement, theorem |
| Writing | W0 stub |
| MSC | 62F05, 62E20 |
| Status | This copy of the site has no build data. Run m2 status WQPB6GXD0M. |
| About | Likelihood-ratio test |
| Uses | Likelihood-ratio test, Chi-squared distribution, Convergence in distribution, Independent and identically distributed random variables |
| Same as |
Markdown · JSON · Edit on GitHub
What this page needs for W1
- an inventory row: the row of the inventory that the node accounts for (0 of 1)
- a source with a locator (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.
What links here
No page links to this page yet.