Math 2.0

Statistics Hypothesis testing Theorem

Karlin–Rubin theorem

Builds on Monotone likelihood ratioUniformly most powerful testPower of a testStatistic

Statement

Let Θ⊆ℝ\Theta \subseteq \R, let XX have a density fθf_\theta with θ∈Θ\theta \in \Theta, and assume the family has a monotone likelihood ratio in a statistic T(X)T(X). Let θ0∈Θ\theta_0 \in \Theta and α∈(0,1)\alpha \in (0, 1). For constants c∈ℝc \in \R and γ∈[0,1]\gamma \in [0, 1], let φ(x)=1\varphi(x) = 1 if T(x)>cT(x) > c, φ(x)=γ\varphi(x) = \gamma if T(x)=cT(x) = c, and φ(x)=0\varphi(x) = 0 if T(x)<cT(x) < c. Then cc and γ\gamma can be chosen so that Eθ0[φ(X)]=αE_{\theta_0}[\varphi(X)] = \alpha. With this choice, φ\varphi is a uniformly most powerful test at level α\alpha of H0 ⁣:θ≤θ0H_0 \colon \theta \le \theta_0 against H1 ⁣:θ>θ0H_1 \colon \theta > \theta_0.

Remarks

Proof idea: fix θ1>θ0\theta_1 > \theta_0. By the monotone likelihood ratio, φ\varphi rejects exactly when fθ1/fθ0f_{\theta_1}/f_{\theta_0} is large, so it is the most powerful test of θ0\theta_0 against θ1\theta_1 by the Neyman–Pearson lemma. This test does not depend on θ1\theta_1. One then shows that its power function is nondecreasing in θ\theta, so its type I error is at most α\alpha on all of {θ≤θ0}\set{\theta \le \theta_0}. Example: for XX binomial with parameters nn and pp, the UMP test of p≤p0p \le p_0 against p>p0p > p_0 rejects for a large number of successes, with randomization at the boundary value. The theorem is about one-sided hypotheses; for H1 ⁣:θ≠θ0H_1 \colon \theta \ne \theta_0 a UMP test usually does not exist.

Going deeper

For a student

The Karlin–Rubin theorem extends the Neyman–Pearson lemma from a simple alternative to a one-sided composite alternative. The key is that the most powerful test against one alternative is the same for all alternatives on one side. It applies to one-parameter exponential families, such as binomial, Poisson and normal models with one unknown parameter. For two-sided problems, one restricts to unbiased tests to get an optimal test. For discrete data, the randomization γ\gamma is needed to reach the exact level α\alpha.

Reading path

To understand this page from the ground up, read these 52 pages in order. The foundations come first.

  1. Construction of the reals from Cauchy sequences concept
  2. Element definition
  3. Integers object
  4. Monotone likelihood ratio concept
  5. Ordered field definition
  6. Power of a test concept
  7. Proposition concept
  8. Random experiment concept
  9. Rational numbers object
  10. Real numbers object
  11. Uniformly most powerful test concept
  12. Set definition
  13. Ring of integers statement
  14. Disjunction definition
  15. Implication definition
  16. Predicate definition
  17. Ordered pair definition
  18. Union definition
  19. Sample space definition
  20. Existential quantifier definition
  21. Universal quantifier definition
  22. The rationals form a field statement
  23. Cartesian product definition
  24. Subset definition
  25. Uniqueness quantifier definition
  26. The rationals form an ordered field statement
  27. Binary relation definition
  28. Universal set definition
  29. Power set definition
  30. Order on the reals definition
  31. Complement definition
  32. Function definition
  33. Interval definition
  34. Sigma-algebra definition
  35. Preimage of a set definition
  36. Event definition
  37. Borel sigma-algebra definition
  38. Probability axioms concept
  39. Probability measure definition
  40. Probability distribution definition
  41. Probability space definition
  42. Conditional probability definition
  43. Random variable definition
  44. Independence of two events definition
  45. Law of a random variable definition
  46. Mutual independence of events definition
  47. Identically distributed random variables definition
  48. Independent sigma-algebras definition
  49. Independence of random variables definition
  50. Independent and identically distributed random variables definition
  51. Statistic definition
  52. Karlin–Rubin theorem statement

Further reading

  1. Web https://en.wikipedia.org/wiki/Uniformly_most_powerful_test
About this page
TagRCASN31FFS
URIm2://RCASN31FFS
Kindstatement, theorem
WritingW0 stub
MSC62F03
StatusThis copy of the site has no build data. Run m2 status RCASN31FFS.
AboutUniformly most powerful test, Monotone likelihood ratio
UsesMonotone likelihood ratio, Uniformly most powerful test, Power of a test, Statistic

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.