Statistics Statistical decision theory Proposition
Bayes risk is at most minimax risk
Builds on Risk functionBayes riskMinimax estimator
Statement
Let be a statistical model with a loss function, with risk function . Let be a prior on such that is measurable for every rule . Then the Bayes risk of is at most the minimax risk:
Remarks
For each fixed rule , an average of is at most its supremum, so . Taking the infimum over on both sides gives the claim. Hence also , where is the minimax risk.
This inequality is the standard way to prove lower bounds for the minimax risk. If a rule has for some prior , then is minimax. For instance, a Bayes rule with constant risk is minimax, as for the binomial proportion with the beta prior of parameters and .
Going deeper
For a student
To show that no estimator can do better than some value in the worst case, it is enough to find a prior whose Bayes risk equals that value. This is the Bayesian route to minimax lower bounds, often used with a sequence of priors whose Bayes risks increase to the candidate value. For a finite parameter set with randomized rules allowed, minimax theorems show that the two sides are equal when the supremum over priors is taken.
Reading path
To understand this page from the ground up, read these 4 pages in order. The foundations come first.
Show the path as a graph
- no evidence level
- Bayes risk concept
- Minimax estimator concept
- Risk function concept
- Bayes risk is at most minimax risk statement
Further reading
About this page
| Tag | FB692YN0BZ |
|---|---|
| URI | m2://FB692YN0BZ |
| Kind | statement, proposition |
| Writing | W0 stub |
| MSC | 62C20, 62C10 |
| Status | This copy of the site has no build data. Run m2 status FB692YN0BZ. |
| About | Bayes risk, Minimax estimator |
| Uses | Risk function, Bayes risk, Minimax estimator |
Markdown · JSON · Edit on GitHub
What this page needs for W1
- an inventory row: the row of the inventory that the node accounts for (0 of 1)
- a source with a locator (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.
What links here
No page links to this page yet.