Statistics Point estimation Counterexample
Hodges' superefficient estimator
Builds on Hájek–Le Cam convolution theoremEfficiency of an estimatorSample meanNormal distributionIndependent and identically distributed random variablesConvergence in distributionFisher informationMean squared error
Counterexample
Let be i.i.d. , the normal distribution with unknown mean , and let be the sample mean. Hodges' estimator is The Fisher information of one observation is , and exactly.
Check of the limit laws, with convergence in distribution:
- If , then , because while . So with probability tending to one, and .
- If , then for standard normal. So with probability tending to one, and .
So the asymptotic variance of is for and for : at it beats the bound that maximum likelihood attains. This is superefficiency: the usual bound of efficiency is beaten at one point.
Remarks
The price appears near . Take . Then is of order , so , and the scaled mean squared error satisfies , while for it equals .
is not a regular estimator at : under , the law of tends to the point mass at , which depends on . This is why the Hájek–Le Cam convolution theorem assumes regularity.
Reading path
To understand this page from the ground up, read these 83 pages in order. The foundations come first.
- Construction of the reals from Cauchy sequences concept
- Efficiency of an estimator concept
- Element definition
- Fisher information concept
- Integers object
- Local asymptotic normality concept
- Ordered field definition
- Proposition concept
- Random experiment concept
- Rational numbers object
- Real numbers object
- Set definition
- Ring of integers statement
- Disjunction definition
- Implication definition
- Predicate definition
- Ordered pair definition
- Union definition
- Existential quantifier definition
- Sample space definition
- Universal quantifier definition
- The rationals form a field statement
- Cartesian product definition
- Subset definition
- Uniqueness quantifier definition
- The rationals form an ordered field statement
- Binary relation definition
- Universal set definition
- Power set definition
- Order on the reals definition
- Function definition
- Complement definition
- Interval definition
- Injective function definition
- Indicator function definition
- Preimage of a set definition
- Sigma-algebra definition
- Countable set definition
- Event definition
- Borel sigma-algebra definition
- Probability axioms concept
- Probability measure definition
- Probability distribution definition
- Dirac measure definition
- Probability space definition
- Conditional probability definition
- Random variable definition
- Cumulative distribution function definition
- Discrete random variable definition
- Law of a random variable definition
- Independence of two events definition
- Random variable with a density definition
- Convergence in distribution definition
- Joint probability distribution definition
- Probability mass function definition
- Expected value definition
- Identically distributed random variables definition
- Independence of two random variables definition
- Mutual independence of events definition
- Probability density function definition
- Marginal distribution definition
- Variance definition
- Linearity of expectation statement
- Convolution of probability distributions definition
- Independent sigma-algebras definition
- Density of the normal distribution definition
- Covariance definition
- Independence means the joint law is the product of the marginals statement
- Independence of random variables definition
- Normal distribution definition
- Variance of a sum statement
- Multivariate normal distribution definition
- Expectation of a product of independent random variables statement
- Independent and identically distributed random variables definition
- Statistic definition
- Independent random variables are uncorrelated statement
- Variance of a sum of independent random variables statement
- Estimator definition
- Sample mean definition
- Bias of an estimator definition
- Hájek–Le Cam convolution theorem statement
- Mean squared error definition
- Hodges' superefficient estimator counterexample
Further reading
About this page
| Tag | 2E46CY6S3Z |
|---|---|
| URI | m2://2E46CY6S3Z |
| Kind | counterexample |
| Writing | W0 stub |
| MSC | 62F12 |
| Uses | Hájek–Le Cam convolution theorem, Efficiency of an estimator, Sample mean, Normal distribution, Independent and identically distributed random variables, Convergence in distribution, Fisher information, Mean squared error |
| Same as |
Markdown · JSON · Edit on GitHub
What this page needs for W1
- an inventory row: the row of the inventory that the node accounts for (0 of 1)
- a source with a locator (0 of 1)
- edge refutes or not_instance_of out (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.
What links here
No page links to this page yet.