Math 2.0

Statistics Definition

Horvitz–Thompson estimator

Builds on EstimatorExpected valueSimple random sample

Definition

Let U={1,…,N}U = \set{1, \dots, N} be a finite population, and let y1,…,yNy_1, \dots, y_N be fixed real values attached to the units. Let S⊆US \subseteq U be a random sample drawn by a sampling design, and let πi=P(i∈S)\pi_i = P(i \in S) be the inclusion probability of unit ii. Assume πi>0\pi_i > 0 for every i∈Ui \in U. The Horvitz–Thompson estimator of the population total Y=∑i=1NyiY = \sum_{i=1}^N y_i is the estimator Y^HT=∑i∈Syiπi.\hat{Y}_{HT} = \sum_{i \in S} \frac{y_i}{\pi_i}. The Horvitz–Thompson estimator of the population mean Y/NY/N is Y^HT/N\hat{Y}_{HT}/N.

Remarks

The estimator is unbiased: write Y^HT=∑i=1Nyiπi𝟏[i∈S]\hat{Y}_{HT} = \sum_{i=1}^N \frac{y_i}{\pi_i} \mathbf{1}[i \in S], and take the expected value, using E(𝟏[i∈S])=πiE(\mathbf{1}[i \in S]) = \pi_i, to get E(Y^HT)=YE(\hat{Y}_{HT}) = Y.

Example: in a simple random sample of size nn drawn without replacement, every unit has πi=n/N\pi_i = n/N. Then Y^HT=Nn∑i∈Syi=Nyˉ\hat{Y}_{HT} = \frac{N}{n}\sum_{i \in S} y_i = N \bar{y}, where yˉ\bar{y} is the sample mean.

Non-example: let some unit jj have πj=0\pi_j = 0. Then it never appears in the sample, so no estimator built from the sample can be unbiased for every choice of yjy_j. The condition πi>0\pi_i > 0 fails, and the definition does not apply.

With the joint inclusion probabilities πij=P(i∈S,j∈S)\pi_{ij} = P(i \in S, j \in S) and πii=πi\pi_{ii} = \pi_i, the variance is Var⁡(Y^HT)=∑i=1N∑j=1N(πij−πiπj)yiπiyjπj.\operatorname{Var}(\hat{Y}_{HT}) = \sum_{i=1}^N \sum_{j=1}^N (\pi_{ij} - \pi_i \pi_j) \frac{y_i}{\pi_i} \frac{y_j}{\pi_j}.

Reading path

To understand this page from the ground up, read these 56 pages in order. The foundations come first.

  1. Construction of the reals from Cauchy sequences concept
  2. Element definition
  3. Integers object
  4. Ordered field definition
  5. Proposition concept
  6. Random experiment concept
  7. Rational numbers object
  8. Real numbers object
  9. Simple random sample concept
  10. Set definition
  11. Ring of integers statement
  12. Disjunction definition
  13. Implication definition
  14. Predicate definition
  15. Ordered pair definition
  16. Union definition
  17. Sample space definition
  18. The rationals form a field statement
  19. Existential quantifier definition
  20. Universal quantifier definition
  21. Cartesian product definition
  22. Subset definition
  23. The rationals form an ordered field statement
  24. Uniqueness quantifier definition
  25. Binary relation definition
  26. Universal set definition
  27. Order on the reals definition
  28. Power set definition
  29. Complement definition
  30. Function definition
  31. Interval definition
  32. Injective function definition
  33. Preimage of a set definition
  34. Sigma-algebra definition
  35. Countable set definition
  36. Event definition
  37. Borel sigma-algebra definition
  38. Probability axioms concept
  39. Probability measure definition
  40. Probability distribution definition
  41. Probability space definition
  42. Conditional probability definition
  43. Random variable definition
  44. Discrete random variable definition
  45. Law of a random variable definition
  46. Independence of two events definition
  47. Random variable with a density definition
  48. Identically distributed random variables definition
  49. Expected value definition
  50. Mutual independence of events definition
  51. Independent sigma-algebras definition
  52. Independence of random variables definition
  53. Independent and identically distributed random variables definition
  54. Statistic definition
  55. Estimator definition
  56. Horvitz–Thompson estimator definition

Further reading

  1. Web https://en.wikipedia.org/wiki/Horvitz–Thompson_estimator
About this page
TagPFJFB459MT
URIm2://PFJFB459MT
Kinddefinition
WritingW0 stub
MSC62D05
DefinesHorvitz–Thompson estimator
UsesEstimator, Expected value, Simple random sample

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.