Math 2.0

Statistics Definition

Missing data mechanisms

Builds on Random variableProbability distributionLikelihood function

Definition

Let YY be the complete data, a random variable with values in a product space, split as Y=(Yobs,Ymis)Y = (Y_{\mathrm{obs}}, Y_{\mathrm{mis}}) into its observed and its missing parts. Let RR be the missingness indicator: Rj=1R_j = 1 if entry jj of YY is observed and Rj=0R_j = 0 otherwise. The missing data mechanism is the conditional distribution of RR given YY, written p(r∣y;ϕ)p(r \mid y; \phi) with a parameter ϕ\phi.

  1. The data are missing completely at random (MCAR) if p(r∣y;ϕ)=p(r;ϕ)p(r \mid y; \phi) = p(r; \phi) for all yy, that is, RR does not depend on YY.
  2. The data are missing at random (MAR) if p(r∣yobs,ymis;ϕ)=p(r∣yobs;ϕ)p(r \mid y_{\mathrm{obs}}, y_{\mathrm{mis}}; \phi) = p(r \mid y_{\mathrm{obs}}; \phi) for all ymisy_{\mathrm{mis}}, that is, RR depends on YY only through the observed part.
  3. The data are missing not at random (MNAR) if they are not MAR.

Remarks

MCAR implies MAR.

Example: let Y=(Y1,Y2)Y = (Y_1, Y_2), where Y1Y_1 (age) is always observed and Y2Y_2 (income) is missing with probability h(Y1)h(Y_1) for a function hh that is not constant. Then p(r∣y)p(r \mid y) depends only on y1=yobsy_1 = y_{\mathrm{obs}}, so the data are MAR, but not MCAR.

Non-example: let Y2Y_2 be missing with probability h(Y2)h(Y_2) for a function hh that is not constant. Then p(r∣y)p(r \mid y) depends on the missing value itself, so clause 2 fails and the data are MNAR.

Assume the data are MAR and the parameters θ\theta of the data model and ϕ\phi of the mechanism are distinct, that is, they vary in a product set. Then the mechanism is called ignorable. In that case, the likelihood of θ\theta based on (yobs,r)(y_{\mathrm{obs}}, r) is proportional to the likelihood based on yobsy_{\mathrm{obs}} alone.

Reading path

To understand this page from the ground up, read these 56 pages in order. The foundations come first.

  1. Construction of the reals from Cauchy sequences concept
  2. Element definition
  3. Integers object
  4. Ordered field definition
  5. Proposition concept
  6. Random experiment concept
  7. Rational numbers object
  8. Real numbers object
  9. Set definition
  10. Ring of integers statement
  11. Disjunction definition
  12. Implication definition
  13. Predicate definition
  14. Ordered pair definition
  15. Union definition
  16. Sample space definition
  17. The rationals form a field statement
  18. Existential quantifier definition
  19. Universal quantifier definition
  20. Cartesian product definition
  21. Subset definition
  22. The rationals form an ordered field statement
  23. Uniqueness quantifier definition
  24. Binary relation definition
  25. Universal set definition
  26. Order on the reals definition
  27. Power set definition
  28. Complement definition
  29. Function definition
  30. Interval definition
  31. Injective function definition
  32. Preimage of a set definition
  33. Sigma-algebra definition
  34. Countable set definition
  35. Event definition
  36. Borel sigma-algebra definition
  37. Probability axioms concept
  38. Probability measure definition
  39. Probability distribution definition
  40. Probability space definition
  41. Conditional probability definition
  42. Random variable definition
  43. Cumulative distribution function definition
  44. Discrete random variable definition
  45. Law of a random variable definition
  46. Independence of two events definition
  47. Random variable with a density definition
  48. Probability mass function definition
  49. Mutual independence of events definition
  50. Identically distributed random variables definition
  51. Probability density function definition
  52. Independent sigma-algebras definition
  53. Independence of random variables definition
  54. Independent and identically distributed random variables definition
  55. Likelihood function definition
  56. Missing data mechanisms definition

Further reading

  1. Web https://en.wikipedia.org/wiki/Missing_data
About this page
TagQXDY7STQWG
URIm2://QXDY7STQWG
Kinddefinition
WritingW0 stub
MSC62D10
DefinesMissing data mechanisms
UsesRandom variable, Probability distribution, Likelihood function

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.