Math 2.0

Number theory Theorem

Koksma–Hlawka inequality

Builds on Bounded variationTotal variationLebesgue integralLow-discrepancy sequenceHalton sequenceMonte Carlo integration

Statement

Let s≥1s \ge 1 and let x1,…,xNx_1, \ldots, x_N be points of [0,1)s[0,1)^s. For t=(t1,…,ts)∈[0,1]st = (t_1, \ldots, t_s) \in [0,1]^s, let A(t)A(t) be the number of indices ii with xi∈[0,t1)×⋯×[0,ts)x_i \in [0,t_1) \times \cdots \times [0,t_s). The star discrepancy of the points is DN∗=sup⁡t∈[0,1]s∣A(t)N−t1t2⋯ts∣.D_N^* = \sup_{t \in [0,1]^s} \abs{\frac{A(t)}{N} - t_1 t_2 \cdots t_s}. Let f ⁣:[0,1]s→ℝf \colon [0,1]^s \to \R have finite variation V(f)V(f) in the sense of Hardy and Krause. Then ∣1N∑i=1Nf(xi)−∫[0,1]sf(u) du∣≤V(f) DN∗.\abs{\frac{1}{N} \sum_{i=1}^{N} f(x_i) - \int_{[0,1]^s} f(u) \, du} \le V(f) \, D_N^*.

Remarks

For s=1s = 1 this is Koksma's inequality, and V(f)V(f) is the ordinary total variation of ff on [0,1][0,1]. In that case the proof writes the error as a Riemann–Stieltjes integral ∫01(A(t)/N−t) df(t)\int_0^1 \big(A(t)/N - t\big) \, df(t) by integration by parts, and bounds the integrand by DN∗D_N^*. In higher dimension the same idea works with a multivariate integration by parts, which produces one term for each face of the cube. The Hardy–Krause variation collects the variations of ff on all these faces. The bound separates the two sources of error: V(f)V(f) depends only on the integrand, and DN∗D_N^* depends only on the points. For a low-discrepancy sequence such as the Halton sequence, DN∗=O((log⁡N)s/N)D_N^* = O\big((\log N)^s / N\big), so the quasi-Monte Carlo error is O((log⁡N)s/N)O\big((\log N)^s / N\big) for every ff of finite variation. This beats the rate N−1/2N^{-1/2} of plain Monte Carlo integration for large NN. The hypothesis of finite variation is needed: the indicator of a ball in [0,1]2[0,1]^2 has infinite Hardy–Krause variation, and the bound gives nothing for it.

Going deeper

For a student

The inequality is the basic error bound of quasi-Monte Carlo integration. It turns the design of good integration rules into the purely geometric task of finding point sets with small star discrepancy. Halton, Sobol and other digital sequences reach DN∗=O((log⁡N)s/N)D_N^* = O\big((\log N)^s / N\big). The bound is sharp in a worst-case sense. But V(f)V(f) is often hard to compute, and it is infinite for simple functions with jumps along surfaces not aligned with the axes. Variants replace DN∗D_N^* and V(f)V(f) by other pairs of dual quantities, for example L2L^2 discrepancy and a Sobolev-type norm.

Reading path

To understand this page from the ground up, read these 110 pages in order. The foundations come first.

  1. Borel sigma-algebra concept
  2. Bounded variation concept
  3. Complex numbers object
  4. Construction of the reals from Cauchy sequences concept
  5. Continuous uniform distribution concept
  6. Element definition
  7. Euclidean space object
  8. Independent and identically distributed random variables concept
  9. Integers object
  10. Lebesgue integral concept
  11. Low-discrepancy sequence concept
  12. Monte Carlo method concept
  13. Ordered field definition
  14. Outer measure concept
  15. Prime number concept
  16. Proposition concept
  17. Quasi-Monte Carlo method concept
  18. Random experiment concept
  19. Rational numbers object
  20. Real numbers object
  21. Set bounded above definition
  22. Total variation concept
  23. Variance concept
  24. Euler's formula statement
  25. Set definition
  26. Lebesgue measure object
  27. Ring of integers statement
  28. Halton sequence object
  29. Disjunction definition
  30. Implication definition
  31. Predicate definition
  32. Supremum definition
  33. Ordered pair definition
  34. Union definition
  35. Existential quantifier definition
  36. Universal quantifier definition
  37. Sample space definition
  38. The rationals form a field statement
  39. Completeness axiom statement
  40. Cartesian product definition
  41. Uniqueness quantifier definition
  42. Subset definition
  43. Existence of square roots of nonnegative reals statement
  44. The rationals form an ordered field statement
  45. Binary relation definition
  46. Universal set definition
  47. Power set definition
  48. Square root definition
  49. Order on the reals definition
  50. Function definition
  51. Complement definition
  52. Interval definition
  53. Injective function definition
  54. Indicator function definition
  55. Preimage of a set definition
  56. Sigma-algebra definition
  57. Countable set definition
  58. Event definition
  59. Borel sigma-algebra definition
  60. Probability axioms concept
  61. Probability measure definition
  62. Probability distribution definition
  63. Dirac measure definition
  64. Probability space definition
  65. Almost surely definition
  66. Conditional probability definition
  67. Monotonicity of probability statement
  68. Random variable definition
  69. Independence of two events definition
  70. Almost sure convergence definition
  71. Cumulative distribution function definition
  72. Discrete random variable definition
  73. Law of a random variable definition
  74. Random variable with a density definition
  75. Convergence in probability definition
  76. Mutual independence of events definition
  77. Independence of two random variables definition
  78. Joint probability distribution definition
  79. Convergence in distribution definition
  80. Probability mass function definition
  81. Expected value definition
  82. Probability density function definition
  83. Identically distributed random variables definition
  84. Independent sigma-algebras definition
  85. Marginal distribution definition
  86. Markov's inequality statement
  87. Variance definition
  88. Law of the unconscious statistician statement
  89. Linearity of expectation statement
  90. Density of the normal distribution definition
  91. Independence of random variables definition
  92. Independence means the joint law is the product of the marginals statement
  93. Characteristic function definition
  94. Standard deviation definition
  95. Covariance definition
  96. Normal distribution definition
  97. Expectation of a product of independent random variables statement
  98. Chebyshev's inequality statement
  99. The characteristic function determines the distribution statement
  100. Independent and identically distributed random variables definition
  101. Variance of a sum statement
  102. Independent random variables are uncorrelated statement
  103. Lévy's continuity theorem statement
  104. Law of large numbers concept
  105. Variance of a sum of independent random variables statement
  106. Central limit theorem statement
  107. Weak law of large numbers statement
  108. Strong law of large numbers statement
  109. Monte Carlo integration statement
  110. Koksma–Hlawka inequality statement

Further reading

  1. Web https://en.wikipedia.org/wiki/Low-discrepancy_sequence
About this page
Tag2DSN343YYW
URIm2://2DSN343YYW
Kindstatement, theorem
WritingW0 stub
MSC11K38, 65D30, 65C05
StatusThis copy of the site has no build data. Run m2 status 2DSN343YYW.
AboutQuasi-Monte Carlo method, Low-discrepancy sequence
UsesBounded variation, Total variation, Lebesgue integral, Low-discrepancy sequence, Halton sequence, Monte Carlo integration

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.