Math 2.0

Numerical analysis Definition

Monte Carlo method

Builds on Random variableExpected valueIndependent and identically distributed random variables

Definition

Let qq be a real number to be computed. A (plain) Monte Carlo method for qq consists of the following data:

  1. a random variable YY with 𝔼∣Y∣<∞\mathbb E\abs{Y} < \infty and expected value 𝔼Y=q\mathbb E Y = q;
  2. a procedure that produces independent and identically distributed random variables Y1,Y2,…Y_1, Y_2, \ldots with the distribution of YY;
  3. for each sample size n≥1n \ge 1, the estimate q^n=1n∑i=1nYi.\hat q_n = \frac{1}{n} \sum_{i=1}^{n} Y_i.

More generally, a Monte Carlo method is any algorithm whose output is a random variable used to approximate a deterministic quantity.

Remarks

Example: q=π/4q = \pi/4 is the probability that a point (U,V)(U, V) uniform on [0,1]2[0, 1]^2 satisfies U2+V2≤1U^2 + V^2 \le 1. So Y=1Y = 1 if U2+V2≤1U^2 + V^2 \le 1 and Y=0Y = 0 otherwise satisfies clause 1, since YY is bounded and 𝔼Y=π/4\mathbb E Y = \pi/4, and independent uniform points give clause 2. Non-example: Y=1/UY = 1/U with UU uniform on (0,1)(0, 1) has 𝔼∣Y∣=∫01u−1 du=∞\mathbb E\abs{Y} = \int_0^1 u^{-1}\, du = \infty, so clause 1 fails and the averages q^n\hat q_n tend to +∞+\infty almost surely. The estimate q^n\hat q_n is unbiased, 𝔼q^n=q\mathbb E \hat q_n = q, and if Var⁡Y=σ2<∞\operatorname{Var} Y = \sigma^2 < \infty its standard deviation is σ/n\sigma/\sqrt{n}. In practice clause 2 is realised with a pseudorandom number generator, so the samples are only imitations of independent random variables. Methods based on Markov chains, such as Markov chain Monte Carlo, fit the general sense but not the plain one, since their samples are dependent.

Reading path

To understand this page from the ground up, read these 4 pages in order. The foundations come first.

Show the path as a graph
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Expected value concept
  2. Independent and identically distributed random variables concept
  3. Random variable concept
  4. Monte Carlo method definition

Further reading

  1. Web https://en.wikipedia.org/wiki/Monte_Carlo_method
About this page
TagW4MT7K2QTF
URIm2://W4MT7K2QTF
Kinddefinition
WritingW0 stub
MSC65C05, 11K45
DefinesMonte Carlo method
UsesRandom variable, Expected value, Independent and identically distributed random variables

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.