Math 2.0

Probability theory and stochastic processes Theorem

Harris inequality

Builds on Probability measureExpected valueMonotone function

Statement

Let n≥1n \ge 1 and let p1,…,pn∈[0,1]p_1, \ldots, p_n \in [0, 1]. Let Ω={0,1}n\Omega = \set{0, 1}^n with the product probability measure μ\mu under which the coordinates are independent and the ii-th coordinate equals 11 with probability pip_i. Order Ω\Omega coordinatewise: x≤yx \le y when xi≤yix_i \le y_i for all ii. Let f,g ⁣:Ω→ℝf, g \colon \Omega \to \R be increasing functions, that is, x≤yx \le y implies f(x)≤f(y)f(x) \le f(y) and g(x)≤g(y)g(x) \le g(y). Then 𝔼[fg]≥𝔼[f] 𝔼[g],\mathbb{E}[f g] \ge \mathbb{E}[f] \, \mathbb{E}[g], where 𝔼\mathbb{E} is the expected value with respect to μ\mu.

Remarks

The proof is by induction on nn. For n=1n = 1, the inequality is equivalent to p1(1−p1)(f(1)−f(0))(g(1)−g(0))≥0p_1 (1 - p_1) (f(1) - f(0)) (g(1) - g(0)) \ge 0, which holds because both differences are nonnegative. The induction step conditions on the last coordinate and applies the case n=1n = 1 to the conditional expectations, which are again increasing.

For indicator functions of increasing events AA and BB, the inequality reads μ(A∩B)≥μ(A) μ(B)\mu(A \cap B) \ge \mu(A) \, \mu(B): increasing events are positively correlated. For example, in the Erdős–Rényi model G(n,p)G(n, p) the events "the graph is connected" and "the graph has a triangle" are increasing, so they are positively correlated. If ff is increasing and gg is decreasing, the inequality is reversed. The product structure of μ\mu matters. For the measure giving probability 1/21/2 to each of (1,0)(1, 0) and (0,1)(0, 1), the increasing events {x1=1}\set{x_1 = 1} and {x2=1}\set{x_2 = 1} have probability 1/21/2 each but are disjoint.

Going deeper

For a student

The Harris inequality is the case of a product measure in the FKG inequality, which allows any measure on a distributive lattice satisfying the log-supermodularity condition. Both follow from the Ahlswede–Daykin inequality. For the uniform measure on subsets of a finite set, it is Kleitman's lemma: two up-sets 𝒜,ℬ\mathcal{A}, \mathcal{B} of subsets of {1,…,n}\set{1, \ldots, n} satisfy 2n∣𝒜∩ℬ∣≥∣𝒜∣ ∣ℬ∣2^n |\mathcal{A} \cap \mathcal{B}| \ge |\mathcal{A}| \, |\mathcal{B}|. It is a standard tool in percolation theory and random graphs, often together with the Janson inequality, which gives a bound in the other direction.

Reading path

To understand this page from the ground up, read these 4 pages in order. The foundations come first.

Show the path as a graph
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Expected value concept
  2. Monotone function concept
  3. Probability measure concept
  4. Harris inequality statement

Where this leads

2 pages build on this one.

Further reading

  1. Web https://en.wikipedia.org/wiki/FKG_inequality
About this page
TagW1YH3YD3S4
URIm2://W1YH3YD3S4
Kindstatement, theorem
WritingW0 stub
MSC60E15, 05D05, 60C05
StatusThis copy of the site has no build data. Run m2 status W1YH3YD3S4.
AboutExpected value
UsesProbability measure, Expected value, Monotone function

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

Used by