Probability theory and stochastic processes
572 ideas in this subject. The map below lists the main ideas of the subject by area, in teaching order. 236 of its 242 ideas have a page so far.
Start here
- ConceptProbability space
A probability space is the mathematical model of a random experiment: a sample space, a σ-algebra of events and a probability measure on the events. The node probability space gives the precise definition.
- ConceptProbability axioms
The probability axioms of Kolmogorov are the three rules that a probability function on the events of a sample space must obey. First, for each event . Second, . Third, for each sequence of pairwise disjoint events, . This is countable additivity. A function that obeys these rules is a probability measure.
- ConceptEvent
An event is a set of outcomes of a random experiment to which we give a probability. The event happens when the outcome of the experiment is in the set. The node event gives the precise definition.
- ConceptSigma-algebra
A σ-algebra on a set is a family of subsets that contains the whole set and is closed under complements and countable unions. In probability theory, the σ-algebra is the family of events, the sets to which we give a probability. The node sigma-algebra gives the precise definition.
- ConceptPi-system
A π-system on a set is a nonempty family of subsets that is closed under intersections of two members. It is the kind of generating family used in the uniqueness theorems of measure theory. Two probability measures that agree on a π-system agree on the σ-algebra it generates.
- ConceptRandom variable
A random variable is a quantity whose value depends on the outcome of a random experiment. Formally it is a measurable function on the sample space of a probability space. The node random variable gives the precise definition.
Map of the subject
Foundations: probability spaces and events 16 of 17
- Probability space definition
- Probability axioms definition
- Event definition
- Sigma-algebra definition
- Pi-system definition
- Dynkin's pi-lambda theorem statement
- Random variable definition
- Law of a random variable definition
- Cumulative distribution function definition
- Probability density function definition
- Probability mass function definition
- Quantile function definition
- Conditional probability definition
- Bayes' theorem statement
- Law of total probability statement
- Borel–Kolmogorov paradox counterexample
- Bertrand paradox counterexample
Independence 13 of 13
- Independence of two events definition
- Independence of two random variables definition
- Pairwise independence definition
- Independent and identically distributed random variables definition
- Conditional independence definition
- Product measure definition
- Kolmogorov extension theorem statement
- Ionescu-Tulcea theorem statement
- Exchangeable random variables definition
- De Finetti's theorem statement
- Kolmogorov's zero–one law statement
- Hewitt–Savage zero–one law statement
- Coupling definition
Expectation, moments and transforms 15 of 16
- Expected value definition
- Variance definition
- Variance of a sum of independent random variables statement
- Covariance definition
- Correlation coefficient definition
- Moment definition
- Central moment definition
- Moment problem problem
- Moment-generating function definition
- Cumulant definition
- Probability-generating function definition
- characteristic function definition
- The characteristic function determines the distribution statement
- Bochner's theorem statement
- Cramér–Wold theorem statement
- Convolution of probability distributions definition
Inequalities 13 of 13
- Markov's inequality statement
- Chebyshev's inequality statement
- Jensen's inequality statement
- Paley–Zygmund inequality statement
- Chernoff bound statement
- Sub-Gaussian distribution definition
- Hoeffding's inequality statement
- Bernstein inequalities statement
- Azuma's inequality statement
- McDiarmid's inequality statement
- Concentration of measure concept
- Talagrand's concentration inequality statement
- FKG inequality statement
Conditioning 6 of 6
- Conditional expectation definition
- Law of total expectation statement
- Law of total variance statement
- Markov kernel definition
- Regular conditional probability definition
- Disintegration theorem statement
Probability distributions 23 of 23
- Bernoulli distribution example
- Binomial distribution example
- Geometric distribution example
- Negative binomial distribution example
- Hypergeometric distribution example
- Poisson distribution example
- Discrete uniform distribution example
- Continuous uniform distribution example
- Normal distribution example
- Multivariate normal distribution example
- Gaussian measure definition
- Exponential distribution example
- Gamma distribution example
- Beta distribution example
- Chi-squared distribution example
- Log-normal distribution example
- Cauchy distribution example
- Pareto distribution example
- Dirichlet distribution example
- Stable distribution definition
- Infinitely divisible distribution definition
- Lévy–Khintchine representation statement
- Stochastic ordering definition
Modes of convergence 15 of 15
- Convergence of random variables concept
- Almost sure convergence definition
- Convergence in probability definition
- Convergence in distribution definition
- Weak convergence of measures definition
- Portmanteau theorem statement
- Lévy–Prokhorov metric definition
- Tightness of measures definition
- Prokhorov's theorem statement
- Skorokhod's representation theorem statement
- Lévy's continuity theorem statement
- Slutsky's theorem statement
- Continuous mapping theorem statement
- Uniform integrability definition
- Vitali convergence theorem statement
Limit theorems 15 of 15
- First Borel–Cantelli lemma statement
- Second Borel–Cantelli lemma statement
- Weak law of large numbers statement
- Strong law of large numbers statement
- Kolmogorov's inequality statement
- Kolmogorov's three-series theorem statement
- Central limit theorem statement
- De Moivre–Laplace theorem statement
- Lindeberg's condition definition
- Berry–Esseen theorem statement
- Poisson limit theorem statement
- Law of the iterated logarithm statement
- Glivenko–Cantelli theorem statement
- Donsker's theorem statement
- Fisher–Tippett–Gnedenko theorem statement
Large deviations 6 of 6
- Large deviations theory concept
- Rate function definition
- Cramér's theorem statement
- Sanov's theorem statement
- Varadhan's lemma statement
- Kullback–Leibler divergence definition
Stochastic processes: general theory 14 of 15
- Stochastic process definition
- Finite-dimensional distributions definition
- Filtration definition
- Adapted process definition
- Stopping time definition
- Stopped process definition
- Kolmogorov continuity theorem statement
- Stationary process definition
- Gaussian process definition
- Karhunen–Loève theorem statement
- Wiener–Khinchin theorem statement
- Self-similar process definition
- Empirical process definition
- optimal stopping problem
- Secretary problem problem
Martingales 15 of 15
- Martingale definition
- Submartingale definition
- Supermartingale definition
- Doob martingale example
- Optional stopping theorem statement
- Doob's martingale inequality statement
- Doob's upcrossing inequality statement
- Doob's martingale convergence theorems statement
- Lévy's upward theorem statement
- Doob decomposition theorem statement
- Doob–Meyer decomposition theorem statement
- Local martingale definition
- Semimartingale definition
- Quadratic variation definition
- Burkholder–Davis–Gundy inequality statement
Brownian motion 10 of 10
- Wiener process definition
- Classical Wiener space object
- Lévy's characterization of Brownian motion statement
- Reflection principle statement
- Brownian bridge definition
- Geometric Brownian motion definition
- Ornstein–Uhlenbeck process definition
- Fractional Brownian motion definition
- Local time definition
- Skorokhod's embedding theorem statement
Stochastic analysis 16 of 16
- Itô calculus concept
- Itô isometry statement
- Itô's lemma statement
- Stratonovich integral definition
- Stochastic differential equation definition
- Doléans-Dade exponential definition
- Girsanov theorem statement
- Martingale representation theorem statement
- Tanaka's formula statement
- Feynman–Kac formula statement
- Fokker–Planck equation definition
- Kolmogorov backward equation definition
- Langevin equation definition
- Euler–Maruyama method concept
- Malliavin calculus concept
- Stochastic partial differential equation definition
Rough analysis 2 of 2
- Rough path definition
- Regularity structures concept
Markov processes 26 of 26
- Markov property definition
- Markov chain definition
- Transition matrix definition
- Chapman–Kolmogorov equation statement
- Recurrence and transience of states definition
- Stationary distribution definition
- Convergence to equilibrium of ergodic Markov chains statement
- Detailed balance definition
- Markov chain mixing time definition
- Random walk definition
- Pólya's recurrence theorem statement
- Gambler's ruin problem
- Markov chain Monte Carlo concept
- Metropolis–Hastings algorithm concept
- Coupling from the past concept
- Hidden Markov model definition
- Continuous-time Markov chain definition
- Poisson point process definition
- Birth–death process definition
- Galton–Watson process definition
- Galton–Watson process definition
- Feller process definition
- Infinitesimal generator of a Markov process definition
- Diffusion process definition
- Dirichlet form definition
- Lévy process definition
Special processes 23 of 25
- Point process definition
- Renewal theory concept
- Queueing theory concept
- M/M/1 queue example
- Little's law statement
- Percolation theory concept
- Percolation threshold definition
- Kesten's theorem on planar bond percolation statement
- Interacting particle system concept
- Asymmetric simple exclusion process example
- Contact process example
- Voter model example
- Ising model example
- Self-avoiding walk definition
- Loop-erased random walk definition
- Schramm–Loewner evolution definition
- Gaussian free field definition
- Kardar–Parisi–Zhang equation definition
- Random matrix definition
- Wigner semicircle distribution statement
- Marchenko–Pastur distribution statement
- Tracy–Widom distribution definition
- Pólya urn model example
- Chinese restaurant process example
- Dirichlet process definition
Combinatorial and geometric probability 8 of 9
- Probabilistic method concept
- Lovász local lemma statement
- Erdős–Rényi model definition
- Coupon collector's problem problem
- birthday problem problem
- Bertrand's ballot theorem statement
- Buffon's needle problem problem
- Stochastic geometry concept
- Boolean model definition
More ideas in this subject
Concepts 65
- Balayage space
- Probability theory
- Random experiment
- Bernoulli trial
- Error function
- Excessive function
- Infinite product measure
- Sample space
- Survival function
- Autocorrelation function
- Copula
- Doob's h-transform
- Exponential family
- Hazard function
- Markov random field
- Outcome
- Poisson boundary
- von Mises–Fisher distribution
- Conditioned Brownian motion
- Hellinger distance
- Potential operator of a Markov process
- Rademacher functions
- Random walk on a group
- Total variation distance between probability measures
- Cylinder set measure
- Green's function of a Markov process
- Standard probability space
- Stochastic Volterra equation
- Wasserstein metric
- Abstract Wiener space
- Laplace–Stieltjes transform
- Dynkin system
- Martin boundary
- Probability measure
- Almost surely
- Geometric probability
- Probability distribution
- Random graph
- Mutual independence of events
- Independent sigma-algebras
- Random variable with a density
- Classical definition of probability
- Discrete random variable
- Identically distributed random variables
- Median
- Density of the normal distribution
- Independence of random variables
- Particle filter
- Random integral equation
- Convergence in mean
- Hunt process
- Conditional variance
- Law of large numbers
- Standard deviation
- Conditional probability distribution
- Memorylessness
- Characteristic function
- Contiguity of measures
- Bernoulli process
- Absorbing Markov chain
- Cumulant generating function
- Student's t-distribution
- F-distribution
- Noncentral chi-squared distribution
- Wishart distribution
Theorems and results 80
- Ahlswede–Daykin inequality
- Janson inequality
- Khintchine inequality
- Polar sets and Brownian hitting
- Beurling–Deny formula
- Harris inequality
- Marchenko–Pastur law
- Rayleigh monotonicity law
- Analyticity of the bilateral Laplace transform of a law
- Asymptotic behavior of solutions of renewal equations
- Dynkin's π-λ theorem
- Hammersley–Clifford theorem
- Marcinkiewicz–Zygmund inequality
- Sklar's theorem
- Wold's decomposition theorem
- Inverse transform sampling
- Minlos theorem
- Feldman–Hájek theorem
- Fukushima correspondence between Dirichlet forms and processes
- Kac's lemma
- Kantorovich–Rubinstein duality
- Cameron–Martin theorem
- Recurrence and capacity of graphs
- Wigner semicircle law
- XYZ inequality
- Scheffé's lemma
- Kantorovich duality
- Milstein method
- Runge–Kutta method for stochastic differential equations
- Hamiltonian Monte Carlo
- Brenier's theorem
- Box–Muller transform
- Boole's inequality
- Continuity of probability measures
- Monotonicity of probability
- Probability of the complement
- Multiplication rule
- Jensen's inequality for integrals
- Addition rule for two events
- Stein's lemma
- Law of total probability for an event and its complement
- The cumulative distribution function determines the distribution
- Limit of the cumulative distribution function at infinity
- Monotonicity of the cumulative distribution function
- Almost sure convergence implies convergence in probability
- Convergence in probability implies convergence in distribution
- Kakutani's solution of the Dirichlet problem
- Linearity of expectation
- Mehta integral
- Cauchy–Schwarz inequality for expectations
- Independence means the joint law is the product of the marginals
- Tail sum formula for expectation
- Variance as the mean of the square minus the square of the mean
- Variance under scaling
- Variance under translation
- Mean of the Poisson distribution
- Variance of a sum
- Harmonic measure as exit distribution
- Law of the unconscious statistician
- Dvoretzky–Kiefer–Wolfowitz inequality
- Expectation with respect to the binomial distribution
- Mean of the geometric distribution
- Mean of the normal distribution
- Expectation of a product of independent random variables
- Moments are derivatives of the moment-generating function at zero
- Independent random variables are uncorrelated
- Pickands–Balkema–De Haan theorem
- Moment-generating function of the normal distribution
- Variance of the normal distribution
- Characteristic function of the normal distribution
- Generating function of a sum of independent random variables
- Gibbs sampling
- Wald's equation
- Moment-generating function of a sum of independent random variables
- Characteristic function of a sum of independent random variables
- Sum of independent Poisson random variables
- Edgeworth expansion
- Sum of independent normal random variables
- Delta method
- Kingman's subadditive ergodic theorem
Examples 6
Counterexamples 3
Problems 2
Definitions 190
- Self-avoiding walk
- Error function
- Filtration
- Interacting particle system
- Local time
- Percolation threshold
- Stopping time
- Concentration of measure
- Erdős–Rényi model
- Excessive function
- Infinite product measure
- Kullback–Leibler divergence
- Langevin equation
- Loop-erased random walk
- Markov kernel
- Percolation theory
- Point process
- Probabilistic method
- Queueing theory
- Random matrix
- Regularity structures
- Renewal theory
- Sample space
- Sub-Gaussian distribution
- Survival function
- Tracy–Widom distribution
- Uniform integrability
- Autocorrelation function
- Copula
- Coupling
- Cumulant
- Doob's h-transform
- Exchangeable random variables
- Exponential family
- Hazard function
- Infinitely divisible distribution
- Infinitesimal generator of a Markov process
- Markov random field
- Outcome
- Poisson boundary
- Rate function
- Rough path
- Stratonovich integral
- Tightness of measures
- von Mises–Fisher distribution
- Conditioned Brownian motion
- Hellinger distance
- Lindeberg's condition
- Potential operator of a Markov process
- Rademacher functions
- Random walk on a group
- Regular conditional probability
- Stable distribution
- Stochastic geometry
- Stochastic ordering
- Total variation distance between probability measures
- Cylinder set measure
- Green's function of a Markov process
- Kardar–Parisi–Zhang equation
- Lévy–Prokhorov metric
- Weak convergence of measures
- Fokker–Planck equation
- Standard probability space
- Stochastic Volterra equation
- Wasserstein metric
- Large deviations theory
- Abstract Wiener space
- Laplace–Stieltjes transform
- Diffusion process
- Dirichlet form
- Doléans-Dade exponential
- Gaussian measure
- Kolmogorov backward equation
- Euler–Maruyama method
- Stochastic differential equation
- Dynkin system
- Event
- Pi-system
- Martin boundary
- Schramm–Loewner evolution
- Probability measure
- Probability space
- Almost surely
- Conditional probability
- Independence of two events
- Probability distribution
- Random graph
- Conditional independence
- Mutual independence of events
- Pairwise independence
- Independent sigma-algebras
- Random variable
- Convergence in probability
- Random variable with a density
- Almost sure convergence
- Cumulative distribution function
- Dirichlet process
- Law of a random variable
- Adapted process
- Classical definition of probability
- Convergence in distribution
- Discrete random variable
- Identically distributed random variables
- Independence of two random variables
- Median
- Quadratic variation
- Self-similar process
- Empirical process
- Lévy process
- Probability density function
- Probability mass function
- Wiener process
- Cauchy distribution
- Continuous uniform distribution
- Density of the normal distribution
- Expected value
- Exponential distribution
- Feller process
- Finite-dimensional distributions
- Gaussian process
- Independence of random variables
- Particle filter
- Quantile function
- Random integral equation
- Stationary process
- Stopped process
- Bernoulli distribution
- Beta distribution
- Convergence in mean
- Gamma distribution
- Geometric Brownian motion
- Geometric distribution
- Ornstein–Uhlenbeck process
- Poisson distribution
- Stochastic partial differential equation
- Variance
- Binomial distribution
- Brownian bridge
- Conditional expectation
- Covariance
- Fractional Brownian motion
- Hunt process
- Negative binomial distribution
- Normal distribution
- Conditional variance
- Independent and identically distributed random variables
- Martingale
- Probability-generating function
- Discrete uniform distribution
- Markov property
- Random walk
- Convolution of probability distributions
- Hypergeometric distribution
- Markov chain
- Moment
- Standard deviation
- Supermartingale
- Conditional probability distribution
- Moment-generating function
- Transition matrix
- Central moment
- Characteristic function
- Local martingale
- Malliavin calculus
- Stationary distribution
- Submartingale
- Semimartingale
- Birth–death process
- Contiguity of measures
- Detailed balance
- Hidden Markov model
- Recurrence and transience of states
- Bernoulli process
- Coupling from the past
- Metropolis–Hastings algorithm
- Itô calculus
- Poisson point process
- Markov chain mixing time
- Gaussian free field
- Markov chain Monte Carlo
- Absorbing Markov chain
- Galton–Watson process
- Cumulant generating function
- Continuous-time Markov chain
- Boolean model
- Chi-squared distribution
- Student's t-distribution
- F-distribution
- Noncentral chi-squared distribution
- Wishart distribution