Probability theory and stochastic processes Foundations: probability spaces and events Concept
Probability axioms
Builds on Sample spaceEventSigma-algebra
Summary
The probability axioms of Kolmogorov are the three rules that a probability function on the events of a sample space must obey. First, for each event . Second, . Third, for each sequence of pairwise disjoint events, . This is countable additivity. A function that obeys these rules is a probability measure.
Remarks
Andrey Kolmogorov stated these axioms in 1933. The other rules of probability follow from the axioms. Examples are , , the rule for the complement and the addition rule for two events.
Reading path
To understand this page from the ground up, read these 17 pages in order. The foundations come first.
Show the path as a graph
- no evidence level
- Element definition
- Proposition concept
- Random experiment concept
- Set definition
- Disjunction definition
- Implication definition
- Predicate definition
- Union definition
- Sample space definition
- Universal quantifier definition
- Subset definition
- Power set definition
- Universal set definition
- Complement definition
- Sigma-algebra definition
- Event definition
- Probability axioms concept
Where this leads
374 pages build on this one.
- Variance
- Prior probability
- Chernoff bound
- Chapman–Kolmogorov equation
- Bias of an estimator
- Identically distributed random variables
- Law of the unconscious statistician
- Density of the normal distribution
- Exponential distribution
- Covariance matrix
- Chebyshev's inequality
- Characteristic function of a sum of independent random variables
- Stationary distribution
- Bernoulli process
- Markov chain
- Statistic
- Law of total variance
- Variance of the normal distribution
- Cauchy–Schwarz inequality for expectations
- Monotonicity of probability
- Correlation coefficient
- Variance under translation
- Almost sure convergence
- Law of total expectation
- Probability density function
- Expectation of a product of independent random variables
- Likelihood function
- Markov's inequality
- Standard score
- Poisson point process
- Gamma distribution
- De Moivre–Laplace theorem
- Buffon's needle problem
- Kolmogorov's zero–one law
- Independent random variables are uncorrelated
- Convolution of probability distributions
- Normal distribution
- Mean of the Poisson distribution
- Statistical hypothesis test
- Independence means the joint law is the product of the marginals
- Median
- Geometric probability
- Dirac measure
- Method of moments
- Mean of the normal distribution
- Independent sigma-algebras
- Independent and identically distributed random variables
- Classical definition of probability
- Pairwise independent events that are not mutually independent
- Marginal distribution
- Moment-generating function of the normal distribution
- Quantile function
- Weak law of large numbers
- Multiplication rule
- Addition rule for two events
- Random walk
- Random variable with a density
- Uncorrelated random variables that are not independent
- Kurtosis
- Martingale
- Variance of a sum
- Mean of the geometric distribution
- Expected value
- Strong law of large numbers
- Covariance
- Random variable
- Base rate fallacy
- Law of total probability
- Independence of two random variables
- Neyman–Pearson lemma
- Convergence in probability
- Boole's inequality
- P-value
- Chi-squared test
- Convergence in probability implies convergence in distribution
- Central limit theorem
- 68–95–99.7 rule
- Transition matrix
- Conditional variance
- Conditional probability
- Lévy's continuity theorem
- Convergence of random variables
- Maximum likelihood estimation
- Multivariate normal distribution
- Mutual independence of events
- Skewness
- Galton–Watson process
- Markov property
- Student's t-test
- Discrete random variable
- Bernoulli distribution
- Convergence in distribution
- The cumulative distribution function determines the distribution
- Sample variance
- Bayesian inference
- Confidence interval
- Posterior probability
- Variance under scaling
- Discrete uniform distribution
- Coupon collector's problem
- Cumulative distribution function
- Characteristic function
- Pairwise independence
- Cauchy distribution
- Bayes' theorem
- Variance as the mean of the square minus the square of the mean
- Birthday problem
- Moment-generating function
- Student's t-distribution
- Characteristic function of the normal distribution
- Second Borel–Cantelli lemma
- Sum of independent normal random variables
- Independence of two events
- Linearity of expectation
- Monty Hall problem
- Moment
- Beta distribution
- Probability of the complement
- Expectation with respect to the binomial distribution
- Cumulant generating function
- Joint probability distribution
- Probability distribution
- Stochastic process
- Sample mean
- Type I and type II errors
- Almost surely
- Generating function of a sum of independent random variables
- Chi-squared distribution
- Limit of the cumulative distribution function at infinity
- Hypergeometric distribution
- Moments are derivatives of the moment-generating function at zero
- Almost sure convergence implies convergence in probability
- Bertrand paradox
- First Borel–Cantelli lemma
- The characteristic function determines the distribution
- Law of a random variable
- Convergence in mean
- Estimator
- Variance of a sum of independent random variables
- Mean squared error
- Poisson distribution
- Probability measure
- Binomial distribution
- Standard deviation
- Law of total probability for an event and its complement
- Probability mass function
- Gambler's ruin
- Continuous uniform distribution
- Hoeffding's inequality
- Moment-generating function of a sum of independent random variables
- Continuity of probability measures
- Independence of random variables
- Geometric distribution
- Monotonicity of the cumulative distribution function
- Consistent estimator
- Poisson limit theorem
- Negative binomial distribution
- Tail sum formula for expectation
- Conditional expectation
- Absorbing Markov chain
- Sum of independent Poisson random variables
- Conditional probability distribution
- Probability-generating function
- Memorylessness
- Conditional independence
- Central moment
- Law of large numbers
- Probability space
- Doob's upcrossing inequality
- Bernstein–von Mises theorem
- Cramér–Rao bound
- Efficiency of an estimator
- Log-rank test
- Functional data analysis
- Poisson regression
- Sequential analysis
- Ergodic decomposition
- Koksma–Hlawka inequality
- Hodges' superefficient estimator
- Martingale representation theorem
- Mathematical statistics
- F-test
- Laplace transform of the Dirac delta
- Stationary process
- Orthogonal polynomials on the unit circle
- Cramér–Wold theorem
- Boolean model
- Stochastic partial differential equation
- Wald–Wolfowitz optimality of the sequential probability ratio test
- Doob's martingale inequality
- Sequential probability ratio test
- Brownian bridge
- Consistency of the maximum likelihood estimator
- Wiener process
- Empirical Bayes method
- Karhunen–Loève theorem
- Itô isometry
- Bayes factor
- Pickands–Balkema–De Haan theorem
- Basu's theorem
- Variogram
- Robbins–Monro algorithm
- Contiguity of measures
- Order statistic
- Dirichlet process
- Lindley's paradox
- Universally measurable set
- M-estimator
- Ornstein–Uhlenbeck process
- Kernel regression
- Bayes estimator
- Adapted process
- Score test
- Kingman's subadditive ergodic theorem
- Multivariate analysis of variance
- McDiarmid's inequality
- Lévy's characterization of Brownian motion
- Asymptotic normality of the maximum likelihood estimator
- Mann–Whitney U test
- Kolmogorov automorphism
- Score
- F-distribution
- Edgeworth expansion
- Crofton formula
- Monotone likelihood ratio
- Sample mean and sample covariance
- Wilcoxon signed-rank test
- Metropolis–Hastings algorithm
- Continuous-time Markov chain
- Kriging
- Identifiability
- Minimal sufficient statistic
- Whittle likelihood
- Logistic regression
- Convergence to equilibrium of ergodic Markov chains
- Cramér–von Mises criterion
- Azuma's inequality
- Gaussian free field
- Parry measure
- Kernel density estimation
- Erdős–Kac theorem
- Detailed balance
- Coupling from the past
- Robust statistics
- Hidden Markov model
- Finite-dimensional distributions
- Continuous mapping theorem
- Bias–variance decomposition
- Lévy process
- Wald's equation
- Random ordinary differential equation
- Monte Carlo integration
- Time series
- Optional stopping theorem
- Breakdown point
- Delta method
- Minimum description length
- Noncentral chi-squared distribution
- Hájek–Le Cam convolution theorem
- Behrens–Fisher problem
- Submartingale
- Hodges–Lehmann estimator
- Kruskal–Wallis test
- Stochastic difference equation
- Sampling distribution
- Information geometry
- Recurrence and transience of states
- Malliavin calculus
- Wishart distribution
- Birth–death process
- Bayes risk
- Statistical inference
- Minimum-variance unbiased estimator
- Sign test
- Slutsky's theorem
- Tanaka's formula
- Geometric Brownian motion
- Empirical likelihood
- Dvoretzky–Kiefer–Wolfowitz inequality
- Bayesian information criterion
- Berry–Esseen theorem
- Continuity of measure from below and above
- Hunt process
- Cochran's theorem
- Stochastic approximation
- Jackknife
- Quantile regression
- Markov chain mixing time
- Birkhoff's ergodic theorem
- Akaike information criterion
- Hewitt–Savage zero–one law
- Jensen's inequality for integrals
- Statistical model
- Reflection principle
- Credible interval
- Independence of sample mean and sample variance for normal samples
- Self-similar process
- Gibbs sampling
- Estimating equations
- Supermartingale
- Anderson–Darling test
- Spearman's rank correlation coefficient
- Family-wise error rate
- Markov chain Monte Carlo
- Dickey–Fuller test
- Generalized method of moments
- Doob's martingale convergence theorems
- Random integral equation
- Uniformly most powerful test
- Bernstein inequalities
- Kendall rank correlation coefficient
- Semimartingale
- Empirical distribution function
- Bootstrap
- Influence function
- Oseledets theorem
- Itô calculus
- Ancillary statistic
- Stopped process
- Jeffreys prior
- Moments of the log-normal distribution
- Complete statistic
- Horvitz–Thompson estimator
- U-statistic
- Fractional Brownian motion
- Bayesian hierarchical model
- L-estimator
- Power of a test
- Parametric model
- Randomization
- Sufficient statistic
- Gaussian process
- Missing data mechanisms
- Likelihood-ratio test
- Karlin–Rubin theorem
- Conjugate prior
- Kolmogorov–Smirnov test
- Expectation–maximization algorithm
- Hotelling's T-squared distribution
- Burkholder–Davis–Gundy inequality
- Doob–Meyer decomposition theorem
- Cross-validation
- Barbier's theorem
- Wald test
- Pivotal quantity
- Generalized linear model
- Random graph
- Box–Jenkins method
- Kolmogorov continuity theorem
- Shrinkage estimator
- Pesin theory
- Empirical process
- Binomial proportion confidence interval
- Lévy's upward theorem
- False discovery rate and the Benjamini–Hochberg procedure
- Particle filter
- Neyman construction
- Wilks' theorem
- Skorokhod's embedding theorem
- Blaschke–Lebesgue theorem
- Permutation test
- Fisher's exact test
- Bonferroni correction
- Doob decomposition theorem
- Local asymptotic normality
- Frequentist inference
- Likelihood principle
- Fisher–Neyman factorization theorem
- Girsanov theorem
- Quadratic variation
- Observed information
- Feller process
- Point estimation
- Local martingale
Further reading
- Web https://en.wikipedia.org/wiki/Probability_axioms, Kolmogorov axioms
About this page
| Tag | 0DAX8PMAJ4 |
|---|---|
| URI | m2://0DAX8PMAJ4 |
| Aliases | kolmogorov-axioms |
| Kind | concept |
| Writing | W1 stated |
| MSC | 60A05 |
| Uses | Sample space, Event, Sigma-algebra |
| Same as |
Markdown · JSON · Edit on GitHub
What this page needs for W2
- edge defines in: at least one definition (0 of 1)
- edge instance_of in: at least two examples (0 of 2)
- edge not_instance_of in: at least one non-example (0 of 1)
- edge specializes both: the more general notions and the special cases (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.