Math 2.0

Statistics Definition

Probit model

Builds on Generalized linear modelBernoulli distributionCumulative distribution functionNormal distributionLogistic regression

Definition

Let x1,…,xn∈ℝpx_1, \dots, x_n \in \R^p be known regressor vectors, and let Φ\Phi be the cumulative distribution function of the standard normal distribution. The probit model for responses y1,…,yn∈{0,1}y_1, \dots, y_n \in \set{0, 1} states three things. The yiy_i are independent, yiy_i has the Bernoulli distribution with parameter pip_i, and pi=Φ(xiTβ)p_i = \Phi(x_i^T \beta) for an unknown β∈ℝp\beta \in \R^p.

Remarks

Equivalent latent variable form: let yi∗=xiTβ+εiy_i^* = x_i^T \beta + \varepsilon_i with independent εi∼N(0,1)\varepsilon_i \sim N(0, 1), and yi=1y_i = 1 if yi∗>0y_i^* > 0 and yi=0y_i = 0 otherwise. Then P(yi=1)=P(εi>−xiTβ)=Φ(xiTβ)P(y_i = 1) = P(\varepsilon_i > -x_i^T \beta) = \Phi(x_i^T \beta), by the symmetry of the normal distribution. The error variance is fixed at 11 because β\beta and the scale of εi\varepsilon_i cannot be identified separately from binary data.

It is the generalized linear model with Bernoulli responses and link g=Φ−1g = \Phi^{-1}, which is not the canonical link.

Example: with xi=(1,ti)x_i = (1, t_i) and β=(−1,0.5)\beta = (-1, 0.5), at t=2t = 2 one gets p=Φ(0)=1/2p = \Phi(0) = 1/2.

Non-example: the model pi=1/(1+e−xiTβ)p_i = 1/(1 + e^{-x_i^T \beta}) uses the logistic function instead of Φ\Phi; it is logistic regression, not the probit model. Its latent errors are logistic, with variance π2/3\pi^2/3, so its coefficients are typically larger than probit coefficients by a factor of roughly 1.61.6 to 1.81.8.

Reading path

To understand this page from the ground up, read these 6 pages in order. The foundations come first.

Show the path as a graph
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Bernoulli distribution concept
  2. Cumulative distribution function concept
  3. Generalized linear model concept
  4. Logistic regression concept
  5. Normal distribution concept
  6. Probit model definition

Further reading

  1. Web https://en.wikipedia.org/wiki/Probit_model
About this page
TagGR4FN6XNWP
URIm2://GR4FN6XNWP
Kinddefinition
WritingW0 stub
MSC62J12, 62P20
DefinesProbit model
UsesGeneralized linear model, Bernoulli distribution, Cumulative distribution function, Normal distribution, Logistic regression

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.