Minimum description length

Summary

The minimum description length (MDL) principle selects the model that gives the shortest description of the data. The description counts the bits to state the model and the bits to encode the data with the help of the model. It turns model selection into data compression: a good model captures regularities and so compresses the data. It is a computable relative of Kolmogorov complexity, and Jorma Rissanen introduced it.