Chapter 29 sections from Deep Learning with PyTorch.
7 items
A Bayesian neural network is a neural network whose parameters are treated as random variables rather than fixed unknown constants.
Bayesian neural networks require inference over a posterior distribution:
Monte Carlo methods approximate difficult mathematical quantities using random samples.
Uncertainty estimation measures how much confidence a model should place in its own predictions.
A Gaussian process is a probabilistic model over functions. Instead of defining a probability distribution over parameters, as in Bayesian neural networks, a Gaussian process defines a probability distribution directly
Probabilistic deep learning adds distributions to ordinary neural networks.
Probabilistic deep learning extends neural networks with explicit probability models.