Artificial intelligence and machine learning
16 papers, 1950 to 2020.
- Computing Machinery and Intelligence
the imitation game, and nine objections answered
- The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain
a learning rule for a linear threshold unit
- Learning Representations by Back-propagating Errors
the chain rule applied to a layered network
- Support-Vector Networks
the maximum margin hyperplane, and the kernel trick
- A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting
many weak learners, reweighted, add up to a strong one
- Long Short-Term Memory
a gated cell that carries the gradient across long gaps
- Gradient-Based Learning Applied to Document Recognition
convolution, weight sharing and pooling, trained end to end
- ImageNet Classification with Deep Convolutional Neural Networks
depth, ReLU, dropout and two GPUs
- Generative Adversarial Nets
a generator and a discriminator playing a minimax game
- Sequence to Sequence Learning with Neural Networks
an encoder LSTM into a decoder LSTM, with no alignment model
- Deep Residual Learning for Image Recognition
learn the residual, and a hundred layers become trainable
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
one deep sequence to sequence model per language pair, in production
- Mastering the game of Go with deep neural networks and tree search
policy and value networks guiding Monte Carlo tree search
- Attention Is All You Need
self-attention alone, with no recurrence and no convolution
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
masked language modelling, then fine-tuning
- Language Models are Few-Shot Learners
scale, and a task specified in the prompt rather than the weights