Nearly mandatory for infrastructure engineering
The papers that turn up in the design review of every distributed system.
7 papers, in the order to read them. A paper that needs another one first is listed under it.
- 1Time, Clocks, and the Ordering of Events in a Distributed System
happens-before, logical clocks, and state machine replication
- 2The Part-Time Parliament
consensus that survives any minority failing, told as an archaeology paper
Read first: Time, Clocks, and the Ordering of Events in a Distributed System
- 3
- 4MapReduce: Simplified Data Processing on Large Clusters
two functions, and the framework handles the thousand machines
Read first: The Google File System
- 5Dynamo: Amazon's Highly Available Key-value Store
always writable, reconciled later, with consistent hashing and vector clocks
- 6In Search of an Understandable Consensus Algorithm
consensus decomposed into leader election, log replication and safety
Read first: The Part-Time Parliament
- 7Large-scale cluster management at Google with Borg
one scheduler for batch and serving, and the ancestor of Kubernetes