Distributed Systems Course
Every system that runs on more than one machine faces the same problems. Messages get lost or delayed. Machines crash and come back. Clocks disagree. Parts of the network can't reach each other. This course works through those problems in order, one lesson at a time. It starts with the models every algorithm assumes, works up through replication, time, consensus and coordination, and ends by reading the systems that defined the field.
What's inside
- Foundations: system and failure models, safety vs liveness, CAP, consistency models and FLP.
- Communication: RPC, wire formats and schema evolution, timeouts, retries and backoff, circuit breakers and rate limits.
- Replication & Partitioning: leader-based and leaderless replication, quorums, consistent hashing, partitioning and CRDTs.
- Time, Order & Causality: clock synchronization, Lamport and vector clocks, version vectors and dotted version vectors.
- Consensus & Replicated State Machines: Raft, Paxos, ZAB, Viewstamped Replication, and building services on a replicated log.
- Coordination & Transactions: leases and fencing, distributed locks, 2PC and sagas, exactly-once processing.
- Failure Detection & Recovery: failure detectors, gossip membership and distributed snapshots.
- Byzantine Faults & Trust: BFT, PBFT, and the cryptography and PKI that secure service-to-service traffic.
- Landmark Systems: GFS/HDFS, MapReduce/Spark, Bigtable/HBase, Dynamo, ZooKeeper, Spanner, Calvin and distributed ledgers.
It goes deeper than the distributed-data modules of the System Design Course. Take it after that course, or alongside it if you already know caching, databases and queues.
How it works: each lesson shows where you are in its module and links to the next one. Tick lessons in the sidebar, or press Mark lesson done & continue, and the module and course progress bars fill up. The deep dives under each module are optional.
Where to start
Do Module 1 first, because every later lesson relies on its vocabulary. After that, Modules 2–4 can be taken in any order. Module 5 (consensus) is the core of the course. Module 9 reads best last, since each landmark system combines ideas from the earlier modules.