ML System Design Foundations

Requirements, metrics, architecture and tradeoffs — the framework behind every design interview and every real system.

Module 07.1 · Advanced
Free

10h · 8 lessons · 1 challenge

Before this: Data Pipelines & Feature Engineering, Structuring ML Projects

About this module

A repeatable framework: clarify the requirements, define online and offline metrics, size the problem, sketch the architecture, then name the tradeoffs before anyone asks.

Worked designs include a feed ranker, a fraud detector, a search system and an LLM assistant, each done end to end. This module and the interview track are the two most cited by learners who move up a level.

After this module you can

8 lessons

Lesson 1
The framework: requirements to tradeoffs
Kind
Concept
Length
55 min
Lesson 2
Online and offline metrics, and the gap between them
Kind
Concept
Length
50 min
Lesson 3
Sizing: traffic, latency budgets, storage, cost
Kind
Concept
Length
55 min
Lesson 4
Worked design: ranking a feed
Kind
Concept
Length
60 min
Lesson 5
Worked design: real-time fraud detection
Kind
Concept
Length
60 min
Lesson 6
Worked design: an LLM assistant over company data
Kind
Concept
Length
60 min
Lesson 7
Design Dojo: defend the architecture
Kind
Interactive
Length
50 min
Lesson 8
Checkpoint: design under constraints
Kind
Checkpoint
Length
35 min

The challenge: Design Dojo

You present an architecture and the game pushes back the way an interviewer does — traffic times ten, latency halved, budget cut. Adapt or justify.

Worth 700 XP.

Related modules

All modules