Cost, Capacity & Tradeoffs

Unit economics, build versus buy, and making the case for an ML investment to people who do not build models.

Module 07.7 · Advanced
Free

6h · 6 lessons · 1 challenge

Before this: Monitoring, Drift & Reliability

About this module

Senior ML engineers are asked what something will cost and whether it is worth it. This module builds that fluency: cost per prediction, cost per training run, the hosted-versus-self-hosted arithmetic, and the capacity planning behind a launch.

Ends with writing the one-page case for an ML investment — the artefact that actually gets projects approved.

After this module you can

6 lessons

Lesson 1
Unit economics of training and inference
Kind
Concept
Length
50 min
Lesson 2
Hosted APIs versus self-hosting, with the arithmetic
Kind
Concept
Length
50 min
Lesson 3
Capacity planning and headroom
Kind
Concept
Length
40 min
Lesson 4
Cost Cutter: halve the bill, keep the quality
Kind
Interactive
Length
40 min
Lesson 5
Write the business case
Kind
Lab
Length
70 min
Lesson 6
Checkpoint: justify the spend
Kind
Checkpoint
Length
25 min

The challenge: Cost Cutter

A production system and its bill. Halve the spend without dropping below the quality floor or breaking the latency SLA.

Worth 500 XP.

Related modules

All modules
The ML Breadth Interview
8h · 6 lessons
The ML System Design Interview
10h · 6 lessons
Depth & Research Interviews
8h · 6 lessons