Retrieval-Augmented Generation

Chunking, embeddings, vector search, reranking and the evaluation that tells you whether any of it worked.

Module 06.4 · Advanced
Free

10h · 8 lessons · 1 challenge

Before this: NLP Tasks & Production Pipelines, Prompting & Structured Output

About this module

RAG is the most-built and least-evaluated LLM architecture. This module takes it seriously as a retrieval problem first: chunking strategy, hybrid search, reranking, and separating retrieval failures from generation failures when the answer is wrong.

It is also the most commonly requested system design interview topic right now, so the module ends with that framing.

After this module you can

8 lessons

Lesson 1
Chunking strategies and what each destroys
Kind
Concept
Length
50 min
Lesson 2
Embedding models and vector index choices
Kind
Concept
Length
50 min
Lesson 3
Hybrid search: dense plus lexical
Kind
Concept
Length
45 min
Lesson 4
Reranking and the two-stage pattern
Kind
Concept
Length
45 min
Lesson 5
Evaluating retrieval and generation separately
Kind
Concept
Length
55 min
Lesson 6
Build a RAG system over a real corpus
Kind
Lab
Length
130 min
Lesson 7
Retrieval Roulette: the answer is wrong — whose fault?
Kind
Interactive
Length
40 min
Lesson 8
Checkpoint: design the RAG system
Kind
Checkpoint
Length
30 min

The challenge: Retrieval Roulette

Wrong answers from a RAG system. Attribute each to chunking, embedding, retrieval depth, reranking or generation — then fix it and confirm.

Worth 600 XP.

Related modules

All modules
Agents & Tool Use
10h · 8 lessons
Evaluating LLM Systems
8h · 8 lessons
ML System Design Foundations
10h · 8 lessons