Lesson 3.3

Evaluating retrieval

Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.

12mAdvanced5.4k students

Overview

What this lesson covers

  • Build a query set with known correct passages
  • Measure recall and precision at k
  • Separate retrieval failures from generation failures

This lesson sits in Retrieval Quality, part of Retrieval-Augmented Generation from Scratch. It assumes what came before it and leads directly into the next lesson in the module.


In this lesson you will:

  • Build a query set with known correct passages
  • Measure recall and precision at k
  • Separate retrieval failures from generation failures