Agentic RAG Foundations: Grading & Query Rewriting

Practise and Check

Deliverable

Grader loop: add a relevance grader and a two-retry rewrite loop to your T6 system and log how often each path fires on the golden set.

Assessment

Answer the five Interview questions without notes, then run the lab.

Interview probe

A week after the Larkspur handbook moved to a new document system, the support assistant's LLM bill doubled while traffic stayed flat. Traces show most questions now making three retrievals. What happened, and what do you check first?

Common mistakes

• Passing a chunk that is about the topic but lacks the answer
• Comparing binary_score exactly with "yes" without normalising it first
• Leaving off-topic questions for the document grader to reject

Related Modules

• T9.2Self-Correcting RAG: CRAG & Self-RAG
• T9.3Adaptive RAG & Query Routing
• T9.4RAG as an Agent Tool
• T9.5Reliability, Feedback Loops & Diversity