Cost and latency optimisation

1. 1

   Why Cost and Latency Decide Production

   6 min · Credited source
2. 2

   The Eight Cost and Latency Drivers

   7 min · Credited source
3. 3

   Latency: Prefill, Decode, Streaming, and the Tail

   7 min · Credited source
4. 4

   Model Routing and Prompt Discipline

   7 min · Credited source
5. 5

   Caching in GenAI Systems

   10 min · Credited source
6. 6

   RAG and Agent Cost Controls

   7 min · Credited source
7. 7

   Budgets and Spend Guardrails

   7 min · Credited source
8. 8

   Practise Cost and Latency Interview Questions

   8 min · Credited source

Also used in this module

Lessons taught in another module that this one builds on.