Forward Deployed

Production AI Systems: sections and modules

T4.7

AgentOps: versioning, rollout, CI/CD, red teaming

Ship prompt and model changes safely.

About 3 h 4 min: 1 h 4 min reading + 2 h practice · 9 lessons

Scope: Change management
Prerequisites: Evaluation and release gates

Lessons

9 lessons

1
Prompt Versioning, Rollout, and Rollback
6 min
2
Testing Prompt Changes
7 min · Credited source
3
AgentOps Mapped to Databricks
7 min
4
Enterprise RAG on a Governed Lakehouse
8 min
5
Enterprise RAG on a Governed Lakehouse: Running and Auditing
7 min
6
Channel Adapters and Human Escalation
6 min
7
Red Teaming and Layered Guardrails
9 min
8
Infrastructure as Code and the Release Pipeline
6 min
9
Practise AgentOps Interview Questions
8 min

Also used in this module

Lessons taught in another module that this one builds on.

Gate Releases on Quality
6 min
Roll Out Changes Gradually
5 min
Access-Controlled RAG on Databricks
7 min
Anatomy of a Deployed Multi-Agent Platform
11 min

Practise and Check

Deliverable: Rollout and rollback plan
Assessment: Checkpoint
Interview probe: How do you roll out a new prompt?
Common mistakes: Shipping prompt edits without evals

Your Progress

How confident are you with this module?

1 means "I could not explain it yet"; 5 means "I could teach it". Rate again any time.

Your notes on this module

Saved in this browser when you leave the box.