# Evaluations and Reliability MLOps Lecture

> In this lecture, Zach talks about end to end AI apps, focusing on MLOps, evaluations, and reliability. He explains where agents break, like user behavior drift, code and tool changes via MCP, model upgrades, RAG data changes, and even tool or web downtime, plus latency and context window issues. He…

- Web page: https://www.dataexpert.io/lesson/endtoendaiapplicationsday1lecture-mar26-p737-l2153
- Program: [AIExpert](https://www.dataexpert.io/program/ai-expert)
- Module: Week 5: End-to-End AI Applications
- Access: Requires enrollment in AIExpert
- Length: 36 min video
- Skills: MLOps, LLMs, CI/CD
- Academy: DataExpert.io Academy

## About this lesson

In this lecture, Zach talks about end to end AI apps, focusing on MLOps, evaluations, and reliability. He explains where agents break, like user behavior drift, code and tool changes via MCP, model upgrades, RAG data changes, and even tool or web downtime, plus latency and context window issues. He breaks down unit tests, integration tests, and end to end evaluation, and four evaluation styles, cosine distance, ROUGE, exact match, custom scoring, and LLM as a judge.

## Navigation

- Previous lesson: [Big Picture AI Applications Lab](https://www.dataexpert.io/lesson/building-end-to-end-ai-application-day2-lab-oct25-p737-l1522.md)
- Next lesson: [Evaluations and Reliability MLOps Lab](https://www.dataexpert.io/lesson/endtoendaiapplicationsday1lab-mar26-p737-l2154.md)