# Hard Orchestration Lessons Day 2 Lab

> In this lab, Zach takes you through the optimization of a data pipeline, with a focus on making it idempotent and predictable. He demonstrates steps such as setting up dependencies, handling data waits, and ensuring task success. Zach also emphasizes the importance of scheduling and avoiding duplic…

- Web page: https://www.dataexpert.io/lesson/hard-orchestration-lessons-day-2-lab-jan2025-p736-l726
- Program: [AnalyticsExpert](https://www.dataexpert.io/program/analytics-expert)
- Module: Week 6: Airflow & Pipeline Specs with Trino
- Access: Requires enrollment in AnalyticsExpert
- Length: 32 min video
- Skills: SQL, ETL/ELT, Airflow
- Academy: DataExpert.io Academy

## About this lesson

In this lab, Zach takes you through the optimization of a data pipeline, with a focus on making it idempotent and predictable. He demonstrates steps such as setting up dependencies, handling data waits, and ensuring task success. Zach also emphasizes the importance of scheduling and avoiding duplicates.

## Navigation

- Previous lesson: [Hard Orchestration Lessons Day 2 Lecture](https://www.dataexpert.io/lesson/hard-orchestration-lessons-day-2-lecture-jan2025-p736-l725.md)
- Next lesson: [Cumulative DAGs in Production Day 3 Lecture](https://www.dataexpert.io/lesson/cumulative-dags-in-production-day-3-lecture-jan2025-p736-l760.md)