# Hard Orchestration Lessons Day 2 Lab

> In this lab, Zach takes you through the optimization of a data pipeline, with a focus on making it idempotent and predictable. He demonstrates steps such as setting up dependencies, handling data waits, and ensuring task success. Zach also emphasizes the importance of scheduling and avoiding duplic…

- Web page: https://www.dataexpert.io/lesson/hard-orchestration-lessons-day-2-lab-jan2025
- Program: [2025 New Year  Data Engineering Boot Camp starting January 6th](https://www.dataexpert.io/program/2025-new-year-data-engineering-boot-camp-starting-january-6th)
- Access: Requires enrollment in 2025 New Year  Data Engineering Boot Camp starting January 6th
- Length: 32 min video
- Skills: SQL, ETL/ELT, Airflow
- Academy: DataExpert.io Academy

## About this lesson

In this lab, Zach takes you through the optimization of a data pipeline, with a focus on making it idempotent and predictable. He demonstrates steps such as setting up dependencies, handling data waits, and ensuring task success. Zach also emphasizes the importance of scheduling and avoiding duplicates.

## Navigation

- Previous lesson: [Hard Orchestration Lessons Day 2 Lecture](https://www.dataexpert.io/lesson/hard-orchestration-lessons-day-2-lecture-jan2025.md)
- Next lesson: [Cumulative DAGs in Production Day 3 Lecture](https://www.dataexpert.io/lesson/cumulative-dags-in-production-day-3-lecture-jan2025.md)