# How to build job orchestration that matters

> In this lecture, Zach dives into the concept of orchestration and its critical role in data pipelines, emphasizing that orchestration is not just about tools like Airflow, but about the entire process from data collection to ROI. He shares insights on common pitfalls in orchestration, such as bad l…

- Web page: https://www.dataexpert.io/lesson/howtobuildjoborchestrationthatmatters-jan2026-p735-l1906
- Program: [AnalyticsExpert](https://www.dataexpert.io/program/analytics-expert)
- Module: Week 6: Airflow & Pipeline Specs with Trino
- Access: Requires enrollment in AnalyticsExpert
- Length: 54 min video
- Skills: Data Modeling, ETL/ELT, Airflow, Problem Solving
- Academy: DataExpert.io Academy

## About this lesson

In this lecture, Zach dives into the concept of orchestration and its critical role in data pipelines, emphasizing that orchestration is not just about tools like Airflow, but about the entire process from data collection to ROI. He shares insights on common pitfalls in orchestration, such as bad logging and schema changes, and discussed best practices like the right audit publish pattern. He also highlights the importance of idempotency in pipelines to avoid inconsistencies.

## Navigation

- Previous lesson: [Apache Iceberg Lab Day3](https://www.dataexpert.io/lesson/apacheiceberglabday3-9e57d-p735-l1996.md)
- Next lesson: [Injecting quality into your Airflow DAG Lab](https://www.dataexpert.io/lesson/injectingqualityintoyourairflowdaglab-jan2026-p735-l1907.md)