# Injecting quality into your Airflow DAG Lab

> In this video, Zach walk you through the setup and execution of a simple data pipeline using Airflow, focusing on reading data from Kafka and storing it in a production table. He covers key components like ExecutionTimeout, MaxActiveRuns, and the importance of data quality checks. He demonstrates h…

- Web page: https://www.dataexpert.io/lesson/injectingqualityintoyourairflowdaglab-jan2026-p735-l1907
- Program: [AnalyticsExpert](https://www.dataexpert.io/program/analytics-expert)
- Module: Week 6: Airflow & Pipeline Specs with Trino
- Access: Requires enrollment in AnalyticsExpert
- Length: 54 min video
- Skills: Python, ETL/ELT, Airflow, Apache Iceberg, Kafka
- Academy: DataExpert.io Academy

## About this lesson

In this video, Zach walk you through the setup and execution of a simple data pipeline using Airflow, focusing on reading data from Kafka and storing it in a production table. He covers key components like ExecutionTimeout, MaxActiveRuns, and the importance of data quality checks. He demonstrates how to handle missing data and ensure our pipeline is idempotent, meaning it won't create duplicates when rerun. He also highlights the significance of staging tables and the write-audit-publish pattern for maintaining data integrity.

## Navigation

- Previous lesson: [How to build job orchestration that matters](https://www.dataexpert.io/lesson/howtobuildjoborchestrationthatmatters-jan2026-p735-l1906.md)
- Next lesson: [How to load data into Iceberg with Airflow](https://www.dataexpert.io/lesson/howtoloaddataintoicebergwithairflow-jan2026-p735-l1908.md)