# Airflow Data Quality (Day 1 Lecture)

> In this lecture, Zach explains the concept of cumulative DAGs in Airflow and their unique architecture. He also discusses the importance of using partition sensors and setting concurrency limits on DAGs. Additionally, he shares best practices for backfilling data and highlight the potential challen…

- Web page: https://www.dataexpert.io/lesson/airflow-data-quality-day-1-lecture-v4
- Program: [Data Engineering Mastery Course](https://www.dataexpert.io/program/data-engineering-mastery-course)
- Module: Week 3: Airflow and Airflow Data Quality
- Access: Requires enrollment in Data Engineering Mastery Course
- Length: 38 min video
- Skills: Data Modeling, ETL/ELT, Apache Spark, Airflow
- Academy: DataExpert.io Academy

## About this lesson

In this lecture, Zach explains the concept of cumulative DAGs in Airflow and their unique architecture. He also discusses the importance of using partition sensors and setting concurrency limits on DAGs. Additionally, he shares best practices for backfilling data and highlight the potential challenges and resource-intensive nature of backfilling. This lecture explains how to handle both small and large datasets in your pipeline and airflow. [Recorded on May22nd, 2024]

## Navigation

- Previous lesson: [Airflow Data Quality (Day 1 Lab)](https://www.dataexpert.io/lesson/airflow-data-quality-day-1-lab-v4.md)
- Next lesson: [Airflow Data Quality (Day 2 Lab)](https://www.dataexpert.io/lesson/airflow-data-quality-day-2-lab-v4.md)