Sign in to view content

Sign in to view this lesson and continue learning.

Airflow Data Quality (Day 2 Lab)

Week 3: Airflow and Airflow Data Quality
24 mins

Description

In this lab, Zach explains how automated data quality checks work. He discusses the process of running checks on an output table, ensuring that certain columns are not null, and executing Trino queries to validate the results. He also covers the steps involved in inserting and cleaning up data, as well as the challenges we faced with permissions. [Recorded on May23rd, 2024]