Sign in to view content

Sign in to view this lesson and continue learning.

Advanced dbt: Production Pipelines and dbt with Airflow Lab

Week 2: Advanced dbt
62 mins
Data ModelingETL/ELTAirflowdbt

Description

The lesson covers advanced techniques in dbt, focusing on implementing the right audit-publish pattern and integrating dbt with Airflow. Participants will learn how to create an audit table for critical data, ensuring data quality through testing before publishing to production tables. The session also demonstrates how to configure Airflow to manage dbt tasks, including setting environment variables and using Docker for deployment, making it ideal for data engineers looking to enhance their workflow automation and data integrity practices.