Purchase Required

You need to purchase this content in order to view it

Orchestration and Airflow Fundamentals Lab

Module
70 mins

Description

In this video, Zach walks through the first lab of the Spring Data Engineering Bootcamp, focusing on idempotent pipelines, performance optimizations, and Airflow DAGs. The structure of the AirflowDBT project is explained, along with effective methods for creating and managing DAGs. Additionally, the video demonstrates how to handle data processing using AWS Glue and Spark, highlighting the significance of developing idempotent pipelines.