Sign in to view content

Sign in to view this lesson and continue learning.

Hard Orchestration Lessons Day 2 Lab

Module
32 mins
SQLETL/ELTAirflow

Description

In this lab, Zach takes you through the optimization of a data pipeline, with a focus on making it idempotent and predictable. He demonstrates steps such as setting up dependencies, handling data waits, and ensuring task success. Zach also emphasizes the importance of scheduling and avoiding duplicates.