Sign in to view content

Sign in to view this lesson and continue learning.

How to load data into Iceberg with Airflow

Week 6: Airflow & Pipeline Specs with Trino
60 mins
Data ModelingETL/ELTAirflowApache Iceberg

Description

Learn how to effectively load data into Iceberg using Airflow in this comprehensive lesson. Gain insights into orchestration techniques through real-world examples from companies like Airbnb and Netflix, focusing on pipeline design, data availability definitions, and performance optimization. This lesson is ideal for data engineers and data scientists looking to enhance their skills in building efficient data pipelines with Airflow and Iceberg.