Sign in to view content

Sign in to view this lesson and continue learning.

Airflow Day2 Lab

Week 6: Airflow & Pipeline Specs with Trino
59 mins
SQLPythonETL/ELTAirflow

Description

The Airflow Day 2 Lab focuses on enhancing data quality in ETL processes using the Pie Iceberg API and Trino. Participants will learn how to identify and resolve common data quality issues, such as duplicates and incorrect currency representations, while working with stock ticker data. This hands-on session is ideal for data engineers looking to improve their skills in data validation and pipeline orchestration within Airflow.