# TA Office Hour 4 (2025-01-21)

> Office hours provide a platform for students to ask questions and clarify concepts related to their assignments. This session focused on building a data pipeline using Apache Airflow, incorporating the right audit published pattern. Key topics included creating a daily partitioning table, loading d…

- Web page: https://www.dataexpert.io/lesson/ta-office-hour-4-jan2025-p736-l767
- Access: Requires enrollment
- Length: 53 min video
- Skills: Data Modeling, ETL/ELT, Airflow, Apache Iceberg, Trino
- Academy: DataExpert.io Academy

## About this lesson

Office hours provide a platform for students to ask questions and clarify concepts related to their assignments. This session focused on building a data pipeline using Apache Airflow, incorporating the right audit published pattern. Key topics included creating a daily partitioning table, loading data from the Polygon API into staging tables, and performing data quality checks before transitioning to production. Students also discussed various tools like PyIceberg and Trino for different parts of the assignment.