Sign in to view content

Sign in to view this lesson and continue learning.

Description

Understanding data lake architectures is crucial for data engineers aiming to transition from building simple pipelines to designing comprehensive data solutions. This session covers key concepts such as agnostic storage, Lambda versus Kappa architecture, and Iceberg's file compaction and row-level updates. Participants will also explore the implications of hot, warm, and cold storage, along with strategies for optimizing data retrieval and managing small files, making it valuable for engineers looking to enhance their data modeling skills.