Master data engineering and AI like a big tech engineer

Advanced Spark on Databricks January 2025

Apache Spark Shuffle Joins Day 1 Lecture

Apache Spark Shuffle Joins Day 1 Lab

Apache Spark Memory Turning, Partitioning Day 2 Lecture

Apache Spark Memory Turning, Partitioning Day 2 Lab

Apache Spark Unit Testing Day 3 Lecture

Apache Spark Unit Testing Day 3 Lab

Apache Airflow DAG Assignment January 2025

Orchestration and Airflow Fundamentals Day 1 Lecture

Hard Orchestration Lessons Day 2 Lecture

Hard Orchestration Lessons Day 2 Lab

Cumulative DAGs in Production Day 3 Lecture

Cumulative DAGs in Production Day 3 Lab

Analytical Patterns and Analysis

Advanced SQL and Applying Analytical patterns  (Day 1 Lecture)

Analytical Patterns (Day 2 Lecture)

Advanced SQL and Applying Analytical patterns  (Day 1 Lab)

Analytical Patterns (Day 2 Lab)

Analytical Patterns and Advanced SQL January 2025

Applying Analytical Patterns Day 1 Lecture

Applying Analytical Patterns Day 1 Lab

Advanced SQL Patterns Day 2 Lecture

Advanced SQL Patterns Day 2 Lab

Analytical Patterns Recognizing Business Value Day 3 Lecture

Analytical Patterns Recognizing Business Value Day 3 Lab

RAG and LLMs Day1 Lecture

RAG and LLMs Day1 Lab

RAG and LLMs Day2 Lecture

RAG and LLMs Day2 Lab

LLMs Day 3 Part1

LLMs Day3 Part2

Capstone Showcase Jan 2025

Career Development - LinkedIn Optimization

Career Development - Resume Review

Career Development - Interview Help

Career Development - Data Modeling Interview  

Career Development - Strategic Networking

Analytical Pattern Query Submission

Change Data Capture (CDC) and Snowflake basics Lecture

Growth Accounting Models Lecture

Grouping sets and Window functions Lecture

Grouping sets and Window functions Lab

Growth Accounting Models Lab

Change Data Capture (CDC) and Snowflake basics Lab

How to use snowpark and Snowflake optimization Lecture

How to use snowpark and Snowflake optimization Lab

Capstone Showcase with Billy Switzer

Capstone Showcase with Jesse Charbneau

Data Communication and Impact (Day 1 Lab)

Data Visualization with tableau (Day 2 Lecture)

Data Communication and Impact (Day 1 Lecture)

Data Visualization with tableau (Day 2 Lab)

Airflow dbt Pipeline

Airflow Data Quality (Day 2 Lab)

Airflow Data Quality (Day 1 Lab)

Airflow Data Quality (Day 2 Lecture)

Airflow Data Quality (Day 1 Lecture)

Databricks Notebook Submission January 2025

Databricks Platform Overview Day 1 Lecture

Databricks Platform Overview Day 1 Lab

Introduction to Spark Day 2 Lecture

Introduction to Spark Day 2 Lab

Apache Spark Core Day 3 Lecture

Apache Spark Core Day 3 Lab

Dimensional Data Modeling with Iceberg

Dimensional Data Modeling - Complex Data Types Arrays and Structs with Iceberg (Day 1 Lecture) - Pre-recorded from V3

Dimensional Data Modeling - Complex Data Types Arrays and Structs with Iceberg (Day 1 Lab) - Pre-recorded from V3

Dimensional Data Modeling - Slowly-changing Dimensions and Idempotent Queries in Iceberg (Day 2 Lecture) - Pre-recorded from V3

Dimensional Data Modeling - Slowly-changing Dimensions and idempotent queries with Trino (Day 2 Lab) - Pre-recorded from V3

Conceptual Data Modeling (Day 3 Lecture)

Conceptual Data Modeling (Day 3 Lab)

Fact Data Modeling with Iceberg

Fact Data Modeling - Practical Guide to Formatting and Aggregating Data with Iceberg (Day 3 Lab) - Pre-recorded from V3

Fact Data Modeling - Compact Tables for Efficient Data Representation with Iceberg (Day 2 Lab) - Pre-recorded from V3

Fact Data Modeling - Core Concepts, Deduplication Techniques, and Retention Considerations with Iceberg (Day 1 Lecture) - Pre-recorded from V3

Fact Data Modeling - Minimizing Shuffle and Reducing Facts with Iceberg (Day 3 Lecture) - Pre-recorded from V3

Data Accessibility and Privacy (Day 4 Lecture)

Data Accessibility and Privacy (Day 4 Lab)

Fact Data Modeling - Core Concepts, Deduplication Techniques, and Retention Considerations with Iceberg (Day 1 Lab) - Pre-recorded from V3

Fact Data Modeling - Core Elements in Data Modeling with Iceberg (Day 2 Lecture) - Pre-recorded from V3

Jason Reid (cofounder of Tabular)

Shachar Meir

Brian Pulliam

Sundas Khalid

Prasad Rao

Joe Reis

Apache Iceberg and PyIceberg January 2025

Apache Iceberg Day 1 Lecture 

Apache Iceberg Day 1 Lab

Apache Iceberg Day 2 Lecture

Apache Iceberg Day 2 Lab

Apache Iceberg Day 3 Lecture

Apache Iceberg Day 3 Lab

The SQL Interview

The Data Modeling Interview

The Data Architecture Interview

The Behavioral Interview

The Data Structures and Algorithms Interview

Capstone Submission January 2025

Capstone Proposal Submission Jan 2025 Bootcamp

January 2025 Bootcamp Kickoff

LLMs - Vector database for RAG applications Day 2 Lecture

LLMs - Using LLMs to provide business value Day 1 Lecture

LLMs - Vector database for RAG applications Day 2 Lab

LLMs - Using LLMs to provide business value Day 1 Lab

Capstone Project

AE Bootcamp Capstone Project Proposal

Data Structures and Algorithms Interview

Product Sense Interview

Behavioral Interview

Data Modeling Interview

Q&A Week 1

Q&A Week 2

Q&A Week 3

Q&A Week 4

Spark Streaming W5 Homework January 2025

Advanced Spark Optimization Techniques Day 1 Lecture

Advanced Spark Optimization Techniques Day 1 Lab

Spark Structured Streaming Day 2 Lecture

Spark Structured Streaming Day 2 Lab

Deep Dive On Workflows Day 3 Lecture

Deep Dive On Workflows Day 3 Lab

dbt advanced jan 2025

Snowflake Lecture

Snowflake Lab

Advanced dbt Day 2 Lecture

Advanced dbt Day 2 Lab

Advanced dbt Day 3 Lecture

Advanced dbt Day 3 Lab

dbt basics Jan 2025

Snowflake Basics Day 1 Lecture

Snowflake Basics Day 1 Lab

dbt Basics Day 2 Lecture

dbt Basics Day 2 Lab

dbt Basics Day 3 Lecture

dbt Basics Day 3 Lab

Streaming Pipelines with Kafka and Iceberg

Processing data with Apache Flink  (Day 2 Lab)

Kafka Fundamentals, consumer APIs with Confluent (Day 1 Lab)

Kafka Fundamentals, consumer APIs with Confluent (Day 1 Lecture)

Processing data with Apache Flink  (Day 2 Lecture)

TA Office Hour 1

TA Office Hour 2

TA Office Hour 3

TA Office Hour 4

TA Office Hour 5

TA Office Hour 6

Spark Data Quality Unit Test Integration

Spark Data Quality Unit Test Integration (New)

Spark Fundamentals Spark Lab on REST API consumption (Day 1 Lab)

Spark Fundamentals (Day 1 Lecture)

Advanced Spark (Day 2 Lecture)

Spark Data Quality (Day 3 Lab)

Spark Data Quality (Day 3 Lecture)

Advanced Spark (Day 2 Lab)

dbt day 1 lecture

dbt day 1 lab

dbt day 2 lecture

dbt day 2 lab

dbt advanced Apr 2025

Advanced dbt Lecture Day 1

Advanced dbt Lab Day 1

Advanced dbt Lecture Day 2

Advanced dbt Lab Day 2

Build-a-Resume!

LinkedIn Like Pro!

Apache Iceberg and PyIceberg

Apache Iceberg Lecture Day 1 - Updated

Apache Iceberg Lab Day 1

Apache Iceberg Lecture Day 2

Apace Iceberg Lab Day 2

Apache Iceberg Lecture Day 3

Apache iceberg Lab Day 3

Apache Iceberg Lecture Day 1

Advanced Snowflake Queries

Conceptual Data Modeling Lecture Day 1

Conceptual Data Modeling Lab Day 1

How to use Snowpark and Snowflake Optimizations Lecture Day 2

How to use Snowpark and Snowflake Optimizations Lab Day 2

Advanced Snowflake Data Modeling and UDFs Lecture Day 3

Advanced Snowflake Data Modeling and UDFs Lab Day 3

Capstone Proposal AE Bootcamp April 2025

Capstone Project AE Bootcamp April 2025

Capstone Project Day 1 Lecture

Capstone Project Day 1 Lab

Capstone Project Day 2 Class

Capstone Project Day 3 Class

Q&A with Zach Week 1

Q&A with Zach Week 2

Q&A with Zach Week 3

Q&A with Zach Week 4

dbt basics Apr 2025

dbt basics Day 1 Lecture

dbt basics Day 1 Lab

dbt basics Day 2 Lecture

dbt basics Day 2 Lab

TA Office Hour 4 

Tech Talk 1 - Jess Ramos

Tech Talk 2 - Madison

Tech Talk 3 - Ben Rogojan

This gets you access to all self-paced content and the discord community of highly motivated learners!

All-Access DataExpert.io Subscription

DataExpert.io AcademyMaster data engineering and AI like a big tech engineerPlease review our academy policies before buying

All-Access DataExpert.io Subscription

DataExpert.io Academy
Master data engineering and AI like a big tech engineer
Please review our academy policies before buying