Master data engineering and AI like a big tech engineer

Advanced Spark on Databricks January 2025

Apache Spark Shuffle Joins Day 1 Lecture

Apache Spark Shuffle Joins Day 1 Lab

Apache Spark Memory Turning, Partitioning Day 2 Lecture

Apache Spark Memory Turning, Partitioning Day 2 Lab

Apache Spark Unit Testing Day 3 Lecture

Apache Spark Unit Testing Day 3 Lab

Apache Airflow DAG Assignment January 2025

Orchestration and Airflow Fundamentals Day 1 Lecture

Hard Orchestration Lessons Day 2 Lecture

Hard Orchestration Lessons Day 2 Lab

Cumulative DAGs in Production Day 3 Lecture

Cumulative DAGs in Production Day 3 Lab

Analytical Patterns and Analysis

Analytical Patterns (Day 2 Lab)

Advanced SQL and Applying Analytical patterns  (Day 1 Lab)

Analytical Patterns (Day 2 Lecture)

Advanced SQL and Applying Analytical patterns  (Day 1 Lecture)

Analytical Patterns and Advanced SQL January 2025

Applying Analytical Patterns Day 1 Lecture

Applying Analytical Patterns Day 1 Lab

Advanced SQL Patterns Day 2 Lecture

Advanced SQL Patterns Day 2 Lab

Analytical Patterns Recognizing Business Value Day 3 Lecture

Analytical Patterns Recognizing Business Value Day 3 Lab

RAG and LLMs Day1 Lecture

RAG and LLMs Day1 Lab

RAG and LLMs Day2 Lecture

RAG and LLMs Day2 Lab

LLMs Day 3 Part1

LLMs Day3 Part2

Capstone Showcase Jan 2025

Career Development - LinkedIn Optimization

Career Development - Resume Review

Career Development - Interview Help

Career Development - Data Modeling Interview  

Career Development - Strategic Networking

Analytical Pattern Query Submission

Change Data Capture (CDC) and Snowflake basics Lecture

Growth Accounting Models Lecture

Grouping sets and Window functions Lecture

Grouping sets and Window functions Lab

Growth Accounting Models Lab

Change Data Capture (CDC) and Snowflake basics Lab

How to use snowpark and Snowflake optimization Lecture

How to use snowpark and Snowflake optimization Lab

Capstone Showcase with Billy Switzer

Capstone Showcase with Jesse Charbneau

Data Visualization with tableau (Day 2 Lab)

Data Communication and Impact (Day 1 Lab)

Data Visualization with tableau (Day 2 Lecture)

Data Communication and Impact (Day 1 Lecture)

Airflow dbt Pipeline

Airflow Data Quality (Day 2 Lecture)

Airflow Data Quality (Day 1 Lecture)

Airflow Data Quality (Day 1 Lab)

Airflow Data Quality (Day 2 Lab)

Databricks Notebook Submission January 2025

Databricks Platform Overview Day 1 Lecture

Databricks Platform Overview Day 1 Lab

Introduction to Spark Day 2 Lecture

Introduction to Spark Day 2 Lab

Apache Spark Core Day 3 Lecture

Apache Spark Core Day 3 Lab

Dimensional Data Modeling with Iceberg

Dimensional Data Modeling - Complex Data Types Arrays and Structs with Iceberg (Day 1 Lecture) - Pre-recorded from V3

Dimensional Data Modeling - Complex Data Types Arrays and Structs with Iceberg (Day 1 Lab) - Pre-recorded from V3

Dimensional Data Modeling - Slowly-changing Dimensions and Idempotent Queries in Iceberg (Day 2 Lecture) - Pre-recorded from V3

Dimensional Data Modeling - Slowly-changing Dimensions and idempotent queries with Trino (Day 2 Lab) - Pre-recorded from V3

Conceptual Data Modeling (Day 3 Lecture)

Conceptual Data Modeling (Day 3 Lab)

Fact Data Modeling with Iceberg

Fact Data Modeling - Practical Guide to Formatting and Aggregating Data with Iceberg (Day 3 Lab) - Pre-recorded from V3

Fact Data Modeling - Core Concepts, Deduplication Techniques, and Retention Considerations with Iceberg (Day 1 Lab) - Pre-recorded from V3

Fact Data Modeling - Core Elements in Data Modeling with Iceberg (Day 2 Lecture) - Pre-recorded from V3

Fact Data Modeling - Minimizing Shuffle and Reducing Facts with Iceberg (Day 3 Lecture) - Pre-recorded from V3

Data Accessibility and Privacy (Day 4 Lecture)

Data Accessibility and Privacy (Day 4 Lab)

Fact Data Modeling - Core Concepts, Deduplication Techniques, and Retention Considerations with Iceberg (Day 1 Lecture) - Pre-recorded from V3

Fact Data Modeling - Compact Tables for Efficient Data Representation with Iceberg (Day 2 Lab) - Pre-recorded from V3

Jason Reid (cofounder of Tabular)

Shachar Meir

Brian Pulliam

Sundas Khalid

Prasad Rao

Joe Reis

Apache Iceberg and PyIceberg January 2025

Apache Iceberg Day 1 Lecture 

Apache Iceberg Day 1 Lab

Apache Iceberg Day 2 Lecture

Apache Iceberg Day 2 Lab

Apache Iceberg Day 3 Lecture

Apache Iceberg Day 3 Lab

The SQL Interview

The Data Modeling Interview

The Data Architecture Interview

The Behavioral Interview

The Data Structures and Algorithms Interview

Capstone Submission January 2025

Capstone Proposal Submission Jan 2025 Bootcamp

January 2025 Bootcamp Kickoff

LLMs - Vector database for RAG applications Day 2 Lecture

LLMs - Using LLMs to provide business value Day 1 Lecture

LLMs - Vector database for RAG applications Day 2 Lab

LLMs - Using LLMs to provide business value Day 1 Lab

Capstone Project

AE Bootcamp Capstone Project Proposal

Data Structures and Algorithms Interview

Product Sense Interview

Behavioral Interview

Data Modeling Interview

Q&A Week 1

Q&A Week 2

Q&A Week 3

Q&A Week 4

Spark Streaming W5 Homework January 2025

Advanced Spark Optimization Techniques Day 1 Lecture

Advanced Spark Optimization Techniques Day 1 Lab

Spark Structured Streaming Day 2 Lecture

Spark Structured Streaming Day 2 Lab

Deep Dive On Workflows Day 3 Lecture

Deep Dive On Workflows Day 3 Lab

dbt advanced jan 2025

Snowflake Lecture

Snowflake Lab

Advanced dbt Day 2 Lecture

Advanced dbt Day 2 Lab

Advanced dbt Day 3 Lecture

Advanced dbt Day 3 Lab

dbt basics Jan 2025

Snowflake Basics Day 1 Lecture

Snowflake Basics Day 1 Lab

dbt Basics Day 2 Lecture

dbt Basics Day 2 Lab

dbt Basics Day 3 Lecture

dbt Basics Day 3 Lab

Streaming Pipelines with Kafka and Iceberg

Kafka Fundamentals, consumer APIs with Confluent (Day 1 Lecture)

Processing data with Apache Flink  (Day 2 Lecture)

Processing data with Apache Flink  (Day 2 Lab)

Kafka Fundamentals, consumer APIs with Confluent (Day 1 Lab)

TA Office Hour 1

TA Office Hour 2

TA Office Hour 3

TA Office Hour 4

TA Office Hour 5

TA Office Hour 6

Spark Data Quality Unit Test Integration

Spark Data Quality Unit Test Integration (New)

Spark Fundamentals Spark Lab on REST API consumption (Day 1 Lab)

Advanced Spark (Day 2 Lecture)

Spark Fundamentals (Day 1 Lecture)

Spark Data Quality (Day 3 Lecture)

Spark Data Quality (Day 3 Lab)

Advanced Spark (Day 2 Lab)

dbt day 1 lecture

dbt day 1 lab

dbt day 2 lecture

dbt day 2 lab

Advanced Snowflake Queries

Advanced snowflake: Deploying the Capstone dag Lecture

Advanced snowflake: Deploying the Capstone dag Lab

Advanced Snowflake: Data Modeling and UDFs Lecture

Advanced Snowflake: Data Modeling and UDFs Lab

advanced-dbt-assignment

Advanced dbt: Understanding incremental models Lecture

Advanced dbt: Understanding incremental models Lab

Advanced pipelines: Blue-green and WAP with Airflow Lecture

Advanced pipelines: Blue-green and WAP with Airflow Lab

Complex Data Types Lecture

Complex Data Types Lab

Data modeling with Date lists Lecture

Data modeling with Date lists Lab

Graph Data Modeling Lecture

Graph Data Modeling Lab

Analytics Engineering Bootcamp Kickoff

Capstone Requirements

Understanding Capstone Requirements

Create a cumulative DAG

Write a comprehensive pipeline spec document

Write a comprehensive pipeline spec document Lab

Orchestration and Airflow Fundamentals Lecture

Orchestration and Airflow Fundamentals Lab

Slowly Changing Dimensions Lecture

Slowly Changing Dimensions Lab

Fact Data Modeling Lecture

Fact Data Modeling Lab

Office Hour 1

Office Hour 2

Office Hour 3

Office Hour 4

Tech talk with Andrew Madson

Tech talk with Gourav Khanijoe

Tech talk with Carly Taylor

Tech talk with Jess Ramos

Tech talk with Madison Schott

Tech talk with Vaishali Macwan

Tech talk with Tim Chan

dbt-basics-assignment

dbt basics:  How dbt works: sources, models, packages Lecture

This will cover all the important things from Spark, Databricks, Delta, Iceberg, and Delta Live Table needed to be amazing data engineers! 

Spring Data Engineering Boot Camp Starting May 26th

Spring Data Engineering Boot Camp Starting May 26thThis will cover all the important things from Spark, Databricks, Delta, Iceberg, and Delta Live Table needed to be amazing data engineers! Please review our academy policies before buying

Spring Data Engineering Boot Camp Starting May 26th

Spring Data Engineering Boot Camp Starting May 26th
This will cover all the important things from Spark, Databricks, Delta, Iceberg, and Delta Live Table needed to be amazing data engineers!
Please review our academy policies before buying