All-Access DataExpert.io Subscription
This gets you access to all self-paced content and the discord community of highly motivated learners!
AirflowAlgorithmsApache IcebergApache SparkAPIsAWSAzureCI/CDCloud PlatformsCommunicationDatabricksData ModelingData StructuresData VisualizationData WarehousingdbtDockerETL/ELTFlinkGCPGitHadoopKafkaLeadershipLLMsMLOpsMySQLPostgresProblem SolvingPythonPyTorchRedisSnowflakeSQLStatisticsSystem DesignTableauTrino
Status
Not Enrolled
What You'll Learn
- Build an awesome portfolio!
- Join the dedicated community
- Weekly Q&A with Zach Wilson
- Master the hottest AI tech: RAG, OpenClaw, Claude Code, and AI Agents
- Master the hottest data engineering tech: Spark, Airflow, Delta, Iceberg, and Databricks
- Master the hottest analytics engineering tech: Snowflake, dbt, BigQuery, and Iceberg
Prerequisites
- Proficiency in Python and SQL
Program Structure
1
Onboarding
Other Included Cohorts
AIExpert
Ship production AI: RAG, agents, MCP, and MLOps — taught by the engineers companies are paying top dollar to hire.
2
Kickoff & Setup
3
Week 1: Prompt Engineering & Basic RAG
17 Lessons•14h 39m
6 Assignments
Lessons
Prompt Engineering Day 1 Lecture
41m
Prompt Engineering Day1 Lab
61m
Prompt Engineering + Basic RAG Day 2 Lecture
45m
Prompt Engineering + Basic RAG Day 2 Lab
61m
Day 1 Lecture: Prompt Engineering Theory
55m
Day 1 Lab: Auto Prompt Optimization with dspy
59m
Day 2 Lecture: Optimizing Dev Workflows with Cursor and Windsurf
39m
Day 2 Lab: Vibe Coding Full Stack application in 45 minutes
77m
Supplemental Session on Auto-prompt Optimization
Day 1 Lecture: RAG Fundamentals and types of RAG
44m
Day 1 Lab: Vectorizing Inputs into Milvus
80m
Day 2 Lecture: RAG Tradeoffs
35m
Day 2 Lab: Integrating RAG into your full stack app
73m
Building functional AI agents using LangChain Day1 Lecture
50m
Building functional AI agents using LangChain Day1 Lab
51m
Building functional AI agents using LangChain Day2 Lecture
39m
Building functional AI agents using LangChain Day2 Lab
63m
4
Week 2: Advanced RAG, Reranking & Dev Workflow
12 Lessons•10h 22m
3 Assignments
Lessons
RAG optimisation + Reranking Day 1 Lecture
48m
RAG optimisation + Reranking Day 1 Lab
65m
RAG optimisation + Reranking Day 2 Lecture
33m
RAG optimisation + Reranking Day 2 Lab
78m
Optimize your dev workflow with Claude Code and Codex Day1 Lecture
48m
Optimize your dev workflow with Claude Code and Codex Day1 Lab
58m
Optimize your dev workflow with Claude Code and Codex Day2 Lecture
50m
Optimize your dev workflow with Claude Code and Codex Day2 Lab
62m
Day 1 Lecture: Graph RAG vs Vector RAG
38m
Day 1 Lab: Building Graph RAG in production
54m
Day 2 Lecture: Types of Agents (reflection, plan-and-execute, rewoo)
30m
Day 2 Lab: Enhancing RAG with Agentic AI
52m
5
Week 3: Agentic AI, MCP & Automation
8 Lessons•6h 53m
2 Assignments
Lessons
MCP and Agentic AI Day 1 Lecture
29m
MCP and Agentic AI Day 1 Lab
73m
MCP and Agentic AI Day 2 Lecture
42m
MCP and Agentic AI Day 2 Lab
55m
OpenClaw and Automating business processes Day1 Lecture
32m
OpenClaw and Automating business processes Day1 Lab
71m
OpenClaw and Automating business processes Day2 Lecture
30m
OpenClaw and Automating business processes Day2 Lab
78m
6
Week 4: MLOps, Guardrails & Business Value
13 Lessons•8h 27m
3 Assignments
Lessons
MLOPs and Guardrails Day 1 Lecture
35m
MLOPs and Guardrails Day 1 Lab
61m
MLOPs and Guardrails Day 2 Lecture
26m
MLOPs and Guardrails Day 2 Lab
76m
Day 1 Lecture: Trusting your workflows (evaluation metrics and guardrails)
27m
Day 1 Lab: Setting up CI/CD for an AI application
48m
Day 2 Lecture: Understanding LLM Reasoning traceability
34m
Day 2 Lab: Tracing LLM reasoning with LangChain + LangSmith
42m
Supplemental lab session on GuardrailsAI
OpenClaw Safeguards & Measuring business value for AI Agents Day1 Lecture
41m
OpenClaw Safeguards & Measuring business value for AI Agents Day1 Lab
49m
OpenClaw Safeguards & Measuring business value for AI Agents Day2 Lecture
47m
OpenClaw Safeguards & Measuring business value for AI Agents Day2 Lab
17m
7
Week 5: End-to-End AI Applications
12 Lessons•9h 52m
4 Assignments
Lessons
How to make AI that actualy provides Value Lecture
36m
How to make AI that actualy provides Value Lab
64m
Big Picture AI Applications Lecture
50m
Big Picture AI Applications Lab
49m
Evaluations and Reliability MLOps Lecture
36m
Evaluations and Reliability MLOps Lab
58m
How to deploy AI Agents using Claude managed Agents Lecture
43m
How to deploy AI Agents using Claude managed Agents Lab
55m
Day 1 Lecture: Leveraging MCP and tools to integrate effectively
31m
Day 1 Lab: Using MCP to build more powerful agents
65m
Day 2 Lecture: How to link your AI agent to value
37m
Day 2 Lab: Building an asynchronous vs synchronous agent
67m
8
Q&A with Zach
15 Lessons•8h 52m
Lessons
Q&A with Zach Week 1 (2025-07-10)
Q&A with Zach Week 2 (2025-07-18)
Q&A with Zach Week 3 (2025-07-25)
Q&A with Zach Week 4 (2025-08-01)
Q&A with Zach Week 5 (2025-08-08)
Q&A with Zach Week 1 (2025-10-09)
59m
Q&A with Zach Week 2 (2025-10-09)
53m
Q&A with Zach Week 3 (2025-10-09)
53m
Q&A with Zach Week 4 (2025-10-09)
55m
Q&A with Zach Week 5 (2025-10-09)
49m
Q&A with Zach 1
54m
Q&A with Zach 2
50m
Q&A with Zach 3
44m
Q&A with Zach 4
55m
Q&A with Zach 5
56m
9
Expert Guest Sessions
17 Lessons•13h 18m
Lessons
Li Yin - Founder of Adal (2025-07-10)
57m
Conor Brennan - CEO & Founder at Hypersell
61m
Vikram Chennai - Founder at Ardent AI
56m
Ryan Brandt - CEO at VundaAI
Chip Huyen - Author of AI Engineering
Future of Data Engineering with Archita
39m
Tech Talk with Xinran Waibel
60m
Data Engineering Interviews with Swetha at OpenAI
Tech Talk - 2
46m
Ryan Brandt - CEO at VundaAI (2.0)
59m
Carly Taylor - Field CTO at Databricks
59m
Li Yin - Founder at Adal (2.0)
57m
Li Yin - Founder at Adal (2026-03-13)
57m
Brian Pulliam - Career Development Coach
72m
Sai Bysani - Lead Data Engineer
60m
Vaishali Macwan - Senior Data Scientist
49m
Shwetha - Data Engineer at OpenAI
61m
10
Bonus - LLMs
6 Lessons•4h 49m
DataExpert
Spark, Databricks, Snowflake, Kafka, Flink — the most comprehensive data engineering curriculum on the internet.
2
Kickoff
5 Lessons•1h 48m
3
Week 1: Databricks Basics
6 Lessons•2h 38m
1 Assignment
4
Week 2: Databricks & Advanced Spark
11 Lessons•7h 5m
3 Assignments
Lessons
Apache Spark Shuffle Joins Day 1 Lecture
40m
Apache Spark Memory Turning, Partitioning Day 2 Lecture
38m
Apache Spark Memory Turning, Partitioning Day 2 Lab
31m
Apache Spark Unit Testing Day 3 Lecture
Apache Spark Unit Testing Day 3 Lab
35m
Setting Up CI/CD and Unit Testing in Databricks for Reliable Data Pipelines
46m
Databricks and Advanced Spark Day1 Lecture
49m
Databricks and Advanced Spark Day1 Lab
46m
Databricks and Advanced Spark Day2 Lecture
52m
Databricks and Advanced Spark Day2 Lab
49m
Apache Spark Shuffle Joins Day 1 Lab
34m
5
Week 3: Data Lakes with Delta Table
10 Lessons•5h 33m
2 Assignments
Lessons
6
Week 4: Structured Streaming with Spark & Kafka
15 Lessons•6h 35m
3 Assignments
Lessons
Apache Spark programming with Databricks Day 1 Lecture
Apache Spark programming with Databricks Day 1 Lab
Apache Spark programming with Databricks Day 2 Lecture
Apache Spark programming with Databricks Day 2 Lab
46m
Structured Streaming Kafka to Delta Live Table Day1 Lecture
59m
Structured Streaming Kafka to Delta Live Table Day1 Lab
48m
Structured Streaming Kafka to Delta Live Table Day2 Lecture
62m
Structured Streaming Kafka to Delta Live Table Day2 Lab
40m
Exploring UDFs and SQL Benchmarks in Spark Streaming
6m
Advanced Spark Optimization Techniques Day 1 Lecture
19m
Advanced Spark Optimization Techniques Day 1 Lab
25m
Spark Structured Streaming Day 2 Lecture
19m
Spark Structured Streaming Day 2 Lab
30m
Deep Dive On Workflows Day 3 Lecture
10m
Deep Dive On Workflows Day 3 Lab
26m
7
Week 5: Managing Unstructured Data
8 Lessons•4h 36m
1 Assignment
Lessons
Managing Unstructured Data - Day 1 Lecture
Managing Unstructured Data - Day 1 Lab
Managing Unstructured Data - Day 2 Lecture
Managing Unstructured Data - Day 2 Lab
48m
Managing Unstructured Data Day1 Lecture
58m
Managing Unstructured Data Day1 Lab
47m
Managing Unstructured Data Day2 Lecture
65m
Managing Unstructured Data Day2 Lab
56m
Assignments
8
Week 6: Building AI Agents with Databricks
5 Lessons•3h 50m
9
Capstone Project
2 Lessons•2h 1m
6 Assignments
10
Q&A with Zach
15 Lessons•10h 42m
Lessons
Q&A Week 1
46m
Q&A Week 2
41m
Q&A Week 3
24m
Q&A Week 4
42m
Q&A with Zach Week 1
51m
Q&A with Zach Week 2
Q&A with Zach Week 3
Q&A with Zach Week 4
59m
Q&A with Zach Week 5
53m
Navigating Data Engineering -Tips, Tools, and Career Insights
56m
Q&A with Zach Week1
56m
Q&A with Zach Week2
56m
Q&A with Zach Week3
42m
Q&A with Zach Week4
55m
Q&A with Zach Week5
57m
11
Expert Guest Sessions
15 Lessons•11h 28m
Lessons
Alex Merced - Head of DevRel at Dremio
57m
Joe Reis - Author of Fundamentals of Data Engineering
Shubham Srivastava - Senior Data Engineer at Amazon (2025-06-24)
Vaishali Macwan - Senior Data Scientist at Amazon
Shubham Srivastava - Senior Data Engineer at Amazon (02-01-2026)
59m
Jason Reid - Co-founder at Tabular
59m
Brian Pulliam - Career Development Coach
65m
Xinran Waibel - Data Engineer at OpenAI
60m
Jason Reid - Co-Founder at Tabular (2.0)
57m
Shachar Meir - Data Advisor and Public Speaker
53m
Brian Pulliam - Career Developement Coach (2.0)
61m
Sundas Khalid - Principal Analytics Lead at Google
58m
Yuzheng Sun - Staff Data Scientist at Statsig
59m
Prasad Rao - Principal Solutions Architect
54m
Joe Reis - Author of Fundamentals of Data Engineering (2.0)
41m
AnalyticsExpert
Master dbt, Snowflake, Iceberg, and Airflow — and become the analytics engineer every data team fights to hire.
2
Kickoff
5 Lessons•3h 8m
2 Assignments
3
Pre-Read - Data Modeling
10 Lessons•6h 46m
Lessons
Complex Data Types Lecture
48m
Complex Data Types Lab
30m
Slowly Changing Dimensions Lecture
46m
Slowly Changing Dimensions Lab
37m
Graph Data Modeling Lecture
38m
Graph Data Modeling Lab
42m
Fact Data Modeling Lecture
46m
Fact Data Modeling Lab
37m
Data modeling with Date lists Lecture
38m
Data modeling with Date lists Lab
39m
4
Week 1: dbt Basics
7 Lessons•5h 42m
3 Assignments
Lessons
dbt basics: How dbt works: sources, models, packages Lab
36m
dbt basics: creating a full dbt project lecture
28m
dbt basics: creating a full dbt project lab
49m
Build your first pipeline with dbt
59m
Build your first pipeline with dbt Lab
55m
Creating a full dbt Project Lecture
55m
Creating a full dbt Project Lab
58m
5
Week 2: Advanced dbt
8 Lessons•6h 57m
3 Assignments
Lessons
Advanced dbt: Understanding incremental models Lecture
44m
Advanced dbt: Understanding incremental models Lab
34m
Advanced pipelines: Blue-green and WAP with Airflow Lecture
25m
Advanced pipelines: Blue-green and WAP with Airflow Lab
56m
Advanced dbt: Jinja, Macros and variables Lecture
68m
Advanced dbt: Jinja, Macros and variables Lab
60m
Advanced dbt: Production Pipelines and dbt with Airflow Lecture
65m
Advanced dbt: Production Pipelines and dbt with Airflow Lab
62m
6
Week 3: Data Modeling on Snowflake
6 Lessons•5h 11m
1 Assignment
Lessons
Conceptual Data Modeling Lecture Day 1
57m
Conceptual Data Modeling Lab Day 1
51m
How to use Snowpark and Snowflake Optimizations Lecture Day 2
52m
How to use Snowpark and Snowflake Optimizations Lab Day 2
45m
Advanced Snowflake Data Modeling and UDFs Lecture Day 3
47m
Advanced Snowflake Data Modeling and UDFs Lab Day 3
58m
Assignments
7
Week 4: Advanced Snowflake
8 Lessons•6h 4m
2 Assignments
Lessons
Advanced snowflake: Deploying the Capstone dag Lecture
18m
Advanced snowflake: Deploying the Capstone dag Lab
47m
Advanced Snowflake: Data Modeling and UDFs Lecture
41m
Advanced Snowflake: Data Modeling and UDFs Lab
50m
Master Advanced Snowflake Data Modeling with the VARIANT data type
48m
How to connect Iceberg and Snowflake with Catalogs
55m
Advance Snowflake Day 2 Lecture
51m
Advance Snowflake Day 2 Lab
50m
8
Week 5: Data Modeling on Iceberg
12 Lessons•8h 58m
1 Assignment
Lessons
Apache Iceberg: Big Data History Lecture
40m
Apache Iceberg: Partitioning, time travel for RCA and metadata Lab
50m
Apache Iceberg: Data Lake Architectures Lecture
58m
Apace Iceberg: Data Compression, Run length encoding Lab
32m
Apache Iceberg: Data Contracts Lecture
47m
Apache iceberg: WAP patterns and Querying branched Data Lab
55m
Apache Iceberg Lecture Day1
40m
Apache Iceberg Lab Day1
50m
Apache Iceberg Lecture Day2
46m
Apache Iceberg Lab Day2
32m
Apache Iceberg Lecture Day3
47m
Apache Iceberg Lab Day3
38m
Assignments
9
Week 6: Airflow & Pipeline Specs with Trino
15 Lessons•10h 31m
2 Assignments
Lessons
How to build job orchestration that matters
53m
Injecting quality into your Airflow DAG Lab
53m
How to load data into Iceberg with Airflow
59m
Airflow Day2 Lab
58m
Backfilling with Airflow
12m
Write a comprehensive pipeline spec document
47m
Orchestration and Airflow Fundamentals Day 1 Lecture
41m
Write a comprehensive pipeline spec document Lab
35m
Orchestration and Airflow Fundamentals Lecture
43m
Orchestration and Airflow Fundamentals Lab
42m
Orchestration and Airflow Fundamentals Day 1 Lab
31m
Hard Orchestration Lessons Day 2 Lecture
45m
Hard Orchestration Lessons Day 2 Lab
31m
Cumulative DAGs in Production Day 3 Lecture
40m
Cumulative DAGs in Production Day 3 Lab
34m
10
Week 7: Analytical Patterns & CDC
14 Lessons•9h 2m
2 Assignments
Lessons
How to do Growth Accounting like Meta
46m
Growth Accounting Lab
61m
Mastering Change Data Capture (CDC)
49m
Change Data Capture Lab
13m
Snowflake and Glue Catalog Integration Lab
7m
Understanding Read Streams and SCD Implementation Lab
33m
Change Data Capture (CDC) and Snowflake basics Lecture
58m
Change Data Capture (CDC) and Snowflake basics Lab
40m
How to use snowpark and Snowflake optimization Lecture
48m
How to use snowpark and Snowflake optimization Lab
25m
Growth Accounting Models Lecture
51m
Growth Accounting Models Lab
38m
Grouping sets and Window functions Lecture
30m
Grouping sets and Window functions Lab
38m
Assignments
11
Week 8: Capstone Project
4 Lessons•4h 54m
2 Assignments
12
Q&A with Zach
9 Lessons•7h 59m
13
Expert Guest Sessions
20 Lessons•17h 52m
Lessons
Jess Ramos - Data Analyst
52m
Madison Schott - Analytics Engineer
58m
Ben Rogojan - Fractional Head of Data
55m
John Kutay - Director of Engineering at Rippling
57m
Carly Taylor - Field CTO at Databricks
56m
Vin Vashishtha - Author of From Data to Profit
41m
Parth Parekh - Director of Data Engineering at Meta
58m
Prasad Rao - Principal Solutions Architect
60m
Andrew Madson - Head of DevRel at Fivetran
52m
Gourav Khanijoe - Engineering Lead at HubSpot
52m
Carly Taylor - Field CTO at Databricks (2.0)
58m
Jess Ramos - Data Analyst (2.0)
56m
Madison Schott - Analytics Engineer (2.0)
33m
Vaishali Macwan - Senior Data Scientist
45m
Tim Chan - Data at OpenAI
41m
Joe Reis - Author of Fundamentals of Data Engineering
63m
Madison Schott - Analytics Engineer (3.0)
55m
Carly Taylor - Field CTO at Databricks (3.0)
58m
Raaid A. - AI, Data, & Product Strategy Leader
55m
Parth Parekh - Director of Data Engineering at Meta (2.0)
58m
Boot Camp: Community Edition
Join the free community boot camp that covers everything you need to know to go from junior data engineer to senior data engineer!
2
Bootcamp Orientation
3
Dimensional Data Modeling
6 Lessons•4h 11m
1 Assignment
Lessons
Dimensional Data Modeling Complex Data Type and Cumulation Day 1 Lecture
43m
Dimensional Data Modeling Complex Data Type and Cumulation Day 1 Lab
41m
Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lecture
40m
Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lab
45m
Dimensional Data Modeling: Graph Data Modeling Day 3 Lecture
34m
Dimensional Data Modeling: Graph Data Modeling Day 3 Lab
46m
4
Fact Data Modeling
6 Lessons•3h 52m
1 Assignment
Lessons
Fact Data Modeling: Core Concepts, Deduplication Day 1 Lecture
52m
Fact Data Modeling: Practical Insights into Data Modeling Day 1 Lab
40m
Fact Data Modeling: Core Elements in Data Modeling Day 2 Lecture
31m
Fact Data Modeling: Compact Tables for Efficient Data Representation Day 2 Lab
45m
Fact Data Modeling: Minimizing Shuffle and Reducing Facts Day 3 Lecture
32m
Fact Data Modeling: Practical Guide to Formatting and Aggregating Data Day 3 Lab
30m
Assignments
5
Apache Spark Fundamentals
6 Lessons•3h 34m
1 Assignment
Lessons
Apache Spark: Architecture, Optimization, and Best Practices Day 1 Lecture
48m
Apache Spark: Hands-On for Broadcast and Hash Joins Day 1 Lab
26m
Apache Spark: Managing Spark Jobs and Notebooks Day 2 Lecture
34m
Apache Spark: User-Defined Functions and Broadcast Join Day 2 Lab
36m
Unit Testing Spark Jobs: Importance, Challenges, and Leadership Perspectives Lecture
41m
Unit Testing Spark Jobs: Mastering Spark and PySpark Testing Lab
27m
Assignments
6
Applying Analytical Patterns
4 Lessons•2h 45m
1 Assignment
Lessons
Applying Analytical Patterns: Exploring SQL, Scaling Projects and Aggregation Analysis Day 1 Lecture
52m
Applying Analytical Patterns: Mastering Growth Accounting and Retention Analysis Day 1 Lab
34m
Applying Analytical Patterns: Recursive CTEs and Window Functions Day 2 Lecture
44m
Applying Analytical Patterns: Aggregations and Cardinality Reduction Day 2 Lab
33m
Assignments
7
Real-time pipelines with Flink and Kafka
5 Lessons•2h 48m
1 Assignment
Lessons
Flink Lab Setup
7m
Streaming Pipelines: Mastering Streaming and Real-time Pipelines Day 1 Lecture
50m
Streaming Pipelines: Setting up Streaming Pipelines Day 1 Lab
40m
Streaming Pipelines: Exploring Data Collection and Processing Day 2 Lecture
31m
Streaming Pipelines: Kafka, Postgres, Spark Integrations and Parallelism Day 2 Lab
39m
Assignments
8
Data Visualization and Impact
4 Lessons•1h 49m
1 Assignment
Lessons
Data Visualization and Impact: Mastering Data Engineering Day 1 Lecture
39m
Data Visualization and Impact: Hands-On with the CSV files Day 1 Lab
8m
Data Visualization and Impact: Insights and Best Practices Day 2 Lecture
23m
Data Visualization and Impact: Exploring Data Visualization and Aggregation Techniques Day 2 Lab
37m
Assignments
9
Data Pipeline Maintenance
2 Lessons•2h 24m
1 Assignment
10
KPIs and Experimentation
3 Lessons•2h 37m
1 Assignment
Lessons
Assignments
11
Data Quality Patterns
3 Lessons•1h 46m
2
Fullstack Bootcamp Orientation
3
Web Dev Fundamentals
7 Lessons•5h 4m
4
Intermediate Frontend Development
2 Lessons•3h 44m
5
Fundamentals of Backend Development
2 Lessons•4h 2m
6
Intermediate Backend Development
2 Lessons•4h 2m
7
Advanced Backend Development
5 Lessons•4h 41m
8
Advanced Frontend Development
5 Lessons•4h 48m
LinkedInExpert
Find your niche, build your brand, and become a LinkedIn creator who makes money!
2
Career Development
17 Lessons•9h 59m
Lessons
LinkedIn like a pro
37m
Test Lesson
LinkedIn Like Pro!
48m
Career Dev Session 4 (2025-08-07)
43m
Career Development - LinkedIn Optimization
66m
Career Dev Session 1 - Win with soft skills!
35m
Build a Resume
35m
LinkedIn like a Pro
36m
Career Dev Session 2 - LinkedIn like a Pro!
46m
Career Dev Session 3
Win with Soft Skills
45m
Career Dev Session 4 (2025-10-09)
Career Dev Session 5
Career Development - Resume Review
53m
Career Development - Interview Help
56m
Career Development - Data Modeling Interview
49m
Career Development - Strategic Networking
43m
3
Making Content on LinkedIn
6 Lessons•6h 6m
Lessons
How to write non-boring content by Carly Taylor
43m
Monetizing Part 1: Brands & Coaching by Stephanie Nuesi
63m
Your story matters and how to tell it by Stephanie Nuesi
76m
Monetizing Part 3: Products & Funnels by Zach Wilson
72m
Build community, not content by Zach Wilson
47m
Monetizing Part 2: Sponsorship by Carly Taylor
63m