DataExpert.io Content Pass
Access to all the DataExpert.io content, bring your own cloud
Taught by Zach Wilson
Founder at DataExpert.io
Enroll now
Self-paced · Closed
Payment plan
$67
/moBilled $800/yr
3-day free trial
Content288 hrs
EnrollmentOpen anytime
FormatSelf-paced
This program is not accepting enrollments right now!
What's included
Learn Databricks, Snowflake, AI, and more!
Access to 250+ hours of content
What you'll learn
✓
Learn Databricks, Snowflake, AI, and more!
✓
Access to 250+ hours of content
Learn directly from the experts
Course syllabus
398 lessons • 289+ hours of content • 62 assignments
1
Lesson 1
Also included
IncludedFullStackExpert34 lessons
IncludedFullStackExpert
34 lessonsFullstack Bootcamp Orientation
1Full Stack Bootcamp Orientation
Boot camp Kickoff
1Lesson 1
Web Dev Fundamentals
1Introduction to IDEs
2Structure of a Program
3Intro to HTML & CSS
4HTML & CSS LAB
5Intro to Javascript
6Advanced JavaScript Concepts
7Javascript lab part 2
Intermediate Frontend Development
1Introduction to ReactJS
2Advanced ReactJS and Tailwind
Fundamentals of Backend Development
1Introduction to databases and relational SQL
2Data Modeling and intro to backend
Intermediate Backend Development
1Intro to NodeJS & Express and event driven programming
2Connecting the database to the service
Advanced Backend Development
1Authentication and Advanced techniques
2Lab 1
3Event driven microservices
4Monitoring, scaling, experimenting
5week-5-Lab 2
Advanced Frontend Development
1Nextjs Introduction
2Week 6 lab part 1
3Advanced NextJS Features
4Week 6 lab part 2
5Docker Vercel and Optimization
Office Hours
1Unit Testing
2Integration Testing
3E2E Testing
Q&A with Dan
1Intro to CI/CD
2Intro to System Design
3Introduction to Containers
4Intro to Infrastructure as Code
Soft Skills
1Joining a new team
2Communicating Ideas and Getting Alignment
IncludedBoot Camp: Community EditionJoin the free community boot camp that covers everything you need to know to go from junior data engineer to senior data engineer! 41 lessons
IncludedBoot Camp: Community Edition
Join the free community boot camp that covers everything you need to know to go from junior data engineer to senior data engineer! 41 lessonsBootcamp Orientation
1Bootcamp Kickoff
2Boot Camp Database Setup
Dimensional Data Modeling
1Dimensional Data Modeling Complex Data Type and Cumulation Day 1 Lecture
2Dimensional Data Modeling Complex Data Type and Cumulation Day 1 Lab
3Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lecture
4Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lab
5Dimensional Data Modeling: Graph Data Modeling Day 3 Lecture
6Dimensional Data Modeling: Graph Data Modeling Day 3 Lab
Fact Data Modeling
1Fact Data Modeling: Core Concepts, Deduplication Day 1 Lecture
2Fact Data Modeling: Practical Insights into Data Modeling Day 1 Lab
3Fact Data Modeling: Core Elements in Data Modeling Day 2 Lecture
4Fact Data Modeling: Compact Tables for Efficient Data Representation Day 2 Lab
5Fact Data Modeling: Minimizing Shuffle and Reducing Facts Day 3 Lecture
6Fact Data Modeling: Practical Guide to Formatting and Aggregating Data Day 3 Lab
Apache Spark Fundamentals
1Apache Spark: Architecture, Optimization, and Best Practices Day 1 Lecture
2Apache Spark: Hands-On for Broadcast and Hash Joins Day 1 Lab
3Apache Spark: Managing Spark Jobs and Notebooks Day 2 Lecture
4Apache Spark: User-Defined Functions and Broadcast Join Day 2 Lab
5Unit Testing Spark Jobs: Importance, Challenges, and Leadership Perspectives Lecture
6Unit Testing Spark Jobs: Mastering Spark and PySpark Testing Lab
Applying Analytical Patterns
1Applying Analytical Patterns: Exploring SQL, Scaling Projects and Aggregation Analysis Day 1 Lecture
2Applying Analytical Patterns: Mastering Growth Accounting and Retention Analysis Day 1 Lab
3Applying Analytical Patterns: Recursive CTEs and Window Functions Day 2 Lecture
4Applying Analytical Patterns: Aggregations and Cardinality Reduction Day 2 Lab
Real-time pipelines with Flink and Kafka
1Flink Lab Setup
2Streaming Pipelines: Mastering Streaming and Real-time Pipelines Day 1 Lecture
3Streaming Pipelines: Setting up Streaming Pipelines Day 1 Lab
4Streaming Pipelines: Exploring Data Collection and Processing Day 2 Lecture
5Streaming Pipelines: Kafka, Postgres, Spark Integrations and Parallelism Day 2 Lab
Data Visualization and Impact
1Data Visualization and Impact: Mastering Data Engineering Day 1 Lecture
2Data Visualization and Impact: Hands-On with the CSV files Day 1 Lab
3Data Visualization and Impact: Insights and Best Practices Day 2 Lecture
4Data Visualization and Impact: Exploring Data Visualization and Aggregation Techniques Day 2 Lab
Data Pipeline Maintenance
1Data Pipeline Maintenance: Navigating the Complexities of Data Engineering Day 1 Lecture
2Data Pipeline Maintenance: Strategies for Maintenance and Dock Building Day 2 Lecture
KPIs and Experimentation
1KPIs and Experimentation: Decoding Business Success: Metrics, Growth Strategies and Collaborative Approaches Day 1 Lecture
2KPIs and Experimentation: Setting up and Analysing Experiments Day 1 Lab
3KPIs and Experimentation: Leading and Lagging Metrics Day 2 Lecture
Data Quality Patterns
1Data Quality Patterns: MIDAS Process from Airbnb Day 1 Lecture
2Data Quality Patterns: Spec-Building Document Day 1 Lab
3Data Quality Patterns: WAP Patterns Day 2 Lecture
IncludedAIExpertShip production AI: RAG, agents, MCP, and MLOps — taught by the engineers companies are paying top dollar to hire.105 lessons
IncludedAIExpert
Ship production AI: RAG, agents, MCP, and MLOps — taught by the engineers companies are paying top dollar to hire.105 lessonsKickoff & Setup
1AI Application Setup
2AI Engineering Bootcamp Kick off
3Claude Code Onboarding
4Langchain Starter Repo Setup
Week 1: Prompt Engineering & Basic RAG
1Prompt Engineering Day 1 Lecture
2Prompt Engineering Day1 Lab
3Prompt Engineering + Basic RAG Day 2 Lecture
4Prompt Engineering + Basic RAG Day 2 Lab
5Day 1 Lecture: Prompt Engineering Theory
6Day 1 Lab: Auto Prompt Optimization with dspy
7Day 2 Lecture: Optimizing Dev Workflows with Cursor and Windsurf
8Day 2 Lab: Vibe Coding Full Stack application in 45 minutes
9Supplemental Session on Auto-prompt Optimization
10Day 1 Lecture: RAG Fundamentals and types of RAG
11Day 1 Lab: Vectorizing Inputs into Milvus
12Day 2 Lecture: RAG Tradeoffs
13Day 2 Lab: Integrating RAG into your full stack app
14Building functional AI agents using LangChain Day1 Lecture
15Building functional AI agents using LangChain Day1 Lab
16Building functional AI agents using LangChain Day2 Lecture
17Building functional AI agents using LangChain Day2 Lab
Week 2: Advanced RAG, Reranking & Dev Workflow
1RAG optimisation + Reranking Day 1 Lecture
2RAG optimisation + Reranking Day 1 Lab
3RAG optimisation + Reranking Day 2 Lecture
4RAG optimisation + Reranking Day 2 Lab
5Optimize your dev workflow with Claude Code and Codex Day1 Lecture
6Optimize your dev workflow with Claude Code and Codex Day1 Lab
7Optimize your dev workflow with Claude Code and Codex Day2 Lecture
8Optimize your dev workflow with Claude Code and Codex Day2 Lab
9Day 1 Lecture: Graph RAG vs Vector RAG
10Day 1 Lab: Building Graph RAG in production
11Day 2 Lecture: Types of Agents (reflection, plan-and-execute, rewoo)
12Day 2 Lab: Enhancing RAG with Agentic AI
Week 3: Agentic AI, MCP & Automation
1MCP and Agentic AI Day 1 Lecture
2MCP and Agentic AI Day 1 Lab
3MCP and Agentic AI Day 2 Lecture
4MCP and Agentic AI Day 2 Lab
5OpenClaw and Automating business processes Day1 Lecture
6OpenClaw and Automating business processes Day1 Lab
7OpenClaw and Automating business processes Day2 Lecture
8OpenClaw and Automating business processes Day2 Lab
Week 4: MLOps, Guardrails & Business Value
1MLOPs and Guardrails Day 1 Lecture
2MLOPs and Guardrails Day 1 Lab
3MLOPs and Guardrails Day 2 Lecture
4MLOPs and Guardrails Day 2 Lab
5Day 1 Lecture: Trusting your workflows (evaluation metrics and guardrails)
6Day 1 Lab: Setting up CI/CD for an AI application
7Day 2 Lecture: Understanding LLM Reasoning traceability
8Day 2 Lab: Tracing LLM reasoning with LangChain + LangSmith
9Supplemental lab session on GuardrailsAI
10OpenClaw Safeguards & Measuring business value for AI Agents Day1 Lecture
11OpenClaw Safeguards & Measuring business value for AI Agents Day1 Lab
12OpenClaw Safeguards & Measuring business value for AI Agents Day2 Lecture
13OpenClaw Safeguards & Measuring business value for AI Agents Day2 Lab
Week 5: End-to-End AI Applications
1How to make AI that actualy provides Value Lecture
2How to make AI that actualy provides Value Lab
3Big Picture AI Applications Lecture
4Big Picture AI Applications Lab
5Evaluations and Reliability MLOps Lecture
6Evaluations and Reliability MLOps Lab
7How to deploy AI Agents using Claude managed Agents Lecture
8How to deploy AI Agents using Claude managed Agents Lab
9Day 1 Lecture: Leveraging MCP and tools to integrate effectively
10Day 1 Lab: Using MCP to build more powerful agents
11Day 2 Lecture: How to link your AI agent to value
12Day 2 Lab: Building an asynchronous vs synchronous agent
Capstone
1Lesson 1
Q&A with Zach
1Q&A with Zach Week 1 (2025-07-10)
2Q&A with Zach Week 2 (2025-07-18)
3Q&A with Zach Week 3 (2025-07-25)
4Q&A with Zach Week 4 (2025-08-01)
5Q&A with Zach Week 5 (2025-08-08)
6Q&A with Zach Week 1 (2025-10-09)
7Q&A with Zach Week 2 (2025-10-09)
8Q&A with Zach Week 3 (2025-10-09)
9Q&A with Zach Week 4 (2025-10-09)
10Q&A with Zach Week 5 (2025-10-09)
11Q&A with Zach 1
12Q&A with Zach 2
13Q&A with Zach 3
14Q&A with Zach 4
15Q&A with Zach 5
Expert Guest Sessions
1Li Yin - Founder of Adal (2025-07-10)
2Conor Brennan - CEO & Founder at Hypersell
3Vikram Chennai - Founder at Ardent AI
4Ryan Brandt - CEO at VundaAI
5Chip Huyen - Author of AI Engineering
6Future of Data Engineering with Archita
7Tech Talk with Xinran Waibel
8Data Engineering Interviews with Swetha at OpenAI
9Tech Talk - 2
10Ryan Brandt - CEO at VundaAI (2.0)
11Carly Taylor - Field CTO at Databricks
12Li Yin - Founder at Adal (2.0)
13Li Yin - Founder at Adal (2026-03-13)
14Brian Pulliam - Career Development Coach
15Sai Bysani - Lead Data Engineer
16Vaishali Macwan - Senior Data Scientist
17Shwetha - Data Engineer at OpenAI
Bonus - LLMs
1RAG and LLMs Day1 Lecture
2RAG and LLMs Day1 Lab
3RAG and LLMs Day2 Lecture
4RAG and LLMs Day2 Lab
5LLMs Day 3 Part1
6LLMs Day3 Part2
IncludedAnalyticsExpertMaster dbt, Snowflake, Iceberg, and Airflow — and become the analytics engineer every data team fights to hire.121 lessons
IncludedAnalyticsExpert
Master dbt, Snowflake, Iceberg, and Airflow — and become the analytics engineer every data team fights to hire.121 lessonsKickoff
1Understanding Capstone Requirements
2Analytics Engineering Bootcamp Kickoff
3Capstone Requirements
4Data Expert.io Architecture
5Onboarding Guide for the Data and AI Engineering Bootcamp
Pre-Read - Data Modeling
1Complex Data Types Lecture
2Complex Data Types Lab
3Slowly Changing Dimensions Lecture
4Slowly Changing Dimensions Lab
5Graph Data Modeling Lecture
6Graph Data Modeling Lab
7Fact Data Modeling Lecture
8Fact Data Modeling Lab
9Data modeling with Date lists Lecture
10Data modeling with Date lists Lab
Week 1: dbt Basics
1dbt basics: How dbt works: sources, models, packages Lecture
2dbt basics: How dbt works: sources, models, packages Lab
3dbt basics: creating a full dbt project lecture
4dbt basics: creating a full dbt project lab
5Build your first pipeline with dbt
6Build your first pipeline with dbt Lab
7Creating a full dbt Project Lecture
8Creating a full dbt Project Lab
Week 2: Advanced dbt
1Advanced dbt: Understanding incremental models Lecture
2Advanced dbt: Understanding incremental models Lab
3Advanced pipelines: Blue-green and WAP with Airflow Lecture
4Advanced pipelines: Blue-green and WAP with Airflow Lab
5Advanced dbt: Jinja, Macros and variables Lecture
6Advanced dbt: Jinja, Macros and variables Lab
7Advanced dbt: Production Pipelines and dbt with Airflow Lecture
8Advanced dbt: Production Pipelines and dbt with Airflow Lab
Week 3: Data Modeling on Snowflake
1Snowflake Basics Day 1 Lecture
2Snowflake Basics Day 1 Lab
3Conceptual Data Modeling Lecture Day 1
4Conceptual Data Modeling Lab Day 1
5How to use Snowpark and Snowflake Optimizations Lecture Day 2
6How to use Snowpark and Snowflake Optimizations Lab Day 2
7Advanced Snowflake Data Modeling and UDFs Lecture Day 3
8Advanced Snowflake Data Modeling and UDFs Lab Day 3
Week 4: Advanced Snowflake
1Advanced snowflake: Deploying the Capstone dag Lecture
2Advanced snowflake: Deploying the Capstone dag Lab
3Advanced Snowflake: Data Modeling and UDFs Lecture
4Advanced Snowflake: Data Modeling and UDFs Lab
5Master Advanced Snowflake Data Modeling with the VARIANT data type
6How to connect Iceberg and Snowflake with Catalogs
7Advance Snowflake Day 2 Lecture
8Advance Snowflake Day 2 Lab
Week 5: Data Modeling on Iceberg
1Apache Iceberg: Big Data History Lecture
2Apache Iceberg: Partitioning, time travel for RCA and metadata Lab
3Apache Iceberg: Data Lake Architectures Lecture
4Apace Iceberg: Data Compression, Run length encoding Lab
5Apache Iceberg: Data Contracts Lecture
6Apache iceberg: WAP patterns and Querying branched Data Lab
7Apache Iceberg Lecture Day1
8Apache Iceberg Lab Day1
9Apache Iceberg Lecture Day2
10Apache Iceberg Lab Day2
11Apache Iceberg Lecture Day3
12Apache Iceberg Lab Day3
Week 6: Airflow & Pipeline Specs with Trino
1How to build job orchestration that matters
2Injecting quality into your Airflow DAG Lab
3How to load data into Iceberg with Airflow
4Airflow Day2 Lab
5Backfilling with Airflow
6Write a comprehensive pipeline spec document
7Orchestration and Airflow Fundamentals Day 1 Lecture
8Write a comprehensive pipeline spec document Lab
9Orchestration and Airflow Fundamentals Lecture
10Orchestration and Airflow Fundamentals Lab
11Orchestration and Airflow Fundamentals Day 1 Lab
12Hard Orchestration Lessons Day 2 Lecture
13Hard Orchestration Lessons Day 2 Lab
14Cumulative DAGs in Production Day 3 Lecture
15Cumulative DAGs in Production Day 3 Lab
Week 7: Analytical Patterns & CDC
1How to do Growth Accounting like Meta
2Growth Accounting Lab
3Mastering Change Data Capture (CDC)
4Change Data Capture Lab
5Snowflake and Glue Catalog Integration Lab
6Understanding Read Streams and SCD Implementation Lab
7Change Data Capture (CDC) and Snowflake basics Lecture
8Change Data Capture (CDC) and Snowflake basics Lab
9How to use snowpark and Snowflake optimization Lecture
10How to use snowpark and Snowflake optimization Lab
11Growth Accounting Models Lecture
12Growth Accounting Models Lab
13Grouping sets and Window functions Lecture
14Grouping sets and Window functions Lab
Week 8: Capstone Project
1Capstone Project Day 1 Lecture
2Capstone Project Day 1 Lab
3Capstone Project Day 2 Class
4Capstone Project Day 3 Class
Q&A with Zach
1Q&A with Zach Week 1
2Q&A with Zach Week 2
3Q&A with Zach Week 3
4Q&A with Zach Week 4
5Q&A with Zach Week1
6Q&A with Zach Week2
7Q&A with Zach Week3
8Q&A with Zach Week4
9Q&A with Zach Week5
Expert Guest Sessions
1Jess Ramos - Data Analyst
2Madison Schott - Analytics Engineer
3Ben Rogojan - Fractional Head of Data
4John Kutay - Director of Engineering at Rippling
5Carly Taylor - Field CTO at Databricks
6Vin Vashishtha - Author of From Data to Profit
7Parth Parekh - Director of Data Engineering at Meta
8Prasad Rao - Principal Solutions Architect
9Andrew Madson - Head of DevRel at Fivetran
10Gourav Khanijoe - Engineering Lead at HubSpot
11Carly Taylor - Field CTO at Databricks (2.0)
12Jess Ramos - Data Analyst (2.0)
13Madison Schott - Analytics Engineer (2.0)
14Vaishali Macwan - Senior Data Scientist
15Tim Chan - Data at OpenAI
16Joe Reis - Author of Fundamentals of Data Engineering
17Madison Schott - Analytics Engineer (3.0)
18Carly Taylor - Field CTO at Databricks (3.0)
19Raaid A. - AI, Data, & Product Strategy Leader
20Parth Parekh - Director of Data Engineering at Meta (2.0)
IncludedDataExpertSpark, Databricks, Snowflake, Kafka, Flink — the most comprehensive data engineering curriculum on the internet.96 lessons
IncludedDataExpert
Spark, Databricks, Snowflake, Kafka, Flink — the most comprehensive data engineering curriculum on the internet.96 lessonsKickoff
1Bootcamp Kickoff
2Boot Camp Database Setup
3January 2025 Bootcamp Kickoff
4Databricks Boot Camp Kickoff
5Capstone Project Brainstorming
Week 1: Databricks Basics
1Databricks Platform Overview Day 1 Lecture
2Databricks Platform Overview Day 1 Lab
3Introduction to Spark Day 2 Lecture
4Introduction to Spark Day 2 Lab
5Apache Spark Core Day 3 Lecture
6Apache Spark Core Day 3 Lab
Week 2: Databricks & Advanced Spark
1Apache Spark Shuffle Joins Day 1 Lecture
2Apache Spark Memory Turning, Partitioning Day 2 Lecture
3Apache Spark Memory Turning, Partitioning Day 2 Lab
4Apache Spark Unit Testing Day 3 Lecture
5Apache Spark Unit Testing Day 3 Lab
6Setting Up CI/CD and Unit Testing in Databricks for Reliable Data Pipelines
7Databricks and Advanced Spark Day1 Lecture
8Databricks and Advanced Spark Day1 Lab
9Databricks and Advanced Spark Day2 Lecture
10Databricks and Advanced Spark Day2 Lab
11Apache Spark Shuffle Joins Day 1 Lab
Week 3: Data Lakes with Delta Table
1Delta Table Day 1 Lecture
2Delta Table Day 1 Lab
3Delta Lake Bonus
4Delta Table Day 2 Lecture
5Delta Table Day 2 Lab
6Data Lakes with Delta Table Day1 Lecture
7Data Lakes with Delta Table Day1 Lab
8Data Lakes with Delta Table Day2 Lecture
9Data Lakes with Delta Table Day2 Lab
Week 4: Structured Streaming with Spark & Kafka
1Apache Spark programming with Databricks Day 1 Lecture
2Apache Spark programming with Databricks Day 1 Lab
3Apache Spark programming with Databricks Day 2 Lecture
4Apache Spark programming with Databricks Day 2 Lab
5Structured Streaming Kafka to Delta Live Table Day1 Lecture
6Structured Streaming Kafka to Delta Live Table Day1 Lab
7Structured Streaming Kafka to Delta Live Table Day2 Lecture
8Structured Streaming Kafka to Delta Live Table Day2 Lab
9Exploring UDFs and SQL Benchmarks in Spark Streaming
10Advanced Spark Optimization Techniques Day 1 Lecture
11Advanced Spark Optimization Techniques Day 1 Lab
12Spark Structured Streaming Day 2 Lecture
13Spark Structured Streaming Day 2 Lab
14Deep Dive On Workflows Day 3 Lecture
15Deep Dive On Workflows Day 3 Lab
Week 5: Managing Unstructured Data
1Managing Unstructured Data - Day 1 Lecture
2Managing Unstructured Data - Day 1 Lab
3Managing Unstructured Data - Day 2 Lecture
4Managing Unstructured Data - Day 2 Lab
5Managing Unstructured Data Day1 Lecture
6Managing Unstructured Data Day1 Lab
7Managing Unstructured Data Day2 Lecture
8Managing Unstructured Data Day2 Lab
Week 6: Building AI Agents with Databricks
1Building AI Agents with Databricks Day1 Lecture
2Building AI Agents with Databricks Day1 Lab
3Building AI Agents with Databricks Day2 Lecture
4Building AI Agents with Databricks Day2 Lab
5Enhancements and Implementations in MLflow
Capstone Project
1Capstone May 2025
2Capstone Showcase Jan 2025
Q&A with Zach
1Q&A Week 1
2Q&A Week 2
3Q&A Week 3
4Q&A Week 4
5Q&A with Zach Week 1
6Q&A with Zach Week 2
7Q&A with Zach Week 3
8Q&A with Zach Week 4
9Q&A with Zach Week 5
10Navigating Data Engineering -Tips, Tools, and Career Insights
11Q&A with Zach Week1
12Q&A with Zach Week2
13Q&A with Zach Week3
14Q&A with Zach Week4
15Q&A with Zach Week5
Bonus - Azure
1Azure - Week 1 (Copy)
2Azure - Week 2 (Copy)
3Azure - Week 3 (Copy)
4Azure - Week 4 (Copy)
5Azure - Week 5 (Copy)
Expert Guest Sessions
1Alex Merced - Head of DevRel at Dremio
2Joe Reis - Author of Fundamentals of Data Engineering
3Shubham Srivastava - Senior Data Engineer at Amazon (2025-06-24)
4Vaishali Macwan - Senior Data Scientist at Amazon
5Jason Reid - Co-founder at Tabular
6Shubham Srivastava - Senior Data Engineer at Amazon (02-01-2026)
7Brian Pulliam - Career Development Coach
8Xinran Waibel - Data Engineer at OpenAI
9Jason Reid - Co-Founder at Tabular (2.0)
10Shachar Meir - Data Advisor and Public Speaker
11Brian Pulliam - Career Developement Coach (2.0)
12Sundas Khalid - Principal Analytics Lead at Google
13Yuzheng Sun - Staff Data Scientist at Statsig
14Prasad Rao - Principal Solutions Architect
15Joe Reis - Author of Fundamentals of Data Engineering (2.0)
Platform Access Included
DiscordGitHubEnroll now
Self-paced · Closed
Payment plan
$67
/moBilled $800/yr
3-day free trial
Content288 hrs
EnrollmentOpen anytime
FormatSelf-paced
This program is not accepting enrollments right now!
What's included
Learn Databricks, Snowflake, AI, and more!
Access to 250+ hours of content
Enroll now
Self-paced · Closed
Payment plan
$67
/moBilled $800/yr
3-day free trial
Content288 hrs
EnrollmentOpen anytime
FormatSelf-paced
This program is not accepting enrollments right now!
What's included
Learn Databricks, Snowflake, AI, and more!
Access to 250+ hours of content
$67/moBilled $800/yr
Annual