Master data engineering and AI like a big tech engineer

Real Time Formula 1 Analytics

Big Bag Data

Chess.com Analytics

Trading Strategy for Crypto Currency - Analytics Engineering Capstone Submission

BetFlow - Real Time Sports Betting App

Showcase of student projects

Capstone Projects

Our students have gone on to work at companies like Meta, Airbnb and Amazon. As well as achieve 100% raises!

Fast Track Your Career

Immediate free cloud access to Databricks, AWS, Snowflake, Astronomer, and more!

Free Cloud Access with tons of hands on exercises

Weekly Guest Speaker Sessions

Why Choose DataExpert.io Academy?

Setting Up Airflow for Week1 for Mac

Orchestration and Airflow Fundamentals Lecture

Orchestration and Airflow Fundamentals Lab

Apache Iceberg Data Contracts Lecture

Apache Iceberg Data Contracts Lab

The History of Data Lakes Lecture 

Iceberg Partitioning and Metadata Exploration Lab

Mastering Data Lake Architectures Lecture

Apache Iceberg Day 2 Lab

Apache Iceberg Day 3 Lecture

Apache Iceberg Day 3 Lab

LLM-Driven Data Engineering Day 1 Lab

LLM-Driven Data Engineering Day 1 Lecture

LLM-Driven Data Engineering Day 2 Lab

LLM-Driven Data Engineering Day 2 Lecture

The SQL Interview

The Data Modeling Interview

The Data Architecture Interview

The Behavioral Interview

The Data Structures and Algorithms Interview

Data Structures and Algorithms Interview

Product Sense Interview

Behavioral Interview

Data Modeling Interview

Live SQL Training January 25th, Window Functions and Common Table Expressions

Live SQL Training January 15th

Scala Dataset vs Dataframe API [Dec 15, 2023]

Advanced Spark on Databricks January 2025

Apache Spark Shuffle Joins Day 1 Lecture

Apache Spark Shuffle Joins Day 1 Lab

Apache Spark Memory Turning, Partitioning Day 2 Lecture

Apache Spark Memory Turning, Partitioning Day 2 Lab

Apache Spark Unit Testing Day 3 Lecture

Apache Spark Unit Testing Day 3 Lab

Apache Airflow DAG Assignment January 2025

Orchestration and Airflow Fundamentals Day 1 Lecture

Orchestration and Airflow Fundamentals Day 1 Lab

Hard Orchestration Lessons Day 2 Lecture

Hard Orchestration Lessons Day 2 Lab

Cumulative DAGs in Production Day 3 Lecture

Cumulative DAGs in Production Day 3 Lab

Analytical Patterns and Advanced SQL January 2025

Applying Analytical Patterns Day 1 Lecture

Applying Analytical Patterns Day 1 Lab

Advanced SQL Patterns Day 2 Lecture

Advanced SQL Patterns Day 2 Lab

Analytical Patterns Recognizing Business Value Day 3 Lecture

Analytical Patterns Recognizing Business Value Day 3 Lab

RAG and LLMs Day1 Lecture

RAG and LLMs Day1 Lab

RAG and LLMs Day2 Lecture

RAG and LLMs Day2 Lab

LLMs Day 3 Part1

LLMs Day3 Part2

Capstone Submission January 2025

Capstone Proposal Submission Jan 2025 Bootcamp

Capstone Showcase Jan 2025

Career Development - LinkedIn Optimization

Career Development - Resume Review

Career Development - Interview Help

Career Development - Data Modeling Interview  

Career Development - Strategic Networking

Databricks Notebook Submission January 2025

Databricks Platform Overview Day 1 Lecture

Databricks Platform Overview Day 1 Lab

Introduction to Spark Day 2 Lecture

Introduction to Spark Day 2 Lab

Apache Spark Core Day 3 Lecture

Apache Spark Core Day 3 Lab

Jason Reid (cofounder of Tabular)

Shachar Meir

Brian Pulliam

Sundas Khalid

Prasad Rao

Joe Reis

January 2025 Bootcamp Kickoff

Q&A Week 1

Q&A Week 2

Q&A Week 3

Q&A Week 4

Spark Streaming W5 Homework January 2025

Advanced Spark Optimization Techniques Day 1 Lecture

Advanced Spark Optimization Techniques Day 1 Lab

Spark Structured Streaming Day 2 Lecture

Spark Structured Streaming Day 2 Lab

Deep Dive On Workflows Day 3 Lecture

Deep Dive On Workflows Day 3 Lab

dbt advanced jan 2025

Snowflake Lecture

Snowflake Lab

Advanced dbt Day 2 Lecture

Advanced dbt Day 2 Lab

Advanced dbt Day 3 Lecture

Advanced dbt Day 3 Lab

dbt basics Jan 2025

Snowflake Basics Day 1 Lecture

Snowflake Basics Day 1 Lab

dbt Basics Day 2 Lecture

dbt Basics Day 2 Lab

dbt Basics Day 3 Lecture

dbt Basics Day 3 Lab

TA Office Hour 1

TA Office Hour 2

TA Office Hour 3

TA Office Hour 4

TA Office Hour 5

TA Office Hour 6

2025 New Year  Data Engineering Boot Camp starting January 6th

The self-paced version of the 2025 New Year Boot camp! Excludes access to speaker series and mentorship. 

Test

Test 2

Test 3

Test 4

Test 5

Test 8

New Lesson

2025 New Year Data Engineering Self-Paced Course

Building a Graph RAG assignment

Day 1 Lecture: Graph RAG vs Vector RAG

Day 1 Lab: Building Graph RAG in production

Day 2 Lecture: Types of Agents (reflection, plan-and-execute, rewoo)

Day 2 Lab: Enhancing RAG with Agentic AI

Book Club 1

Book Club 2

Book Club 3

Book Club 4

Submit your Capstone Project Proposal

Submit your Capstone Project

Day 1 Lecture: Leveraging MCP and tools to integrate effectively

Day 1 Lab: Using MCP to build more powerful agents

Day 2 Lecture: How to link your AI agent to value 

Day 2 Lab: Building an asynchronous vs synchronous agent

Career Dev Session 2

Test Lesson

Career Dev Session 4

Creating Evaluation Criteria assignment

Day 1 Lecture: Trusting your workflows (evaluation metrics and guardrails)

Day 1 Lab: Setting up CI/CD for an AI application

Day 2 Lecture: Understanding LLM Reasoning traceability

Day 2 Lab: Tracing LLM reasoning with LangChain + LangSmith

Supplemental lab session on GuardrailsAI

Prompt Engineering Assignment

Day 1 Lecture: Prompt Engineering Theory

Day 1 Lab: Auto Prompt Optimization with dspy

Day 2 Lecture: Optimizing Dev Workflows with Cursor and Windsurf

Day 2 Lab: Vibe Coding Full Stack application in 45 minutes

Supplemental Session on Auto-prompt Optimization

Q&A with Zach Week 1

Q&A with Zach Week 2

Q&A with Zach Week 3

Q&A with Zach Week 4

Q&A with Zach Week 5

TA Office Hour 7

TA Office Hour 8

Tech Talk - Li

Tech Talk - Conor

Tech Talk - Vikram

Tech Talk - Ryan

Tech Talk - Chip

Understanding RAG Basics Assignment

Day 1 Lecture: RAG Fundamentals and types of RAG

Day 1 Lab: Vectorizing Inputs into Milvus

Day 2 Lecture: RAG Tradeoffs

Day 2 Lab: Integrating RAG into your full stack app

Authentication and Advanced techniques

Lab 1

Event driven microservices

Monitoring, scaling, experimenting

week-5-Lab 2

Nextjs Introduction

Week 6 lab part 1

Advanced NextJS Features

Week 6 lab part 2

Docker Vercel and Optimization

Full Stack Bootcamp Orientation

Introduction to databases and relational SQL

Data Modeling and intro to backend

Intro to NodeJS & Express and event driven programming

Connecting the database to the service

Introduction to ReactJS

Advanced ReactJS and Tailwind

Unit Testing

Integration Testing

E2E Testing

Intro to CI/CD

Intro to System Design

Introduction to Containers

Master all the most important technical AI engineering concepts like RAG, Graph RAG, prompt engineering and more! 

AI Engineering Boot Camp starting October 20th, 2025

Scholarship Applications

Apply for a Scholarship

Available Programs

All-Access DataExpert.io Subscription

Spring 2026 AI Engineering Boot Camp

Winter 2026 Data Engineering Boot Camp