Master data engineering and AI like a big tech engineer

Real Time Formula 1 Analytics

Big Bag Data

Chess.com Analytics

Trading Strategy for Crypto Currency - Analytics Engineering Capstone Submission

BetFlow - Real Time Sports Betting App

Showcase of student projects

Capstone Projects

Our students have gone on to work at companies like Meta, Airbnb and Amazon. As well as achieve 100% raises!

Fast Track Your Career

Immediate free cloud access to Databricks, AWS, Snowflake, Astronomer, and more!

Free Cloud Access with tons of hands on exercises

Weekly Guest Speaker Sessions

Why Choose DataExpert.io Academy?

In this lecture, Zach simplifies the concept of LLM to its basics, emphasizing the importance of starting with simple examples for better understanding. He discussed the impact of LLM on data engineering, highlighting the significance of feedback, soft skills, and best practices in adapting to this evolving technology. Recorded on June 20th, 2024.

LLMs - Using LLMs to provide business value Day 1 Lecture

academy/2/course/319/llms_lecture_day1/llms_lecture_day1.json

This is new content and will be recorded on June11th  2024.

LLMs - Vector database for RAG applications Day 2 Lab

academy/2/course/324/llm_day2_lab/llm_day2_lab.json

Learn the different roles you can play using the ChatGPT Python API, how to interact with GPT-4 using different API configurations, and how to make the most of LLMs to streamline data engineering tasks. In this live lab session, we put GPT-4 to the test and see how well it does at generating an Airflow DAG, writing SQL queries, and crafting dataset documentation.

LLM-Driven Data Engineering Day 1 Lab

academy/2/all-access/large-language-models/day1/lab/lab.json

In this bonus lecture, we dive into one of the hottest topics in tech right now: "Will data engineering be replaced by AI and large language models?" We explore where Large Language Models (LLMs) like GPT-4 are poised to have the most significant impact, identify areas ripe for disruption, and discern the domains where LLMs have a long way to go before they can replace human ingenuity. But most importantly, discover how you can use these insights to harness the power of LLMs and elevate your career as a data engineer.

LLM-Driven Data Engineering Day 1 Lecture

academy/2/course/65/large-language-models-day-1-lecture-transcript.json

Explore the dynamic world of data engineering in this insightful video. Zach shares a wealth of experiences and insights, addressing key challenges faced in the field.

Data Pipeline Maintenance: Navigating the Complexities of Data Engineering Day 1 Lecture

academy/5/course/686/data-pipeline-maintenance-day-1-lecture-yt-transcript.json

In this lecture, we talk about one big table vs relational vs dimensional data modeling and their tradeoffs!

Dimensional Data Modeling Complex Data Type and Cumulation Day 1 Lecture

academy/5/course/658/dimensional-data-modeling-lecture-day-1-yt-transcript.json

In this hands-on lab session, we embark on a practical journey of growth accounting. The video guides you through the step-by-step process, illustrating how to create a partition column, calculate active dates, and adeptly track state transitions.

Applying Analytical Patterns: Mastering Growth Accounting and Retention Analysis Day 1 Lab

academy/5/course/671/applying-analytical-patterns-day-1-lab-yt-transcript.json

In this presentation, Zach explores a range of topics related to Advanced SQL Analytical Patterns. The discussion covers the application of recursive CTEs, count case when, grouping sets, cross join unnest, cube, rollup, and window functions.

Applying Analytical Patterns: Recursive CTEs and Window Functions Day 2 Lecture

academy/5/course/672/applying-analytical-patterns-day-2-lecture-yt-transcript.json

In this video will be building a cumulative table design (https://github.com/EcZachly/cumulative-table-design) with complex data types STRUCT and ARRAY. 
We will take the table player_seasons and create a new table called players that holds onto an historical record of all NBA players and the seasons that they played! 

Dimensional Data Modeling Complex Data Type and Cumulation Day 1 Lab

academy/5/course/659/dimensional_data_modeling_day_1_lab/dimensional_data_modeling_day_1_lab.json

We cover slowly changing dimensions and idempotent pipelines in this lecture! Enjoy! 

Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lecture

academy/5/course/660/dimensional-data-modeling-day-2-lecture-yt-transcript.json

In this video we build an slowly changing dimension type 2 model on top of the players table we built in the first lab! 

Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lab

academy/5/course/661/dimensional-data-modeling-day-2-lab-yt-transcript.json

In this lecture we talk about dimensional additivity and how to build a flexible data model ready for graph database consumption!

Dimensional Data Modeling: Graph Data Modeling Day 3 Lecture

academy/5/course/666/dimensional-data-modeling-day-3-lecture-yt-transcript.json

In this lab, we build a network of NBA players and see who they play against/with the most and for which teams!

Dimensional Data Modeling: Graph Data Modeling Day 3 Lab

academy/5/course/667/dimensional-data-modeling-day-3-lab-yt-transcript.json

Data Modeling

Data Engineering Mastery Course