Master data engineering and AI like a big tech engineer

Real Time Formula 1 Analytics

Big Bag Data

Chess.com Analytics

Trading Strategy for Crypto Currency - Analytics Engineering Capstone Submission

BetFlow - Real Time Sports Betting App

Showcase of student projects

Capstone Projects

Our students have gone on to work at companies like Meta, Airbnb and Amazon. As well as achieve 100% raises!

Fast Track Your Career

Immediate free cloud access to Databricks, AWS, Snowflake, Astronomer, and more!

Free Cloud Access with tons of hands on exercises

Weekly Guest Speaker Sessions

Why Choose DataExpert.io Academy?

In this lecture, Zach simplifies the concept of LLM to its basics, emphasizing the importance of starting with simple examples for better understanding. He discussed the impact of LLM on data engineering, highlighting the significance of feedback, soft skills, and best practices in adapting to this evolving technology. Recorded on June 20th, 2024.

LLMs - Using LLMs to provide business value Day 1 Lecture

academy/2/course/319/llms_lecture_day1/llms_lecture_day1.json

This is new content and will be recorded on June11th  2024.

LLMs - Vector database for RAG applications Day 2 Lab

academy/2/course/324/llm_day2_lab/llm_day2_lab.json

Learn the different roles you can play using the ChatGPT Python API, how to interact with GPT-4 using different API configurations, and how to make the most of LLMs to streamline data engineering tasks. In this live lab session, we put GPT-4 to the test and see how well it does at generating an Airflow DAG, writing SQL queries, and crafting dataset documentation.

LLM-Driven Data Engineering Day 1 Lab

academy/2/all-access/large-language-models/day1/lab/lab.json

In this bonus lecture, we dive into one of the hottest topics in tech right now: "Will data engineering be replaced by AI and large language models?" We explore where Large Language Models (LLMs) like GPT-4 are poised to have the most significant impact, identify areas ripe for disruption, and discern the domains where LLMs have a long way to go before they can replace human ingenuity. But most importantly, discover how you can use these insights to harness the power of LLMs and elevate your career as a data engineer.

LLM-Driven Data Engineering Day 1 Lecture

academy/2/course/65/large-language-models-day-1-lecture-transcript.json

In this bonus LLM lab, you will learn how to extend your LLMs capabilities beyond text generation. This includes tasks like sending emails, crafting LinkedIn posts, and exploring the role of agents in aiding you in your technical work such as when bugs arise in your pipeline or database.

LLM-Driven Data Engineering Day 2 Lab

academy/2/course/66/large-language-models-day-2-lab-transcript.json

In this LLM presentation, we explore building applications with LLMs, emphasizing LangChain as a versatile integration point for different LLMs and addressing privacy and security concerns.

LLM-Driven Data Engineering Day 2 Lecture

academy/2/course/67/large-language-models-day-2-lecture-transcript.json

Explore the dynamic world of data engineering in this insightful video. Zach shares a wealth of experiences and insights, addressing key challenges faced in the field.

Data Pipeline Maintenance: Navigating the Complexities of Data Engineering Day 1 Lecture

academy/5/course/686/data-pipeline-maintenance-day-1-lecture-yt-transcript.json

In this lecture, we talk about one big table vs relational vs dimensional data modeling and their tradeoffs!

Dimensional Data Modeling Complex Data Type and Cumulation Day 1 Lecture

academy/5/course/658/dimensional-data-modeling-lecture-day-1-yt-transcript.json

We cover slowly changing dimensions and idempotent pipelines in this lecture! Enjoy! 

Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lecture

academy/5/course/660/dimensional-data-modeling-day-2-lecture-yt-transcript.json

In this video we build an slowly changing dimension type 2 model on top of the players table we built in the first lab! 

Dimensional Data Modeling: Building Slowly Changing Dimensions Day 2 Lab

academy/5/course/661/dimensional-data-modeling-day-2-lab-yt-transcript.json

ETL/ELT

Data Engineering Mastery Course