User ID:

LLM-Driven Data Engineering Day 1 Lecture

Module

61 mins

SQL LLMs Data Modeling ETL/ELT Apache Spark

Description

In this bonus lecture, we dive into one of the hottest topics in tech right now: "Will data engineering be replaced by AI and large language models?" We explore where Large Language Models (LLMs) like GPT-4 are poised to have the most significant impact, identify areas ripe for disruption, and discern the domains where LLMs have a long way to go before they can replace human ingenuity. But most importantly, discover how you can use these insights to harness the power of LLMs and elevate your career as a data engineer.

Resources

View Source Code

Transcript preview: LLM-Driven Data Engineering Day 1 Lecture

All right. Um, let's go back to the top here. And slideshow. Cool, OK, well, welcome everybody to um. I'll go back a slide. There we go. Uh, welcome everyone to LLM Driven Data Engineering. Um, really happy to have you all here today. Um, I think this topic is something that gives people a lot of anxiety or it also gives them a lot of hope, a lot of excitement, a lot of anxiety, a lot of, I mean, at the very least, it's a lot of energy, it's a lot of energy going on in, in, in this in this regard, right? Um, so, I am trying in this presentation to one, give you my take of the matter and where I think there is the biggest risk for LLMs to impact things but also kind of give you uh kind of a very practical view of this, not from Like, you know, there's all those like LinkedIn influencers and Twitter influencers who are all like, yeah, if you're not using AI right now, then your job, you're gonna be deprecated or you're gonna be freaking whatever, right? And there's like, uh like I'm not that sold on it yet. I mean, I don't even think I'm using LLMs every day right now. I'm using them quite often, but like, not every day. I would be using them probably multiple times a week, but not every day quite yet.