# Advanced Spark (Day 2 Lecture)

> In this lecture, Zach covers the Spark APIs, specifically focusing on Dataset, Dataframe, and Spark SQL. He explains the differences between them and their use cases. Additionally, he discusses PySpark UDFs and when to use them. The lecture provides important insights and recommendations for workin…

- Web page: https://www.dataexpert.io/lesson/spark-batch-day-2-lecture-v4
- Program: [Data Engineering Mastery Course](https://www.dataexpert.io/program/data-engineering-mastery-course)
- Module: Week 4: Batch Pipelines with Apache Spark
- Access: Requires enrollment in Data Engineering Mastery Course
- Length: 22 min video
- Skills: Python, Apache Spark
- Academy: DataExpert.io Academy

## About this lesson

In this lecture, Zach covers the Spark APIs, specifically focusing on Dataset, Dataframe, and Spark SQL. He explains the differences between them and their use cases. Additionally, he discusses PySpark UDFs and when to use them. The lecture provides important insights and recommendations for working with Spark. [Recorded on May30th, 2024]

## Navigation

- Previous lesson: [Advanced Spark (Day 2 Lab)](https://www.dataexpert.io/lesson/spark-batch-day-2-lab-v4.md)
- Next lesson: [Processing data with Apache Flink  (Day 2 Lecture)](https://www.dataexpert.io/lesson/flink-streaming-day-2-lecture-v4.md)