Sign in to view content

Sign in to view this lesson and continue learning.

Apache Spark Core Day 3 Lecture

Description

In this lecture, Yared dives into the Query Execution Engine and explore the different types of transformations in Spark SQL, specifically narrow and wide transformations. He provides examples to illustrate these concepts and discuss the importance of schema inference for performance. He also touches on how to configure clusters for optimal data processing.