Sign in to view content

Sign in to view this lesson and continue learning.

Apache Spark Core Day 3 Lab

Week 1: Databricks Basics
25 mins
SQLPythonApache Spark

Description

In this lab, Yared walks you through the basics of Spark SQL and the DataFrame API, highlighting how to create and interact with DataFrames. He explains the difference between transformations and actions, and how they affect job creation in Spark. He also emphasizes the importance of understanding narrow and wide transformations, as well as schema inference.