Purchase Required

You need to purchase this content in order to view it

Introduction to Spark Day 2 Lab

Module
44 mins

Description

In this lab, Yared walks you through the process of running Spark jobs in Databricks, focusing on the differences between shared and personal clusters. He highlights the importance of understanding job IDs, stages, and tasks when executing jobs. He also requests everyone to switch to their personal clusters for better visibility of job details. Please make sure to destroy your cluster after use to avoid unnecessary costs.