# Introduction to Spark Day 2 Lab

> In this lab, Yared walks you through the process of running Spark jobs in Databricks, focusing on the differences between shared and personal clusters. He highlights the importance of understanding job IDs, stages, and tasks when executing jobs. He also requests everyone to switch to their personal…

- Web page: https://www.dataexpert.io/lesson/introduction-to-spark-day-2-lab-jan2025
- Program: [2025 New Year  Data Engineering Boot Camp starting January 6th](https://www.dataexpert.io/program/2025-new-year-data-engineering-boot-camp-starting-january-6th)
- Access: Requires enrollment in 2025 New Year  Data Engineering Boot Camp starting January 6th
- Length: 44 min video
- Skills: SQL, Python, Apache Spark
- Academy: DataExpert.io Academy

## About this lesson

In this lab, Yared walks you through the process of running Spark jobs in Databricks, focusing on the differences between shared and personal clusters. He highlights the importance of understanding job IDs, stages, and tasks when executing jobs. He also requests everyone to switch to their personal clusters for better visibility of job details. Please make sure to destroy your cluster after use to avoid unnecessary costs.

## Navigation

- Previous lesson: [Introduction to Spark Day 2 Lecture](https://www.dataexpert.io/lesson/introduction-to-spark-day-2-lecture-jan2025.md)
- Next lesson: [Apache Spark Core Day 3 Lecture](https://www.dataexpert.io/lesson/apache-spark-core-day-3-lecture-jan2025.md)