# Databricks and Advanced Spark Day2 Lab

> In this Lab, Zach dives into performance tuning and incremental data processing using a substantial dataset of around 50 gigabytes of tweets. He demonstrates the importance of partitioning. He explores the impact of repartitioning strategies on performance. He encourages everyone to experiment with…

- Web page: https://www.dataexpert.io/lesson/databricksandadvancedsparkday2lab-feb26-p736-l2028
- Program: [DataExpert](https://www.dataexpert.io/program/data-expert)
- Module: Week 2: Databricks & Advanced Spark
- Access: Requires enrollment in DataExpert
- Length: 50 min video
- Skills: Python, Apache Spark, Databricks
- Academy: DataExpert.io Academy

## About this lesson

In this Lab, Zach dives into performance tuning and incremental data processing using a substantial dataset of around 50 gigabytes of tweets. He demonstrates the importance of partitioning. He explores the impact of repartitioning strategies on performance. He encourages everyone to experiment with their own partitioning strategies and to utilize the Spark UI for performance analysis.

## Navigation

- Previous lesson: [Databricks and Advanced Spark Day2 Lecture](https://www.dataexpert.io/lesson/databricksandadvancedsparkday2lecture-feb26-p736-l2027.md)
- Next lesson: [Apache Spark Shuffle Joins Day 1 Lab](https://www.dataexpert.io/lesson/apache-spark-shuffle-joins-day-1-lab-jan2025-p736-l789.md)