# Apache Spark Unit Testing Day 3 Lecture

> In this lecture, Zach discusses the critical aspects of data engineering, focusing on the importance of maintaining data quality and minimizing customer pain. He highlights the challenges we face in balancing speed and quality, especially when dealing with machine learning models. He also emphasize…

- Web page: https://www.dataexpert.io/lesson/apache-spark-unit-testing-day-3-lecture-may2025-p736-l1147
- Program: [DataExpert](https://www.dataexpert.io/program/data-expert)
- Module: Week 2: Databricks & Advanced Spark
- Access: Requires enrollment in DataExpert
- Length: 56 min video
- Skills: Python, Apache Spark, CI/CD
- Academy: DataExpert.io Academy

## About this lesson

In this lecture, Zach discusses the critical aspects of data engineering, focusing on the importance of maintaining data quality and minimizing customer pain. He highlights the challenges we face in balancing speed and quality, especially when dealing with machine learning models. He also emphasizes the need for best practices and frameworks to ensure efficient data pipelines.

## Navigation

- Previous lesson: [Apache Spark Memory Turning, Partitioning Day 2 Lab](https://www.dataexpert.io/lesson/apache-spark-memory-turning-partitioning-day-2-lab-may2025-p736-l1146.md)
- Next lesson: [Apache Spark Unit Testing Day 3 Lab](https://www.dataexpert.io/lesson/apache-spark-unit-testing-day-3-lab-may2025-p736-l1148.md)