# Apache Spark Unit Testing Day 3 Lecture

> In this lecture, Zach discusses the critical aspects of data engineering, focusing on the importance of maintaining data quality and minimizing customer pain. He highlights the challenges we face in balancing speed and quality, especially when dealing with machine learning models. He also emphasize…

- Web page: https://www.dataexpert.io/lesson/apache-spark-unit-testing-day-3-lecture-may2025
- Program: [Spring Data Engineering Boot Camp Starting May 26th, 2025](https://www.dataexpert.io/program/spring-data-engineering-boot-camp-starting-march-10th-6262)
- Access: Requires enrollment in Spring Data Engineering Boot Camp Starting May 26th, 2025
- Skills: Python, Apache Spark, CI/CD
- Academy: DataExpert.io Academy

## About this lesson

In this lecture, Zach discusses the critical aspects of data engineering, focusing on the importance of maintaining data quality and minimizing customer pain. He highlights the challenges we face in balancing speed and quality, especially when dealing with machine learning models. He also emphasizes the need for best practices and frameworks to ensure efficient data pipelines.

## Navigation

- Previous lesson: [Apache Spark Memory Turning, Partitioning Day 2 Lab](https://www.dataexpert.io/lesson/apache-spark-memory-turning-partitioning-day-2-lab-may2025.md)
- Next lesson: [Apache Spark Unit Testing Day 3 Lab](https://www.dataexpert.io/lesson/apache-spark-unit-testing-day-3-lab-may2025.md)