Purchase Required

You need to purchase this content in order to view it

Apache Spark Unit Testing Day 3 Lab

Module
36 mins

Description

In this lab, Zach walks you through the process of creating unit tests in PySpark, including how to handle bad data and ensure your tests pass. He demonstrates the importance of testing logic without impacting datasets and share tips on using named tuples and data frames effectively. He also discusses the significance of CI/CD practices and how to properly deploy changes.