# Setting Up CI/CD and Unit Testing in Databricks for Reliable Data Pipelines

> In this video, Zach walks through the process of setting up Continuous Integration/Continuous Deployment (CI/CD) and unit testing in Databricks, with a particular emphasis on enhancing the reliability of data pipelines. He begins by creating a Git folder for an Airflow DBT project and explore the Y…

- Web page: https://www.dataexpert.io/lesson/setting-up-ci-cd-and-unit-testing-in-databricks-for-reliable-data-pipelines-may2025
- Program: [Spring Data Engineering Boot Camp Starting May 26th, 2025](https://www.dataexpert.io/program/spring-data-engineering-boot-camp-starting-march-10th-6262)
- Access: Requires enrollment in Spring Data Engineering Boot Camp Starting May 26th, 2025
- Length: 46 min video
- Skills: Python, MLOps, ETL/ELT, Airflow, dbt, Git, Databricks, CI/CD
- Academy: DataExpert.io Academy

## About this lesson

In this video, Zach walks through the process of setting up Continuous Integration/Continuous Deployment (CI/CD) and unit testing in Databricks, with a particular emphasis on enhancing the reliability of data pipelines. He begins by creating a Git folder for an Airflow DBT project and explore the YAML configuration for GitHub Actions, which will trigger tests upon pull requests. The demonstration includes running unit tests and addressing bad data scenarios, highlighting the critical importance of ensuring accurate data transformations.

## Navigation

- Previous lesson: [Apache Spark Unit Testing Day 3 Lab](https://www.dataexpert.io/lesson/apache-spark-unit-testing-day-3-lab-may2025.md)
- Next lesson: [Apache Spark programming with Databricks Day 1 Lecture](https://www.dataexpert.io/lesson/apache-spark-programming-with-databricks-day-1-lecture-may2025-1.md)