Data Governance

38 articles tagged with "Data Governance"

CCPA Deletion Requests in Databricks Lakehouses

CCPA Deletion Requests in Databricks Lakehouses

Step-by-step runbook to locate, delete, and verify CCPA data in Databricks lakehouses, including file purge, backups, and audits.

⦁ 10 min read
Data Engineering
Table vs. Column-Level Lineage for Data Error Diagnosis

Table vs. Column-Level Lineage for Data Error Diagnosis

Table-level lineage finds affected datasets or jobs; column-level traces fields, joins, filters, and calculations behind wrong values.

⦁ 9 min read
Data Engineering
AWS Data Engineer Certification: 8-Week Study Plan

AWS Data Engineer Certification: 8-Week Study Plan

Eight-week plan (7–10 hrs/week) with hands-on labs, pipeline builds, and timed practice to prepare for the AWS Data Engineer Associate exam.

⦁ 9 min read
Data Engineering
Vendor Compliance Rules for Cross-Border Migration

Vendor Compliance Rules for Cross-Border Migration

Map data flows, set vendor controls, document transfer instruments, and test evidence to approve lawful cross-border data migrations.

⦁ 9 min read
Data Engineering
Metadata Management in Lakehouse Governance

Metadata Management in Lakehouse Governance

Assign owners, enforce classification and access rules, and track lineage, audits, and data quality to govern lakehouse assets.

⦁ 10 min read
Data Engineering
Modern Data Stack 2026: Tools, Trends, Roadmap

Modern Data Stack 2026: Tools, Trends, Roadmap

Build a reliable data stack by prioritizing batch pipelines, clear ownership, and a budget before adding streaming or AI.

⦁ 15 min read
Data Engineering
Security and Compliance in Data Migration

Security and Compliance in Data Migration

Checklist for secure data migration: planning, encryption, access controls, logging, testing, cleanup, and post-move governance.

⦁ 13 min read
Data Engineering
Securing Event-Driven Architecture: Best Practices

Securing Event-Driven Architecture: Best Practices

Checklist to secure event-driven systems: map flows, enforce least privilege, validate schemas, protect identities, control retries, and audit.

⦁ 16 min read
Data Engineering
Handling Schema Drift in Event Streams

Handling Schema Drift in Event Streams

Prevent and contain schema drift in event streams: pin contracts, run compatibility and staging tests, use DLQs and staged rollouts.

⦁ 13 min read
Data Engineering
Champion-Challenger Guide for Lakehouse ML

Champion-Challenger Guide for Lakehouse ML

Repeatable champion-challenger process for lakehouse ML: shared features, registry aliases, shadow/canary tests, logging, and rollback.

⦁ 14 min read
AI Engineering
LIME for ML Models: 5-Step Guide

LIME for ML Models: 5-Step Guide

Use LIME to explain single-model predictions: build local samples, fit a weighted surrogate, and verify stability, fidelity, and scope.

⦁ 8 min read
AI Engineering
Lakehouse Governance for PII: Best Practices

Lakehouse Governance for PII: Best Practices

Layered lakehouse PII controls: column tags, catalog-driven masking/ABAC, lineage, audit logs, and automated deletion.

⦁ 23 min read
Data Engineering
Page 0 of 4Next