38 articles tagged with "Data Governance"

Step-by-step runbook to locate, delete, and verify CCPA data in Databricks lakehouses, including file purge, backups, and audits.

Table-level lineage finds affected datasets or jobs; column-level traces fields, joins, filters, and calculations behind wrong values.

Eight-week plan (7–10 hrs/week) with hands-on labs, pipeline builds, and timed practice to prepare for the AWS Data Engineer Associate exam.

Map data flows, set vendor controls, document transfer instruments, and test evidence to approve lawful cross-border data migrations.

Assign owners, enforce classification and access rules, and track lineage, audits, and data quality to govern lakehouse assets.

Build a reliable data stack by prioritizing batch pipelines, clear ownership, and a budget before adding streaming or AI.

Checklist for secure data migration: planning, encryption, access controls, logging, testing, cleanup, and post-move governance.

Checklist to secure event-driven systems: map flows, enforce least privilege, validate schemas, protect identities, control retries, and audit.

Prevent and contain schema drift in event streams: pin contracts, run compatibility and staging tests, use DLQs and staged rollouts.

Repeatable champion-challenger process for lakehouse ML: shared features, registry aliases, shadow/canary tests, logging, and rollback.

Use LIME to explain single-model predictions: build local samples, fit a weighted surrogate, and verify stability, fidelity, and scope.

Layered lakehouse PII controls: column tags, catalog-driven masking/ABAC, lineage, audit logs, and automated deletion.