Data Governance

10 articles tagged with "Data Governance"

Soda vs. Great Expectations: Data Quality Tools

Soda vs. Great Expectations: Data Quality Tools

Compare Soda's SQL/YAML real-time monitoring and Great Expectations' Python validations to pick the best data quality tool for your team's workflow.

11 min read
Data Engineering
How Data Teams Drive Continuous Improvement

How Data Teams Drive Continuous Improvement

How data teams use audits, root-cause analysis, PDCA, feedback loops, agile methods and modern tools to improve data quality, reliability and delivery.

18 min read
Data Engineering
Access Control in Snowflake Migrations

Access Control in Snowflake Migrations

Plan RBAC, enforce MFA, apply network and session policies, and monitor grants to secure Snowflake during and after migrations.

14 min read
Data Engineering
Databricks for Financial Market Analysis

Databricks for Financial Market Analysis

Use Databricks Lakehouse to combine real-time and historical market data, build streaming Delta pipelines, and train scalable predictive models.

14 min read
Data Engineering
Polyglot Persistence: Database Per Service Pattern

Polyglot Persistence: Database Per Service Pattern

How polyglot persistence and the database-per-service pattern let microservices pick optimal databases, scale independently, and manage consistency trade-offs.

16 min read
Data Engineering
How Databricks Handles Schema Transformations

How Databricks Handles Schema Transformations

Guide to schema enforcement, schema evolution, Auto Loader, mergeSchema, type widening, and streaming best practices in Databricks.

16 min read
Data Engineering
Error Handling in dbt: Best Practices

Error Handling in dbt: Best Practices

Practical dbt error-handling guide: diagnose compilation, model, and database errors; use tests, safe casts, macros, logs, and CI/CD to prevent failures.

17 min read
Data Engineering
Snowflake in Hybrid Cloud Data Architecture

Snowflake in Hybrid Cloud Data Architecture

Unify storage, compute, and governance across hybrid clouds using hybrid tables, micro-partitioning, secure cross-cloud sharing, and pay-per-use scaling.

11 min read
Data Engineering
Backward Compatibility in Schema Evolution: Guide

Backward Compatibility in Schema Evolution: Guide

Evolve schemas without breaking pipelines: learn safe changes, compatibility modes (BACKWARD vs BACKWARD_TRANSITIVE), registry best practices, and rollout tips.

15 min read
Data Engineering
10 Benefits of Domain-Oriented Data Architecture

10 Benefits of Domain-Oriented Data Architecture

Decentralized domain-oriented data architecture improves data quality, speed, scalability, governance, security, and sharing by treating data as products.

16 min read
Data Engineering