Analytics Engineering

41 articles tagged with "Analytics Engineering"

Snowflake vs. Databricks: Monitoring Features Compared

Snowflake vs. Databricks: Monitoring Features Compared

SQL-first platforms favor low-touch monitoring and credit controls, while Spark-heavy stacks demand deeper job and streaming observability.

8 min read
Data Engineering
Ultimate Guide to Data Storytelling with Dashboards

Ultimate Guide to Data Storytelling with Dashboards

Turn dashboards into decision tools: start with one business question, design for one audience, show the insight and next steps.

10 min read
Data Engineering
Scaling Self-Service Analytics with Databricks

Scaling Self-Service Analytics with Databricks

Standardize Gold tables, Unity Catalog metric views, and SQL Warehouses to deliver governed, consistent self-service analytics and BI access.

10 min read
Data Engineering
Case Study: Caching with Databricks for Faster Analytics

Case Study: Caching with Databricks for Faster Analytics

Cut scans from 2.3TB to 8GB and reduce compute costs 73% using Disk Cache, Spark cache, SQL result cache and improved file layout.

8 min read
Data Engineering
Git Workflows for Data Teams

Git Workflows for Data Teams

Use one Git branch model, short-lived branches with reviews and CI, map Dev/Stage/Prod, and keep notebooks and large files out of Git.

9 min read
Data Engineering
How to Monitor Security in Databricks Lakehouses

How to Monitor Security in Databricks Lakehouses

Use Unity Catalog, system tables, SAT, and SIEM integrations to monitor lakehouse security, detect threats, and automate response.

14 min read
Data Engineering
Managing Domain Events in Event-Driven Architectures

Managing Domain Events in Event-Driven Architectures

Treat domain events as versioned API contracts—design for consumers, use outbox/CDC for reliable delivery, and enforce clear ownership.

14 min read
Data Engineering
Snowflake Query Tuning: Best Practices for Low Latency

Snowflake Query Tuning: Best Practices for Low Latency

Practical Snowflake tuning: right-size warehouses, improve micro-partitioning, optimize SQL and caching to cut query latency.

17 min read
Data Engineering
Databricks Parameterization: A Quick Guide

Databricks Parameterization: A Quick Guide

Use named/unnamed SQL parameters, widgets, and best practices to build secure, reusable Databricks queries.

10 min read
Data Engineering
Case Study: Improving Dashboard Speed with Snowflake

Case Study: Improving Dashboard Speed with Snowflake

Diagnose and fix Snowflake dashboard slowness with caching, warehouse tuning, clustering, materialized views and search optimization.

13 min read
Data Engineering
Why dbt SQL Anti-Patterns Hurt Performance

Why dbt SQL Anti-Patterns Hurt Performance

Fix common dbt SQL anti-patterns—huge CTEs, missing staging, ephemeral overuse, and bad incremental filters—to cut costs and speed runs.

10 min read
Data Engineering
How Airflow Supports Analytics Monitoring

How Airflow Supports Analytics Monitoring

Setup and monitor analytics pipelines with Airflow: UI views, logs, alerts, Prometheus/Grafana, and best practices for reliability.

12 min read
Data Engineering
Page 0 of 4Next