Data Infrastructure – Data Engineer Journey

Medallion (Pull) vs Data Product (Push) architectures

Kshitij Wagle / 20 February 2025

This article summarizes the core arguments from Modern Data 101‘s piece: Data Products: A Case Against Medallion Architecture. The original […]

What is an Idempotent Pipeline? An idempotent pipeline produces the same results : This means that both production runs and

SCD Definition: Change of dimension over a course of time rather changing on regular scheduled time. Why do dimensions change?

What is Wide-Facts, why we need it? “Wide-Fact” is a fact table that contains a high number of columns and

The Simple.. Imagine trying to organize a party where every guest is talking to every other guest at the same

As a data analyst, I’ve always been driven by the thrill of transforming raw data into actionable insights. But when

Have you ever wondered how the data in a database is structured and organized? From the books you borrow at

Are spare tables and fields causing confusion and inefficiency in your organization’s database management? Are they causing problems during the

Are you facing challenges related to discrepancies and validation in your Analytics team? Explore these situations: If you are facing

In the complex world of database management, ensuring consistency between databases, schemas, and tables is crucial for seamless data operations.