Blog – Data Engineer Journey

Medallion (Pull) vs Data Product (Push) architectures

Kshitij Wagle / 20 February 2025

This article summarizes the core arguments from Modern Data 101‘s piece: Data Products: A Case Against Medallion Architecture. The original […]

What is an Idempotent Pipeline? An idempotent pipeline produces the same results : This means that both production runs and

Kshitij Wagle / 11 December 2024

Good Practices vs. Bad Practices in Data Governance What’s the secret to making data work for you, not against you?

I love keeping track of my learning journey. Earning my fourth certification, Badge 4: Data Lake Workshop, has been exciting.

What is Wide-Facts, why we need it? “Wide-Fact” is a fact table that contains a high number of columns and

Yesterday, early in the morning, it was beautiful as I traveled to DevFest Sydney 2024, hosted by Google Developer Groups.

Parameters are the secret ingredient that make Power BI reports dynamic and interactive. Let’s explore some of the most commonly

Kshitij Wagle / 4 September 2024

Handling massive datasets can seem overwhelming, but Apache Spark makes it manageable. This hands-on guide will show you how to

Nowadays, people often talk about these principles on LinkedIn. Inspired by these discussions, I created my first design using Figma.

A lot of people on LinkedIn and other professional platforms frequently discuss the Pareto Principle, also known as the 80/20

It’s been an exciting week since I got my new MacBook, and I’ve been eager to explore its capabilities. As

As a data analyst, I’ve always been driven by the thrill of transforming raw data into actionable insights. But when