pub.titas
Home Series Blog
Portfolio
← All Tags

Idempotency

1 items

Series Posts

Conceptual Every Record Counts: Data Engineering for Backend Engineers

Part 2: "Think in Pipelines" — The Data Engineer's Mental Model

Rohan's first daily sales job doubles a day's revenue on a retry and loses late till uploads. Rebuilding it teaches the data engineer's mental model: pipelines as functions, idempotency, partition-scoped overwrites, raw/silver/gold layers, and the five promises behind "every record counts".

© 2026 Titas Biswas

RSS · Portfolio · GitHub
100%