Carlos Diogo·17h agoI built a secured, multi-team lakehouse on my laptop, with open source and an AIPart 0 of 4: why, what, and where this series goes.
Prajwal Banakar·Oct 26My Journey to Google Summer of Code 2026From a small village in Karnataka to becoming a Google Summer of Code contributor with the Apache Software Foundation.
Twendee·Oct 22Industrial Data Platforms Are Becoming the Foundation for AI in ManufacturingManufacturers have invested in sensors, production systems, enterprise software and engineering tools. The challenge is that these systems…
Prakriti Juneja·Oct 21Modern Data Platform Engineering Means Activation, Not Just StorageA data platform that stores everything and changes nothing is a warehouse with better branding. Modern data platform engineering means…
InData Engineer’s NotebookbyStephany Wanjiru·Oct 20B-trees vs LSM-trees: the storage decision hiding inside your warehouseAs a data engineer, you’ve interacted with most if not all databasesA response icon1A response icon1
Sanjeet Shukla·Oct 12A real-time adtech Data Platform to processes millions of records every minuteTwo years ago, I designed and scaled the core data platform for a real-time ad-tech company, processing millions of records every minute…
Fernanda Cladera Melgar·Oct 10From Excel chaos to a Data PlatformHow do you get started building a batch data platform?
ABHISHEK GUPTA·Oct 4“Why Did My Job Fail?” Building a Debug Agent for 1.5M Daily JobsA proactive, Slack-native agent on LangGraph, with skills, MCP tools and memory, that cut our MTTR by 4×.
ABHISHEK GUPTA·Oct 1Every Job Has a Price Tag: FinOps for a Data Platform That Runs 1.5M Jobs a DayHow we turned an opaque AWS bill into a per-use-case P&L: tagging every pod, YARN app and SQL query, pricing every Hive partition across…
Prakriti Juneja·Sep 28A Data Engineering Platform Should Do More Than Move DataA data engineering platform is the set of capabilities that ingests, transforms, validates, and delivers data so downstream analytics and…
