InData Engineer’s NotebookbyStephany Wanjiru·Oct 20B-trees vs LSM-trees: the storage decision hiding inside your warehouseAs a data engineer, you’ve interacted with most if not all databasesA response icon1
Nithiya Nanmaran·Sep 13The Importance of Having a Holistic ViewWhen I started my career in data more than a decade ago, what excited me most wasn’t the technology itself. It was the opportunity to…
Johan Doc·Aug 14The Unsung Hero of AI: Why Data Engineering is the Ultimate Bottleneck (And How to Master It)Ask anyone about Artificial Intelligence, and they’ll talk about Large Language Models, generative art, or autonomous agents. But ask…
Ramakrishna Addanki·Mar 7Spark 4.0: From “Firefighting” to “Engineering”How to build pipelines that don’t just run, but actually behave.
DS Stream·Feb 16Shift Left Your PySpark: How Unit Tests, Local Spark, and CI/CD Turn “It Runs” into “It Works”In the data engineering world, we’ve picked up a dangerous habit: we test in production. We write some SQL or PySpark, hit “Run” in a…
