InData Engineer’s NotebookbyStephany Wanjiru·Oct 20B-trees vs LSM-trees: the storage decision hiding inside your warehouseAs a data engineer, you’ve interacted with most if not all databasesA response icon1A response icon1
Nithiya Nanmaran·Sep 13The Importance of Having a Holistic ViewWhen I started my career in data more than a decade ago, what excited me most wasn’t the technology itself. It was the opportunity to…
Johan Doc·Aug 14The Unsung Hero of AI: Why Data Engineering is the Ultimate Bottleneck (And How to Master It)Ask anyone about Artificial Intelligence, and they’ll talk about Large Language Models, generative art, or autonomous agents. But ask…
Ramakrishna Addanki·Mar 7Spark 4.0: From “Firefighting” to “Engineering”How to build pipelines that don’t just run, but actually behave.
DS Stream·Feb 16Shift Left Your PySpark: How Unit Tests, Local Spark, and CI/CD Turn “It Runs” into “It Works”In the data engineering world, we’ve picked up a dangerous habit: we test in production. We write some SQL or PySpark, hit “Run” in a…
Rahul Sahay·Dec 26, 2025Snowflake Postgres — Things I Got Wrong Before I Understood ItIntro — Why this confused me first
Emmanuel Owodunni·Oct 3, 2025Kafka Modern Data Architecture!Apache Kafka is a distributed streaming platform capable of handling trillions of events a day. It’s often described as a distributed…
Chidinmaokeh·Sep 26, 2025Data Engineering Fundamentals: Turning Raw Data into Business GoldWelcome to the wonderful world of Data Engineering.A response icon1A response icon1
Shabana Khanam·Sep 11, 2025Snowflake and dbt: The Perfect Partnership for Modern Data TeamsTransform your data warehouse into a powerhouse of insights with this game-changing combination
InArt of Data EngineeringbyMaximilian Oliver·Aug 13, 2025Wiring the Pipes Right: My Experience Orchestrating Workflows in Data Engineering with Apache…What It Actually Takes to Move, Transform, and Monitor Data Reliably Across Systems Using Airflow.
