sreekanth keerthipati·Mar 26Lakeflow Series · Part 2 of 3From Imperative Spark to Declarative Pipelines: The Evolution That Changes Everything
sreekanth keerthipati·Mar 25Lakeflow Series · Part 1 of 3Lakeflow Connect Explained: Ingest Data Into Databricks Without Writing Code
sreekanth keerthipati·Mar 16Structured Streaming & Auto Loader: Moving Data in Real Time Through the Medallion ArchitectureHow modern lakehouse pipelines move from batch processing to continuous data ingestion.A response icon1A response icon1
sreekanth keerthipati·Mar 16Medallion Architecture: Building Production Data Pipelines with Bronze, Silver, and Gold LayersIf you’ve been following this series, you now understand:
sreekanth keerthipati·Mar 9Inside the Delta Log — The Complete Series (ACID, Internals, Performance & Concurrency)Over the past few weeks, I’ve written a deep-dive series breaking down how Delta Lake actually works under the hood.
sreekanth keerthipati·Mar 4Inside the Delta Log (Part 6): Stats, Data Skipping & Z-ORDER InternalsIn Part 1, we explored how Delta builds ACID transactions.
sreekanth keerthipati·Mar 4Inside the Delta Log (Part 5): Concurrency, Isolation & Conflict Detection InternalsIn Part 1, we explored how Delta builds ACID transactions using _delta_log.
sreekanth keerthipati·Mar 3Inside the Delta Log (Part 4): Snapshot Reconstruction, Checkpoints & Time Travel InternalsIn Part 1, we opened _delta_log and understood how Delta builds ACID transactions.
sreekanth keerthipati·Mar 3Inside the Delta Log (Part 3): Deletion Vectors Internals & Production TradeoffsIn Part 1, we opened _delta_log and understood how Delta builds ACID transactions.
sreekanth keerthipati·Mar 2Inside the Delta Log (Part 2): What Really Happens When You UPDATE and DELETEIn Part 1, we opened _delta_log and saw how a simple WRITE creates four key sections: