Naidu Rongali·Oct 18From Disk Pages to Columnar Memory : Why Apache Arrow?In modern data engineering, two open-source technologies sit at the heart of almost every analytical pipeline: Apache Parquet, the de facto…
Naidu Rongali·Sep 15Iceberg v3: Why I mapped “Deletion Vectors” to “Deletion Bitmaps”Today i had to know a bit more about Iceberg v3 especially Deletion vectors . Here is my notes on this point. Apache Iceberg tables carry a…
Naidu Rongali·Aug 31Beyond Mypy and Pydantic: Mapping the 3 Layers of Data ValidationThis is a follow up to Defining Data Quality: The Foundation Modern Data Architecture . this post clarifies the overlapping roles of static…
Naidu Rongali·Jul 18Dont fall for the terminology…its all about DataWe keep coming across different terminology about the data depending on who we are talking to. A software engineer says “object,” a…
Naidu Rongali·Jul 7From Raw Data to Knowledge Graphs : Schema, Metadata, Ontology, RDF, and ReasoningIntroduction
Naidu Rongali·Jun 21A Mental Map for Understanding REST, GraphQL, JSON-RPC, HTTP, WebSockets, TCP, and MCPHaving spent most of my time in data engineering, terms like REST, GraphQL, JSON-RPC, HTTP, WebSockets, TCP, MCP, and gRPC always felt…
Naidu Rongali·May 2User Behavior and Experience Analytics Using CloudWatch RUM and AthenaBefore exploring CloudWatch RUM analytics, it’s important to understand the foundational concept of clickstream data