Venkatakrishnan·May 19, 2024Choosing the Right Data Lake: Iceberg vs. Hudi for Transitioning from Data Warehouses to Data LakesIntroduction
Venkatakrishnan·May 10, 2024Eliminating Duplicates In Real-Time with AWS Kinesis and LambdaWhen dealing with real-time data on high-traffic websites, duplicates can be a significant issue, often leading to inefficiencies and…
Venkatakrishnan·Dec 6, 2023Part 2 — Understanding Snowflake’s Architecture:In our first article, we looked at how Snowflake Elastic Data Warehouse has become important in today’s world of data. We talked about how…
Venkatakrishnan·Nov 13, 2023Part 1: Snowflake: The Cloud-Native Solution for Modern Data WarehousingIntroduction:
Venkatakrishnan·Oct 13, 2023Understanding HDFS: A Simple Guide to How Hadoop Stores DataHadoop’s HDFS (Hadoop Distributed File System) is a robust and scalable file system specifically designed for distributed storage and big…
Venkatakrishnan·Sep 18, 2023How Apache Spark decides on the join strategyApache Spark uses a cost-based optimizer to decide on the join strategy. The optimizer takes into account a number of factors, including…
Venkatakrishnan·Sep 16, 2023Designing a Scalable, De-coupled Multi-tenant Architecture using CDPIntroduction
Venkatakrishnan·Sep 11, 2023Data Modelling: Techniques, Importance and ImplementationIntroductionA response icon1A response icon1
Venkatakrishnan·Aug 25, 2023Apache Spark: Query Plans and Under-the-Hood OperationsIntroductionA response icon1A response icon1