PinnedInRazorpay EngineeringbyAnkur Ranjan·Oct 13Inside Razorpay’s RTO Model: The Engineering Behind its ML LifecycleContributor: Abhik Debnath
InDev GeniusbyAnkur Ranjan·May 22, 2025Why catalogs matter: The book-keeping of Apache IcebergFor me, in Apache Iceberg, the catalog is essentially bookkeeping for the latest metadata for the Iceberg table.
Ankur Ranjan·Oct 6, 2023Apache Hudi: Copy on Write(CoW) TableAs Data Engineer, we frequently encounter the tedious task of performing multiple UPSERT(update + insert) and DELETE operations in batch…
Ankur Ranjan·Sep 4, 2023Supercharging Apps with Polyglot Persistence: A Simple GuideAfter working for more than 4 years on Data Intensive applications in a startup, consultancy and product-based companies. I think that the…
Ankur Ranjan·Aug 25, 2023Solve Small File Problem using Apache HudiOne of the biggest pains of Data Engineers is small file problems.
InDev GeniusbyAnkur Ranjan·Jul 31, 2023Optimize MERGE job in BigQueryI love BigQuery and think It is one of the best products ever made by the Google Cloud Platform.A response icon1A response icon1
Ankur Ranjan·Feb 26, 2023Stateful transformations in Spark Streaming — Part 1 | Spark Streaming Session 3In the previous article of this series i.e. Spark Streaming in layman’s terms we have understood the following things.
Ankur Ranjan·Feb 5, 2023Spark Streaming: Session 2In the first article about the spark streaming series, we have understood the following important concept.
Ankur Ranjan·Feb 5, 2023Spark Streaming — Part 1A few months back, I was given a codebase that used Spark Streaming and it was written in scala. We were supposed to make major changes…
InTowards DevbyAnkur Ranjan·Dec 25, 2022Disaster Recovery in Kafka ServersI recently tried onboarding disaster management for our streaming pipeline which involves Kafka, Spark Streaming and MongoDb in one of our…