Amar_Kumar·Oct 15, 2025🪣 How I Broke (and Then Fixed) My S3 Data Lake: A Hard Lesson in PartitioningI still remember my first major data lake deployment on Amazon S3. We were managing IoT sensor readings from manufacturing lines —…
Amar_Kumar·Jul 11, 2025🔍 Catching Fake Invoices with Agentic AI on Google Vertex AIPowered by Google Cloud’s Vertex AI and Gemini 2.0
Amar_Kumar·Feb 14, 2025Navigating the Data Lifecycle on Google Cloud: Choosing the Right Storage SolutionGoogle Cloud Storage Solutions for Every Stage of the Data Journey
Amar_Kumar·Jan 24, 2025Mastering Big Data Extraction Pipelines: Harnessing Paddle OCR & Multi-GPU for Text Extraction in…
Amar_Kumar·Oct 11, 2023Mastering Big Data ETL Pipelines: Harnessing Apache Airflow for orchestration and AWS Glue Jobs· Introduction · Use -case: · Components of Airflow: ∘ Directed Acyclic Graphs (DAGs): ∘ Operators: ∘ Sensors: ∘ Connections: ∘…A response icon1A response icon1
Amar_Kumar·Sep 15, 2023Demystifying Delta Lake with AWS EMR : A CDC Use CaseIn the ever-evolving landscape of data storage and processing, three distinct solutions have emerged as game-changers: Data Lakes, Data…
Amar_Kumar·Sep 14, 2023Building a Data Lakehouse with AWS EMR and Apache Hudi: A CDC Use Case — part2/2In the ever-evolving landscape of data storage and processing, three distinct solutions have emerged as game-changers: Data Lakes, Data…
Amar_Kumar·Sep 14, 2023Building a Data Lakehouse with AWS EMR and Apache Hudi: A CDC Use Case — part1/2In the ever-evolving landscape of data storage and processing, three distinct solutions have emerged as game-changers: Data Lakes, Data…
Amar_Kumar·Sep 14, 2023Building a Data Lake with Amazon S3 and EMRImplementing Upsert Operation on top of the data in the data lake.