Medium

Praveen Kumar B N

Pinned

Praveen Kumar B N

·

Mar 27, 2025

📕DDIA Series — Chapter 1 — Part 1 — Reliability

👋 Hello! In this series, we will summarize and briefly talk about different chapters from Designing Data Intensive Applications (DDIA) by…

📕DDIA Series — Chapter 1 — Part 1 — Reliability

Pinned

Praveen Kumar B N

·

Mar 6, 2025

Performance Tuning — How we brought Down the join runtime from 10+ Hours to under 30 Minutes in…

Scenario🔍

Performance Tuning — How we brought Down the join runtime from 10+ Hours to under 30 Minutes in…

Pinned

Praveen Kumar B N

·

Jan 7, 2025

Spark: Does df.count() Really Won’t Triggering a Shuffle Query Stage?

Spark Official Logo

Spark: Does df.count() Really Won’t Triggering a Shuffle Query Stage?

Praveen Kumar B N

·

Jun 13, 2025

Apache Spark 4.0 : What really matters to Data Engineers

Intro

Apache Spark 4.0 : What really matters to Data Engineers

Praveen Kumar B N

·

Feb 23, 2025

Custom Job Description in Spark — The lesser known feature

One challenge that most Data Engineers face is, there are 100s of jobs in a spark pipeline and it shows up in Spark UI as a bunch of jobs…

Custom Job Description in Spark — The lesser known feature

Praveen Kumar B N

·

Jan 26, 2025

Spark Caching Performance: CSV vs Parquet — Big Difference

We all know that Spark’s ability to cache datasets is widely recognized as one of the key factors that can enable it to outperform…

Spark Caching Performance: CSV vs Parquet — Big Difference

Praveen Kumar B N

·

Jan 10, 2025

Good One. But would be great if you could include code examples as well

Praveen Kumar B N

Praveen Kumar B N

Passionate Big Data Engineer with a strong intent to build robust, scalable pipelines and an avid reader of tech content. www.linkedin.com/in/praveen-kumar-bn

Following

Help

Status

About

Careers

Press

Blog

Store

Privacy

Rules

Terms

Text to speech