InTowards AIbychakshu_salgotra·Oct 6Part XI — RDD vs DataFrame vs Dataset: Why Your “Type-Safe Refactor” Made Spark 3x SlowerThree APIs, two execution worlds — how Catalyst and Tungsten treat structured plans, why typed lambdas are black boxes, and when dropping…A response icon1A response icon1
Sameer Alam·Dec 23, 2025Understanding Spark Internals: JVM Objects, RDDs, and DataFrames ExplainedJVM
InCodeXbyData with Abhishek·Dec 21, 2025RDD in Apache SparkWhen people start learning Apache Spark, they often jump directly into DataFrames and Spark SQL. That’s great, but underneath all that…
Uday Kumar Reddy·Dec 2, 2025How RDD in PySpark Works And When You Should (and Shouldn’t) Use ItApache Spark is known for its speed and ability to process massive datasets. Most people today work with DataFrames, because they are…
Ankur Gupta·Oct 19, 2025PySpark DataFrame vs RDD: Choosing the Right AbstractionUnderstand the differences between PySpark RDDs and DataFrames, and when to use each for optimal performance
InTowards Data EngineeringbyThe Data Forge·Sep 26, 2025Apache Spark RDDs: A Deep Dive into the Core of SparkIn the world of big data, speed, scalability, and fault-tolerance are non-negotiable. At the heart of Apache Spark lies RDDs (Resilient…A response icon1A response icon1
Bhairavi Khairnar·Jul 15, 2025Operations on RDD — Transformation, ActionRDD(Resilient Distributed Datasets) are special data structures in spark core. RDD are immutable, partitioned collection of records that…
Akshay·Jun 20, 2025PySpark for Data Analysts: A Friendly Guide to the FoundationsIf Excel had a turbocharged big-data cousin, it would be PySpark.
DataWithSantosh·May 8, 2025Differences Between RDD, DataFrame, and Dataset in Apache SparkDetailed Explanation