Spark Sql

Explore recommended reads, summarized by AI

Development Practices

Writing about code quality, API choices, framework design, and new language features in Spark.

Code Quality and API Design

Performance and Optimization

Writing about query execution, join strategies, and techniques for improving Spark application performance.

Benchmarking and Tool Integration

Join Strategies and Execution Internals

Popular this week

Towards Data Engineering

Ángel Álvarez Pascua

Apache Spark WTF??? 🙏 Losing My Precision 🧮

Jun 5

Pandraju Isaac

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

Nov 4

Praveenkrishnan

10 PySpark Optimization Techniques Every Data Engineer Should Know

Jul 3

M Jahanzaib Anwar

Building a Watermark Control Table in Microsoft Fabric Lakehouse

May 20

Shamen

Databricks SQL 2026: Unlocking Limitless Hierarchies, Dynamic Execution, and Spatial Scale

May 30

Latest stories

Shree Kavya

Every Charging Bill Used Today’s Price: Fixing Point-in-Time Joins With Spark 4.3’s ASOF JOIN

1d ago

Stefan Koch

Learn Databricks SQL — Part 1 — Why, and the data we’ll use

2d ago

Pandraju Isaac

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

Nov 4

Pandraju Isaac

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

Nov 2

DataWiseCode

Dipak Shaw

Why Your Spark Window Functions Are Slow

Oct 27

See more stories

Spark Sql

Development Practices

Code Quality and API Design

Performance and Optimization

Benchmarking and Tool Integration

Join Strategies and Execution Internals

Popular this week

Apache Spark WTF??? 🙏 Losing My Precision 🧮

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

10 PySpark Optimization Techniques Every Data Engineer Should Know

Building a Watermark Control Table in Microsoft Fabric Lakehouse

Databricks SQL 2026: Unlocking Limitless Hierarchies, Dynamic Execution, and Spatial Scale

Latest stories

Every Charging Bill Used Today’s Price: Fixing Point-in-Time Joins With Spark 4.3’s ASOF JOIN

Learn Databricks SQL — Part 1 — Why, and the data we’ll use

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

Why Your Spark Window Functions Are Slow

Who to follow

Popular this week

Apache Spark WTF??? 🙏 Losing My Precision 🧮

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

10 PySpark Optimization Techniques Every Data Engineer Should Know

Building a Watermark Control Table in Microsoft Fabric Lakehouse

Databricks SQL 2026: Unlocking Limitless Hierarchies, Dynamic Execution, and Spatial Scale

Latest stories

Every Charging Bill Used Today’s Price: Fixing Point-in-Time Joins With Spark 4.3’s ASOF JOIN

Learn Databricks SQL — Part 1 — Why, and the data we’ll use

Subqueries Without SQL Strings: scalar(), exists() and lateralJoin() in PySpark 4

SQL UDFs in Spark 4: Functions the Optimizer Can Actually Read

Why Your Spark Window Functions Are Slow

Who to follow