25 Pull requests opened by 20 people

• [MINOR][DOCS] Minor update to example

  #50647 opened Apr 19, 2025

• [WIP] [SPARK-51867][ML] Make scala model supporting save / load methods against local filesystem path

  #50665 opened Apr 22, 2025

• [SPARK-51869][SS] Create classification for user errors within UDFs for Scala TransformWithState

  #50667 opened Apr 22, 2025

• [SPARK-51886][SQL]Part2.a Adds support for decorrelating nested correlated subqueries in Optimizer

  #50668 opened Apr 22, 2025

• [SPARK-51883][DOCS][PYTHON] Python Data Source user guide for filter pushdown

  #50684 opened Apr 23, 2025

• Test rockdbsjni 10

  #50688 opened Apr 24, 2025

• [SPARK-51899][SQL] Implement error handling rules for spark.catalog.listTables()

  #50696 opened Apr 24, 2025

• [SPARK-51901] [SQL] Disallow generator functions in grouping sets

  #50698 opened Apr 24, 2025

• [SPARK-51820][SQL][CONNECT] Address remaining issues for new `group`/`order` by ordinal approach

  #50699 opened Apr 24, 2025

• [WIP][SPARK-51906][SQL] Dsv2 expressions in alter table add columns

  #50701 opened Apr 25, 2025

• [SPARK-51827][SS][CONNECT] Support Spark Connect on transformWithState in PySpark

  #50704 opened Apr 25, 2025

• [SPARK-51913][SQL] JDBCTableCatalog#loadTable should throw no such table error correctly

  #50706 opened Apr 25, 2025

• [SPARK-51880][ML][PYTHON][CONNECT] Fix ML cache object python client references

  #50707 opened Apr 25, 2025

• [SPARK-51898][PYTHON][CONNECT][TESTS][FOLLOW-UP] Fix inconsistent exception

  #50708 opened Apr 25, 2025

• [SPARK-51914][SQL] Add com.mysql.cj to spark.sql.hive.metastore.sharedPrefixes

  #50711 opened Apr 25, 2025

• DESCRIPTION

  #50712 opened Apr 25, 2025

• Update CONTRIBUTING.md

  #50713 opened Apr 25, 2025

• SPARK-51710 Passing an empty array to PySpark Dataframe.dropDuplicates should behave the same as passing no arguments

  #50714 opened Apr 25, 2025

• [SPARK-51918][CORE] Executor exit wait for out/err appenders to stop + flush remaining data

  #50715 opened Apr 25, 2025

• [SPARK-51919][PYTHON] Allow overwriting statically registered Python Data Source

  #50716 opened Apr 25, 2025

• [SPARK-51671][SQL] Add column pruning ro Recursive CTEs

  #50717 opened Apr 25, 2025

• [SPARK-51920][SS][PYTHON] Fix composite/nested StructType in value state for python

  #50718 opened Apr 25, 2025

• [SPARK-51921][PYTHON][SS] Use long type for TTL duration in millisecond

  #50719 opened Apr 25, 2025

• [DO NOT MERGE]Testing nested correlations handling

  #50720 opened Apr 25, 2025

• [MINOR][DOCS] Add migration note for mapInPandas and mapInArrow validation

  #50722 opened Apr 25, 2025

25 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [SPARK-51821][CORE] Call interrupt() without holding uninterruptibleLock to avoid possible deadlock

  #50594 commented on Apr 25, 2025 • 38 new comments

• [SPARK-51834][SQL] Support end-to-end table constraint management

  #50631 commented on Apr 24, 2025 • 24 new comments

• [SPARK-51885][SQL]Part 1.b Add analyzer support for nested correlated subqueries

  #50548 commented on Apr 24, 2025 • 23 new comments

• [SPARK-51596][SS] Fix concurrent StateStoreProvider maintenance and closing

  #50595 commented on Apr 25, 2025 • 21 new comments

• [SPARK-51884][SQL]Part 1.a Add outer scope attributes for SubqueryExpression

  #50285 commented on Apr 23, 2025 • 21 new comments

• [SPARK-51786][SQL] DSv2 expressions in column defaults in CREATE/REPLACE

  #50593 commented on Apr 25, 2025 • 8 new comments

• [SPARK-51756][CORE] Computes RowBasedChecksum in ShuffleWriters

  #50230 commented on Apr 24, 2025 • 8 new comments

• [SPARK-49386][SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill

  #47856 commented on Apr 21, 2025 • 7 new comments

• [SPARK-51609][SQL] Optimize Recursive CTE execution for simple queries

  #50402 commented on Apr 24, 2025 • 6 new comments

• [SPARK-51757][SQL] Fix LEAD/LAG Function Offset Exceeds Window Group Size

  #50552 commented on Apr 25, 2025 • 6 new comments

• [SPARK-51847][PYTHON] Extend PySpark testing framework util functions with basic data tests

  #50644 commented on Apr 23, 2025 • 3 new comments

• [SPARK-51400] Replace ArrayContains nodes to InSet

  #50170 commented on Apr 22, 2025 • 2 new comments

• [SPARK-44856][PYTHON] Improve Python UDTF arrow serializer performance

  #50099 commented on Apr 22, 2025 • 1 new comment

• [SPARK-51890][SQL] Add New Parameter `options` to Logical Plan `View`.

  #50645 commented on Apr 24, 2025 • 0 new comments

• [SPARK-51272][CORE] Aborting instead of re-submitting of partially completed indeterminate result stage

  #50630 commented on Apr 24, 2025 • 0 new comments

• [SPARK-51699][BUILD] Upgrade to Apache parent pom 34

  #50627 commented on Apr 24, 2025 • 0 new comments

• [SPARK-51823][SS] Add config to not persist state store on executors

  #50612 commented on Apr 21, 2025 • 0 new comments

• [SPARK-51818][CONNECT] Move QueryExecution creation to AnalyzeHandler and don't Execute for AnalyzePlanRequests

  #50605 commented on Apr 24, 2025 • 0 new comments

• [SPARK-51817][SPARK-49578][CONNECT] Re-introduce ansiConfig fields in messageParameters of CAST_INVALID_INPUT and CAST_OVERFLOW

  #50604 commented on Apr 25, 2025 • 0 new comments

• [MINOR][CORE] Place the comments in the appropriate location

  #49216 commented on Apr 24, 2025 • 0 new comments

• [SPARK-50800][PYTHON][TESTS] Upgrade python to 3.11 in Python Packaging test

  #49464 commented on Apr 26, 2025 • 0 new comments

• [SPARK-50758][K8S]Mounts the krb5 config map on the executor pod

  #49467 commented on Apr 26, 2025 • 0 new comments

• [BUILD] Upgrade `RoaringBitmap` to 1.3.19

  #49710 commented on Apr 24, 2025 • 0 new comments

• [SPARK-51728][SQL] Add SELECT EXCEPT Support

  #50536 commented on Apr 25, 2025 • 0 new comments

• [SPARK-51243][CORE][ML] Configurable allow native BLAS

  #49986 commented on Apr 21, 2025 • 0 new comments