Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 22, 2023

• [SPARK-43082][CONNECT][PYTHON] Arrow-optimized Python UDFs in Spark Connect

  Show description for f29502a
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  f29502a

  Copy full SHA for f29502a

• [SPARK-43195][BUILD][FOLLOWUP] Fix mima check for Scala 2.13

  Show description for fece7ed
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  fece7ed

  Copy full SHA for fece7ed

• [SPARK-43046][SS][CONNECT] Implemented Python API dropDuplicatesWithinWatermark for Spark Connect

  Show description for 4d76511
  

  bogao007

  authored and

  HyukjinKwon

  committed
  4d76511

  Copy full SHA for 4d76511

• [SPARK-43174][SQL] Fix SparkSQLCLIDriver completer

  Show description for 069b48e
  wangyum

  committed
  069b48e

  Copy full SHA for 069b48e

Commits on Apr 21, 2023

• [SPARK-43196][YARN][FOLLOWUP] Remove unnecessary Hadoop version check

  Show description for 2cbe049
  

  pan3793

  authored and

  sunchao

  committed
  2cbe049

  Copy full SHA for 2cbe049

• [SPARK-43179][SHUFFLE] Allowing apps to control whether their metadata gets saved in the db by the External Shuffle Service

  Show description for 958a7d5
  

  otterc

  authored and

  Mridul Muralidharan

  committed
  958a7d5

  Copy full SHA for 958a7d5

• Revert "[SPARK-43142] Fix DSL expressions on attributes with special characters"

  Show description for 3523d83
  wangyum

  committed
  3523d83

  Copy full SHA for 3523d83

• [SPARK-43142] Fix DSL expressions on attributes with special characters

  Show description for eb6c885
  

  rshkv

  authored and

  cloud-fan

  committed
  eb6c885

  Copy full SHA for eb6c885

• [SPARK-43191][CORE][FOLLOWUP] Use renamed import statement for Hadoop classes

  Show description for d407a42
  

  pan3793

  authored and

  Mridul Muralidharan

  committed
  d407a42

  Copy full SHA for d407a42

• [SPARK-43192][CONNECT] Remove user agent charset validation

  Show description for 51e947d
  

  nija-at

  authored and

  HyukjinKwon

  committed
  51e947d

  Copy full SHA for 51e947d

• [SPARK-43222][CORE][SQL][K8S][TESTS] Remove `isHadoop3` check from tests

  Show description for ef20bf9
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  ef20bf9

  Copy full SHA for ef20bf9

• [SPARK-43055][CONNECT][PYTHON][FOLLOWUP] Fix deduplicate field names and refactor

  Show description for 50d9f94
  

  ueshin

  authored and

  HyukjinKwon

  committed
  50d9f94

  Copy full SHA for 50d9f94

• [SPARK-43102][BUILD] Upgrade commons-compress to 1.23.0

  Show description for 11274bf
  

  LuciferYang

  authored and

  zhengruifeng

  committed
  11274bf

  Copy full SHA for 11274bf

• [SPARK-43213][PYTHON] Add `DataFrame.offset` to vanilla PySpark

  Show description for 7f724c3
  zhengruifeng

  committed
  7f724c3

  Copy full SHA for 7f724c3

• [SPARK-43193][SS] Remove workaround for HADOOP-12074

  Show description for 563242b
  

  pan3793

  authored and

  HyukjinKwon

  committed
  563242b

  Copy full SHA for 563242b

• [SPARK-43113][SQL][FOLLOWUP] Add comment about copying steam-side variables

  Show description for 6d4ed13
  

  bersprockets

  authored and

  cloud-fan

  committed
  6d4ed13

  Copy full SHA for 6d4ed13

• [SPARK-43119][SQL] Support Get SQL Keywords Dynamically Thru JDBC API and TVF

  Show description for 6be882c
  yaooqinn

  committed
  6be882c

  Copy full SHA for 6be882c

• [MINOR][CONNECT][PYTHON][DOCS] Fix the doc of parameter `num` in `DataFrame.offset`

  Show description for a28d2d7
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  a28d2d7

  Copy full SHA for a28d2d7

• Revert [SPARK-39203][SQL] Rewrite table location to absolute URI based on database URI

  Show description for afd9e2c
  

  cloud-fan

  authored and

  HyukjinKwon

  committed
  afd9e2c

  Copy full SHA for afd9e2c

• [SPARK-43124][SQL] Dataset.show projects CommandResults locally

  Show description for 16a28b1
  

  peter-toth

  authored and

  HyukjinKwon

  committed
  16a28b1

  Copy full SHA for 16a28b1

Commits on Apr 20, 2023

• [SPARK-42960][CONNECT][SS] Add await_termination() and exception() API for Streaming Query in Python

  Show description for 875a297
  

  WweiL

  authored and

  HyukjinKwon

  committed
  875a297

  Copy full SHA for 875a297

• [SPARK-43211][HIVE] Remove Hadoop2 support in IsolatedClientLoader

  Show description for 20e07bf
  

  pan3793

  authored and

  sunchao

  committed
  20e07bf

  Copy full SHA for 20e07bf

• [SPARK-43202][YARN] Replace reflection w/ direct calling for YARN Resource API

  Show description for 5bade8a
  

  pan3793

  authored and

  sunchao

  committed
  5bade8a

  Copy full SHA for 5bade8a

• [SPARK-43208][SQL][HIVE] IsolatedClassLoader should close barrier class InputStream after reading

  Show description for 01dc1cb
  

  pan3793

  authored and

  sunchao

  committed
  01dc1cb

  Copy full SHA for 01dc1cb

• [SPARK-43184][YARN] Resume using enumeration to compare `NodeState.DECOMMISSIONING` state

  Show description for 55eafb4
  

  LuciferYang

  authored and

  zhengruifeng

  committed
  55eafb4

  Copy full SHA for 55eafb4

• [SPARK-43183][SS] Introduce a new callback "onQueryIdle" to StreamingQueryListener

  Show description for 2178769
  HeartSaVioR

  committed
  2178769

  Copy full SHA for 2178769

• [SPARK-43207][CONNECT] Add helper functions to extract value from literal expression

  Show description for 47ac097
  zhengruifeng

  committed
  47ac097

  Copy full SHA for 47ac097

• [SPARK-43190][SQL] ListQuery.childOutput should be consistent with child output

  Show description for 9e17731
  cloud-fan

  committed
  9e17731

  Copy full SHA for 9e17731

• Revert "[SPARK-42945][CONNECT] Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect"

  Show description for 09a4353
  HyukjinKwon

  committed
  09a4353

  Copy full SHA for 09a4353

• [SPARK-43196][YARN] Replace reflection w/ direct calling for `ContainerLaunchContext#setTokensConf`

  Show description for 87ccfc2
  

  LuciferYang

  authored and

  sunchao

  committed
  87ccfc2

  Copy full SHA for 87ccfc2

• [SPARK-43191][CORE] Replace reflection w/ direct calling for Hadoop CallerContext

  Show description for 34d1c22
  

  pan3793

  authored and

  sunchao

  committed
  34d1c22

  Copy full SHA for 34d1c22

• [SPARK-43200][DOCS] Remove Hadoop 2 reference in docs

  Show description for 78407a7
  

  pan3793

  authored and

  sunchao

  committed
  78407a7

  Copy full SHA for 78407a7

• [SPARK-43195][CORE] Remove unnecessary serializable wrapper in HadoopFSUtils

  Show description for 29b40f6
  

  pan3793

  authored and

  sunchao

  committed
  29b40f6

  Copy full SHA for 29b40f6

Commits on Apr 19, 2023

• [SPARK-43129] Scala core API for streaming Spark Connect

  Show description for 3814d15
  

  Raghu Angadi

  authored and

  HyukjinKwon

  committed
  3814d15

  Copy full SHA for 3814d15

• [SPARK-42945][CONNECT] Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect

  Show description for b9400c7
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  b9400c7

  Copy full SHA for b9400c7

Pagination

Previous

Next