Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 21, 2023

• [SPARK-43179][SHUFFLE] Allowing apps to control whether their metadata gets saved in the db by the External Shuffle Service

  Show description for 958a7d5
  

  otterc

  authored and

  Mridul Muralidharan

  committed
  958a7d5

  Copy full SHA for 958a7d5

Commits on Apr 3, 2023

• [SPARK-42974][CORE] Restore `Utils.createTempDir` to use the `ShutdownHookManager` and clean up `JavaUtils.createTempDir` method

  Show description for 707408d
  

  LuciferYang

  authored and

  srowen

  committed
  707408d

  Copy full SHA for 707408d

Commits on Mar 22, 2023

• [MINOR][DOCS] Fix typos

  Show description for 7f45285
  

  sudoliyang

  authored and

  HyukjinKwon

  committed
  7f45285

  Copy full SHA for 7f45285

Commits on Mar 18, 2023

• [SPARK-42803][CORE][SQL][ML] Use getParameterCount function instead of getParameterTypes.length

  Show description for 11c9838
  

  NarekDW

  authored and

  srowen

  committed
  11c9838

  Copy full SHA for 11c9838

Commits on Mar 2, 2023

• [SPARK-42649][CORE] Remove the standard Apache License header from the top of third-party source files

  Show description for 2c9f67c
  dongjoon-hyun

  committed
  2c9f67c

  Copy full SHA for 2c9f67c

Commits on Feb 9, 2023

• [SPARK-42366][SHUFFLE] Log shuffle data corruption diagnose cause

  Show description for 201a91b
  

  cxzl25

  authored and

  Mridul Muralidharan

  committed
  201a91b

  Copy full SHA for 201a91b

Commits on Feb 7, 2023

• [SPARK-42369][CORE] Fix constructor for java.nio.DirectByteBuffer

  Show description for b5f96fa
  

  luhenry

  authored and

  dongjoon-hyun

  committed
  b5f96fa

  Copy full SHA for b5f96fa

Commits on Jan 27, 2023

• [SPARK-33573][CORE][FOLLOW-UP] Enhance ignoredBlockBytes in pushMergeMetrics to cover more scenarios

  Show description for ddd8670
  

  Minchu Yang

  authored and

  Mridul Muralidharan

  committed
  ddd8670

  Copy full SHA for ddd8670

Commits on Jan 25, 2023

• [SPARK-42184][BUILD] Setting version to 3.5.0-SNAPSHOT

  Show description for 1322c86
  

  xinrong-meng

  authored and

  dongjoon-hyun

  committed
  1322c86

  Copy full SHA for 1322c86

Commits on Jan 21, 2023

• [MINOR][SHUFFLE] Include IOException in warning log of finalizeShuffleMerge

  Show description for 074894c
  

  tedyu

  authored and

  srowen

  committed
  074894c

  Copy full SHA for 074894c

Commits on Jan 17, 2023

• [SPARK-42090] Introduce sasl retry count in RetryingBlockTransferor

  Show description for f1a3f4a
  

  tedyu

  authored and

  Mridul Muralidharan

  committed
  f1a3f4a

  Copy full SHA for f1a3f4a

Commits on Jan 16, 2023

• [MINOR][CORE][TESTS] Suppress unchecked warnings in OneForOneStreamManagerSuite

  Show description for b054d49
  dongjoon-hyun

  committed
  b054d49

  Copy full SHA for b054d49

Commits on Jan 15, 2023

• [SPARK-41415] SASL Request Retries

  Show description for 2878cd8
  

  Aravind Patnam

  authored and

  Mridul Muralidharan

  committed
  2878cd8

  Copy full SHA for 2878cd8

Commits on Jan 14, 2023

• [SPARK-40480][SHUFFLE] Remove push-based shuffle data after query finished

  Show description for e424499
  

  wankunde

  authored and

  Mridul

  committed
  e424499

  Copy full SHA for e424499

Commits on Jan 12, 2023

• [SPARK-42031][CORE][SQL] Clean up `remove` methods that do not need override

  Show description for af935e6
  

  LuciferYang

  authored and

  huaxingao

  committed
  af935e6

  Copy full SHA for af935e6

• [SPARK-33573][SHUFFLE][YARN] Shuffle server side metrics for Push-based shuffle

  Show description for e26fa3f
  

  2 peopleauthored and

  Mridul

  committed
  e26fa3f

  Copy full SHA for e26fa3f

Commits on Jan 1, 2023

• [SPARK-41792][SHUFFLE] Fix DB update for push based shuffle when newer shuffle merge is received

  Show description for 5d6b69f
  

  Mridul Muralidharan

  committed
  5d6b69f

  Copy full SHA for 5d6b69f

Commits on Dec 24, 2022

• [CORE][MINOR] Correct spelling for RPC in log

  Show description for 02fdefd
  

  tedyu

  authored and

  srowen

  committed
  02fdefd

  Copy full SHA for 02fdefd

Commits on Dec 21, 2022

• [MINOR] Fix some typos

  Show description for 52e4b31
  

  for08

  authored and

  HyukjinKwon

  committed
  52e4b31

  Copy full SHA for 52e4b31

Commits on Dec 9, 2022

• [SPARK-41458][BUILD][YARN][SHUFFLE] Correctly transform the SPI services for Yarn Shuffle Service

  Show description for be52d67
  

  pan3793

  authored and

  srowen

  committed
  be52d67

  Copy full SHA for be52d67

Commits on Dec 8, 2022

• [SPARK-41376][CORE] Correct the Netty preferDirectBufs check logic on executor start

  Show description for e6be300
  

  pan3793

  authored and

  srowen

  committed
  e6be300

  Copy full SHA for e6be300

Commits on Dec 6, 2022

• [SPARK-41244][UI] Introducing a Protobuf serializer for UI data on KV store

  Show description for 78532fd
  gengliangwang

  committed
  78532fd

  Copy full SHA for 78532fd

Commits on Nov 11, 2022

• [SPARK-41093][BUILD] Remove netty-tcnative-classes from Spark dependencyList

  Show description for 24adac3
  

  pan3793

  authored and

  srowen

  committed
  24adac3

  Copy full SHA for 24adac3

Commits on Nov 10, 2022

• [SPARK-41089][YARN][SHUFFLE] Relocate Netty native arm64 libs

  Show description for c72d399
  

  pan3793

  authored and

  srowen

  committed
  c72d399

  Copy full SHA for c72d399

Commits on Nov 2, 2022

• [SPARK-40248][SQL] Use larger number of bits to build Bloom filter

  Show description for d627d8e
  wangyum

  committed
  d627d8e

  Copy full SHA for d627d8e

Commits on Oct 6, 2022

• [SPARK-40511][BUILD][CORE] Upgrade slf4j to 2.0.3

  Show description for f7fa0fe
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  f7fa0fe

  Copy full SHA for f7fa0fe

Commits on Sep 21, 2022

• [SPARK-40490][YARN][TESTS] Ensure `YarnShuffleIntegrationSuite` tests registeredExecFile reload scenarios

  Show description for e669957
  

  LuciferYang

  authored and

  tgravescs

  committed
  e669957

  Copy full SHA for e669957

Commits on Sep 16, 2022

• [SPARK-40398][CORE][SQL] Use Loop instead of Arrays.stream api

  Show description for d71b180
  

  LuciferYang

  authored and

  srowen

  committed
  d71b180

  Copy full SHA for d71b180

Commits on Sep 9, 2022

• [SPARK-38888][BUILD][CORE][YARN][DOCS] Add `RocksDB` support for shuffle service state store

  Show description for e83aedd
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  e83aedd

  Copy full SHA for e83aedd

Commits on Sep 8, 2022

• [SPARK-40186][CORE][YARN] Ensure `mergedShuffleCleaner` have been shutdown before `db` close

  Show description for 0be27b6
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  0be27b6

  Copy full SHA for 0be27b6

• [SPARK-38909][BUILD][CORE][YARN][FOLLOWUP] Make some code cleanup related to shuffle state db

  Show description for 3566657
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  3566657

  Copy full SHA for 3566657

Commits on Aug 31, 2022

• [SPARK-40194][SQL] SPLIT function on empty regex should truncate trailing empty string

  Show description for 247306c
  

  vitaliili-db

  authored and

  cloud-fan

  committed
  247306c

  Copy full SHA for 247306c

Commits on Aug 18, 2022

• [SPARK-38909][CORE][YARN] Encapsulate `LevelDB` used to store remote/external shuffle state as `DB`

  Show description for 892a45f
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  892a45f

  Copy full SHA for 892a45f

Commits on Aug 16, 2022

• [SPARK-40036][CORE] Fix some API semantics of `Level/RocksDBIterator` after `db/iterator` is closed

  Show description for 8439d84
  

  LuciferYang

  authored and

  srowen

  committed
  8439d84

  Copy full SHA for 8439d84

Commits on Aug 8, 2022

• [SPARK-40004][CORE] Remove redundant `LevelDB.get` in `RemoteBlockPushResolver`

  Show description for 1fed903
  

  LuciferYang

  authored and

  Mridul Muralidharan

  committed
  1fed903

  Copy full SHA for 1fed903

Pagination

Previous

Next