All pull requests

Pull requests

• [SPARK-55220][PYTHON][SQL] Add null strictness level parameter to Python UDF transpiler

  #59060·jzhan-2026 opened Sep 25, 2026·

  ·

• [SPARK-59776][CORE][SQL] Notify ExecutorMonitor when SQL shuffle cleanup removes shuffle files

  #59054·saurabhdamle11 opened Sep 25, 2026·

  ·

• [SPARK-59352][SQL][3.5] Validate prefix lengths in the vectorized DELTA_BYTE_ARRAY reader

  #59050·holdenk opened Sep 25, 2026Contributor·

  ·

• [SPARK-59788][SS] Initialize the global aggregation once per empty batch in the streamline plan

  #59048·nahtonaj opened Sep 25, 2026Contributor·

  ·

• [SPARK-59779][DOCS] Document the whole-stage codegen method limit

  #59047·deepujain opened Sep 25, 2026Contributor·

  ·

• [SPARK-59785][CONNECT][TESTS] Fix SparkConnectResultSetSuite failure when ANSI mode is off

  #59046·SEPURI-SAI-KRISHNA opened Sep 25, 2026Contributor·

  ·

• [SPARK-59787][SDP] SCD1 Ignore-null support; Coalesce incoming microbatch rows per key

  #59045·AnishMahto opened Sep 25, 2026Contributor·

  ·

• [SPARK-59786][SDP] SCD1 Ignore-null support; Populate version map per event row at ingest

  #59044·AnishMahto opened Sep 25, 2026Contributor·

  ·

• [SPARK-59784][SQL][TESTS] Fix racy waits for SQL execution metrics in tests

  #59043·SEPURI-SAI-KRISHNA opened Sep 25, 2026Contributor·

  ·

• [SPARK-59783][SQL] Keep the caller of split functions JIT-compilable

  #59042·MaxGekk opened Sep 25, 2026Member·

  ·
  15

• [MINOR][TESTS] Make column resolution error differences explicit

  #59040·marko-radoicic-db opened Sep 25, 2026Contributor·

  ·

• [SPARK-59781][PYTHON] Raise FIELD_STRUCT_LENGTH_MISMATCH instead of truncating rows longer than the schema in createDataFrame

  #59038·NestDream opened Sep 25, 2026·

  ·
  1

• [SPARK][CORE][SQL][SHUFFLE] Restore interrupt status after catching InterruptedException

  #59037·TimurRakhmatullin86 opened Sep 25, 2026·

  ·

• [SPARK-59778][SQL] Add display-only properties to the Table API

  #59036·szehon-ho opened Sep 25, 2026Member·

  ·

• [SPARK-35198][SQL][PYTHON] Expose direct debugCodegen methods

  #59035·deepujain opened Sep 25, 2026Contributor·

  ·
  1

• [SPARK-59353][UI][4.3] Avoid pre-fetch and crawlers triggering actions in UI- #59029

  #59034·holdenk opened Sep 25, 2026Contributor·

  ·

• [SPARK-59353][UI][4.2] Avoid pre-fetch and crawlers triggering actions in UI- #59029

  #59033·holdenk opened Sep 25, 2026Contributor·

  ·

• [SPARK-59353][UI][4.1] Avoid pre-fetch and crawlers triggering actions in UI- #59029

  #59032·holdenk opened Sep 25, 2026Contributor·

  ·

• [SPARK-59405][SQL][4.0] XSD Validation improvements- #58698

  #59031·holdenk opened Sep 25, 2026Contributor·

  ·

• [SPARK-59353][UI][3.5] Avoid pre-fetch and crawlers triggering actions in UI

  #59030·holdenk opened Sep 25, 2026Contributor·

  ·

• [SPARK-59353][UI][4.0] Avoid pre-fetch and crawlers triggering actions in UI

  #59029·holdenk opened Sep 25, 2026Contributor·

  ·

• [SPARK-43253][SQL] Report unresolved MapObjects as an internal error

  #59028·deepujain opened Sep 24, 2026Contributor·

  ·

• [SPARK-8682][SQL] Support range join for range-predicate joins

  #59027·wangyum opened Sep 24, 2026Member·

  ·

• [SPARK-59777][PYTHON] Fix timing metrics for reused Python workers

  #59025·Spenserrrr opened Sep 24, 2026Contributor·

  ·
  1

• [WIP][SS] Saturate state-watermark microsecond re-expansion to avoid overflow

  #59024·eason-yuchen-liu opened Sep 24, 2026Contributor·

  ·