All pull requests

Pull requests

• [SPARK-61729][SQL] Eliminate redundant Window/Filter after WindowGroupLimit truncates to a top-1 row_number()

  SQL
  #60517·wangyum opened Nov 14, 2026Member·

  ·
  1

• [SPARK-61437][SQL] Fix query errors by ConstantPropagation over aliases that can fail

  SQL
  #60516·sarutak opened Nov 14, 2026Member·

  ·

• [SPARK-61678][SQL] Apply SQL PATH to partially qualified names

  DOCSSQL
  #60515·srielau opened Nov 14, 2026Contributor·

  ·

• [SPARK-61726][SQL] Honor the parse mode in schema_of_json instead of surfacing raw Jackson exceptions on malformed input

  DOCSSQL
  #60514·jubins opened Nov 14, 2026Contributor·

  ·

• [SPARK-61727][SQL] Surface MALFORMED_CSV_RECORD instead of TextParsingException when schema_of_csv input exceeds maxColumns or maxCharsPerColumn

  SQL
  #60513·jubins opened Nov 14, 2026Contributor·

  ·

• [SPARK-61723][4.X][SQL] Avoid quadratic time when rewriting DSv2 DELETE, UPDATE and MERGE on wide tables

  SQL
  #60512·dongjoon-hyun opened Nov 14, 2026Member·

  ·

• [SPARK-61725][SQL] Fix wrong results by DSv2 MERGE that references metadata columns on tables accepting any schema

  SQL
  #60511·dongjoon-hyun opened Nov 14, 2026Member·

  ·

• [SPARK-61724][SQL] Fix CBO failing on analyzed TIMESTAMP_NTZ, TIME and ANSI interval columns

  SQL
  #60510·dongjoon-hyun opened Nov 14, 2026Member·

  ·

• [SPARK-61723][SQL] Avoid quadratic time when rewriting DSv2 DELETE, UPDATE and MERGE on wide tables

  SQL
  #60509·dongjoon-hyun opened Nov 14, 2026Member·

  ·

• [SPARK-61720][CORE][PYTHON][SQL] Share the Python worker idle timeout handling between the readers

  COREPYTHONSQLUDF
  #60507·viirya opened Nov 14, 2026Member·

  ·
  19

• [SPARK-60758][SQL] Require the same broadcast mode when a DPP filter reuses a broadcast without AQE

  SQL
  #60502·rekbun opened Nov 14, 2026·

  ·

• [SPARK-60043][SQL] Keep the sort orders after a partition-key transform in a V2 scan's reported ordering

  DOCSSQL
  #60501·rekbun opened Nov 14, 2026·

  ·

• [MINOR][SQL][TESTS] Rename StUtilsSuite.java to STUtilsSuite.java to match its class

  SQL
  #60500·rekbun opened Nov 14, 2026·

  ·

• [SPARK-61715][BUILD] Check binary compatibility against Spark 4.3.0

  BUILD
  #60499·rekbun opened Nov 14, 2026·

  ·

• [SPARK-61704][SQL] Fix ConstantPropagation propagating an EqualTo with a NULL literal

  SQL
  #60498·sarutak opened Nov 14, 2026Member·

  ·

• [SPARK-61682][SQL][TESTS] Fix in-memory test tables losing column det…

  SQL
  #60497·ramesh004 opened Nov 14, 2026·

  ·

• [SPARK-61689][SQL] Assign a name to the error condition _LEGACY_ERROR…

  SQL
  #60496·ramesh004 opened Nov 14, 2026·

  ·

• Ticketnumber spark-60646

  PANDAS API ON SPARKPYTHON
  #60495·ramesh004 opened Nov 14, 2026·

  ·

• [SPARK-61499][SQL] Fix ORC aggregate push-down reading statistics of the wrong column

  DOCSSQL
  #60494·raviston opened Nov 14, 2026·

  ·

• [SPARK-61700][DOC] Update addressable gem version to 2.9.2

  DOCS
  #60493·LuciferYang opened Nov 14, 2026Contributor·

  ·
  1

• [SPARK-61689][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1089

  SQL
  #60492·Ma77Ball opened Nov 14, 2026Contributor·

  ·

• [SPARK-61686][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1082

  SQL
  #60490·Ma77Ball opened Nov 14, 2026Contributor·

  ·

• [SPARK-61525][SQL] Group NaN values in histogram_numeric

  DOCSSQL
  #60489·ViktorBystrov72 opened Nov 14, 2026·

  ·

• [SPARK-61677][SQL] Add variantPrimitivesAsString option to keep primitive values as strings when reading CSV, JSON and XML into VARIANT

  DOCSPYTHONSQL
  #60484·sandip-db opened Nov 14, 2026Contributor·

  ·

• [SPARK-61676][SQL] Fold a conditional expression in ConstantFolding after folding its children

  SQL
  #60480·rdtr opened Nov 14, 2026·

  ·
  1