All pull requests

Pull requests

• [SPARK-60309][SQL] Fix mode to count binary values by content instead of by reference

  #59567·dongjoon-hyun opened Oct 17, 2026Member·

  ·

• [WIP][SQL] Avoid copying byte-array-backed strings in Parquet writes

  #59566·saths008 opened Oct 17, 2026·

  ·

• [SPARK-60305][PYTHON] Keep the Python runner's input buffer alive when an Arrow write is interrupted

  #59565·viirya opened Oct 17, 2026Member·

  ·

• [SPARK-60308][SQL][WEBUI] Fix exponential re-renders on stage/task checkbox clicks in SQL plan detailed mode

  #59564·dongjoon-hyun opened Oct 17, 2026Member·

  ·

• [SPARK-XXXXX][CONNECT][PYTHON] Use FieldDescriptor.is_repeated when truncating plans for logging

  #59563·RamonZhou opened Oct 16, 2026Contributor·

  ·

• [SPARK-60301] Use the session time zone when printing variant values as strings

  #59561·chenhao-db opened Oct 16, 2026Contributor·

  ·
  1

• [SPARK-39142][SPARK-42235][PYTHON] Fix type checker errors for pandas_udf without functionType

  #59558·hzmsh opened Oct 16, 2026·

  ·
  1

• [SPARK-52878][SQL] Rewrite LogicalRDD attribute references by exprId to fix checkpoint with case-insensitive references

  #59557·mbyne opened Oct 16, 2026·

  ·

• [SPARK-60293][SQL] Resolve Parquet pushed filters and vectorized read types by field id

  #59552·andygrove opened Oct 16, 2026Member·

  ·

• [SPARK-60294][SQL] Copy the pass-through columns of Arrow-backed input to Python UDFs

  #59551·HyukjinKwon opened Oct 16, 2026Member·

  ·
  23

• [SPARK-60285][PYTHON][TESTS] Add tests for ReadLimitRegistry

  #59550·soaring0616 opened Oct 16, 2026Contributor·

  ·

• [SPARK-60283][CONNECT] Validate Spark Connect JDBC connections against the server in isValid

  #59549·j1wonpark opened Oct 16, 2026Contributor·

  ·

• [SPARK-56891][CONNECT] Use session user for SQL current user functions

  #59548·j1wonpark opened Oct 16, 2026Contributor·

  ·

• [SPARK-60281][INFRA] Upgrade AnchorJS to v5.0.0

  #59547·nchammas opened Oct 16, 2026Contributor·

  ·

• [MINOR][DOC] Correct PostgreSQL JDBC truncate documentation

  #59546·hunnguye opened Oct 16, 2026·

  ·

• [SPARK-60032][SQL] Do not freeze the current time and the like in a CHECK constraint added by ALTER TABLE

  #59545·LuciferYang opened Oct 16, 2026Contributor·

  ·

• [SPARK-60203][SQL][4.0] Fix SPJ originalPartitionValues when join keys are a subset of partition keys

  #59544·ammarchalifah opened Oct 16, 2026·

  ·
  3

• [SPARK-60280][PYTHON] Replace _is_iter_based with an EvalTypeHandler class property

  #59543·Yicong-Huang opened Oct 16, 2026Contributor·

  ·

• [SPARK-59854][SQL] Report the column in decoding errors of the vectorized Parquet reader

  #59542·viirya opened Oct 16, 2026Member·

  ·
  33

• [SPARK-60279][CONNECT][PYTHON] Fix Spark Connect pivot rejecting None, date and Decimal values

  #59541·hzmsh opened Oct 16, 2026·

  ·
  1

• [CONNECT] Support client-generated checkpoint relation IDs

  #59540·zhengruifeng opened Oct 16, 2026Contributor·

  ·

• [CORE][ML] Register classification tree nodes with Kryo

  #59539·luka-erceg-data-oss opened Oct 16, 2026·

  ·
  4

• [SPARK-37553][PS] Fix DataFrame.pivot_table with multiple values when names contain underscores

  #59538·hzmsh opened Oct 16, 2026·

  ·
  1

• [SPARK-60278][SDP] SCD1 Ignore-null support; Merge to target table before auxiliary table

  #59537·AnishMahto opened Oct 16, 2026Contributor·

  ·

• [MINOR][SQL] Fix the @since version of ORC Types Framework ops that ship in Spark 4.3.0

  #59536·cloud-fan opened Oct 16, 2026Contributor·

  ·
  1