issues  

Messages by Date

• 2026/07/23 [jira] [Assigned] (SPARK-58288) Bump version to 1.1.0-SNAPSHOT in `main` branch Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Resolved] (SPARK-58288) Bump version to 1.1.0-SNAPSHOT in `main` branch Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Updated] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Assigned] (SPARK-56825) Release Spark Kubernetes Operator 1.0.0 Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Updated] (SPARK-58288) Bump version to 1.1.0-SNAPSHOT in `main` branch ASF GitHub Bot (Jira)
• 2026/07/23 [jira] [Created] (SPARK-58288) Bump version to 1.1.0-SNAPSHOT in `main` branch Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Created] (SPARK-58287) Bump version to 1.1.0-SNAPSHOT in `main` branch Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Updated] (SPARK-58285) Remove stale container CI dependency bypasses Ruifeng Zheng (Jira)
• 2026/07/23 [jira] [Created] (SPARK-58286) Release Spark Kubernetes Operator 1.1.0 Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Assigned] (SPARK-58284) Remove duplicated NetworkPolicy creation in favor of NetworkPolicyFeatureStep of Spark 4.2 Dongjoon Hyun (Jira)
• 2026/07/23 [jira] [Resolved] (SPARK-58284) Remove duplicated NetworkPolicy creation in favor of NetworkPolicyFeatureStep of Spark 4.2 Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58285) Remove stale PySpark CI dependency bypass Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58284) Remove duplicated NetworkPolicy creation in favor of NetworkPolicyFeatureStep of Spark 4.2 ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58284) Remove duplicated NetworkPolicy creation in favor of NetworkPolicyFeatureStep of Spark 4.2 Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58283) Assign names to the error conditions _LEGACY_ERROR_TEMP_1138-1141 ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Commented] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58111) Scan and write schema narrowing for column-level UPDATE in DSv2 Anurag Mantripragada (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Commented] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58160) Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58283) Assign names to the error conditions _LEGACY_ERROR_TEMP_1138-1141 Yang Jie (Jira)
• 2026/07/22 [jira] [Comment Edited] (SPARK-58118) Allow a user-specified AUTO CDC streaming-table schema to omit the reserved metadata column Naveen Kumar Puppala (Jira)
• 2026/07/22 [jira] [Commented] (SPARK-58118) Allow a user-specified AUTO CDC streaming-table schema to omit the reserved metadata column Naveen Kumar Puppala (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58277) Stream DataType.json to bound peak driver memory for large schemas ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58282) Refresh PySpark README ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58282) Refresh PySpark README Nicholas Chammas (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-57375) AutoCdcScd1FullRefreshSuite is flaky Andreas Neumann (Jira)
• 2026/07/22 [jira] [Commented] (SPARK-57375) AutoCdcScd1FullRefreshSuite is flaky Andreas Neumann (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58253) Add size estimates for RobustScalerModel, MinMaxScalerModel, MaxAbsScalerModel, and StandardScalerModel Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58253) Add size estimates for RobustScalerModel, MinMaxScalerModel, MaxAbsScalerModel, and StandardScalerModel Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58280) Estimate size of BucketedRandomProjectionLSH and Word2Vec Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58281) Avoid parent overcounting in PipelineModel size estimates Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58280) Estimate size of BucketedRandomProjectionLSH, Word2Vec, and RFormula models Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58279) Estimate size of TargetEncoder, VectorIndexer, CountVectorizer, and MinHashLSH models Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58278) Estimate size of Univariate, ChiSq, Variance selector, and Imputer models Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58251) Add size estimates for OneHotEncoderModel, PCAModel, StringIndexerModel, and IDFModel Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58251) Add size estimates for OneHotEncoderModel, PCAModel, StringIndexerModel, and IDFModel Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58277) Stream DataType.json to bound peak driver memory for large schemas Ben Hollis (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58275) Add normalize Unicode normalization SQL function ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58263) [Part3] Concurrently schedule pipelined-shuffle stage groups in the DAGScheduler ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58276) Consolidate serializer selection branches in worker.py Yicong Huang (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58276) Consolidate serializer selection branches in worker.py ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58276) Consolidate serializer selection branches in worker.py Yicong Huang (Jira)
• 2026/07/22 [jira] [Commented] (SPARK-52246) SPJ: Support auto-shuffle one side + less join keys than partition keys produces incorrect results Naveen Kumar Puppala (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58275) Add normalize Unicode normalization SQL function sreeramayeshwanthgowd (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58247) Support for SCD Type 2 in Python and Spark Connect APIs Szehon Ho (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58247) Support for SCD Type 2 in Python and Spark Connect APIs Szehon Ho (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58247) Support for SCD Type 2 in Python and Spark Connect APIs Szehon Ho (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58274) Assign a name to the error condition _LEGACY_ERROR_TEMP_1068 Matthew Ball (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58267) Assign a name to the error condition _LEGACY_ERROR_TEMP_1059 ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-57378) Implement SCD2 Batch Processor; Merge Reconciled Rows into Aux and Target Tables ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58272) Enable runtime Bloom filters for safely materialized cached join inputs ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-52246) SPJ: Support auto-shuffle one side + less join keys than partition keys produces incorrect results ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58273) Do not auto-fill generated columns for by-position schema evolution ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58273) Do not auto-fill generated columns for by-position schema evolution Szehon Ho (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58273) Disallow missing generated column specification for Insert Schema Evolution by position Szehon Ho (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58272) Enable runtime Bloom filters for safely materialized cached join inputs Chao Sun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-57356) Implement SCD2 Batch Processor; Cleanup Delete Encoding Rows Post-Reconciliation Szehon Ho (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-57356) Implement SCD2 Batch Processor; Cleanup Delete Encoding Rows Post-Reconciliation Szehon Ho (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58244) Remove type: ignore[name-defined] in pyspark.sql Tian Gao (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58244) Remove type: ignore[name-defined] in pyspark.sql Tian Gao (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58271) Flexible ordering of AUTO CDC clauses Andreas Neumann (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58270) Improve lexing/parsing for SCD TYPE Andreas Neumann (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58266) Assign a name to the error condition _LEGACY_ERROR_TEMP_1058 ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58269) Infer generated column partition filters ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58269) Infer generated column partition filters Szehon Ho (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58268) Disable GC for Config gRPC to avoid deadlock Tian Gao (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58268) Disable GC for Config gRPC to avoid deadlock Tian Gao (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58157) Remove TransformWithStateInPySparkRowInitStateSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58157) Remove TransformWithStateInPySparkRowInitStateSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58268) Disable GC for Config gRPC to avoid deadlock Tian Gao (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58268) Disable GC for Config gRPC to avoid deadlock ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58157) Remove TransformWithStateInPySparkRowInitStateSerializer ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58266) Assign a name to the error condition _LEGACY_ERROR_TEMP_1058 Matthew Ball (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58267) Assign a name to the error condition _LEGACY_ERROR_TEMP_1059 Matthew Ball (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58265) Reuse projected broadcast values for dynamic partition pruning ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58242) Run branch-4.2 tests on branch-4.2 instead of master Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58242) Run branch-4.2 tests on branch-4.2 instead of master Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58265) Reuse projected broadcast values for dynamic partition pruning Chao Sun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58264) Use OS-assigned ports for Spark Connect server test lifecycle ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58264) Use OS-assigned ports for Spark Connect server test lifecycle Matthew Ball (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58236) Fix hash codegen dropping the CalendarInterval days field Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58236) Fix hash codegen dropping the CalendarInterval days field Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58165) SubqueryExpression drops nested subquery plans in IN values, breaking IN-over-subquery on Spark Connect Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58165) SubqueryExpression drops nested subquery plans in IN values, breaking IN-over-subquery on Spark Connect Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58165) SubqueryExpression drops nested subquery plans in IN values, breaking IN-over-subquery on Spark Connect Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58256) Fix npm vulnerabilities in dev and ui-test Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58252) Throw GROUP_BY_POS_OUT_OF_RANGE for out-of-range ordinal in pipe AGGREGATE GROUP BY Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58252) Throw GROUP_BY_POS_OUT_OF_RANGE for out-of-range ordinal in pipe AGGREGATE GROUP BY Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58256) Fix npm vulnerabilities in dev and ui-test Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-54946) Add tests for pa.Array.to_pandas with coerce_temporal_nanoseconds ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58263) [Part3] Concurrently schedule pipelined-shuffle stage groups in the DAGScheduler Boyang Jerry Peng (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58078) [Part1] Add PipelinedShuffleDependency Boyang Jerry Peng (Jira)
• 2026/07/22 [jira] [Commented] (SPARK-58078) [Part1] Add PipelinedShuffleDependency Boyang Jerry Peng (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58261) Support for SCD Type 2 in SQL syntax ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58262) Remove ArrowStreamPandasUDFSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58157) Remove TransformWithStateInPySparkRowInitStateSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58262) Remove ArrowStreamPandasUDFSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58262) Remove ArrowStreamPandasUDFSerializer ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58262) Remove unused ArrowStreamPandasUDFSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Comment Edited] (SPARK-52246) SPJ: Support auto-shuffle one side + less join keys than partition keys produces incorrect results Peter Toth (Jira)
• 2026/07/22 [jira] [Commented] (SPARK-52246) SPJ: Support auto-shuffle one side + less join keys than partition keys produces incorrect results Peter Toth (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58261) Support for SCD Type 2 in SQL syntax Andreas Neumann (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58261) Support for SCD Type 2 in SQL syntax Andreas Neumann (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-57465) `RejectedExecutionException` can consume all retries for a task Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-57465) `RejectedExecutionException` can consume all retries for a task Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58251) Add size estimates for OneHotEncoderModel, PCAModel, StringIndexerModel, and IDFModel ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58243) Remove unused ApplyInPandasWithStateSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58243) Remove unused ApplyInPandasWithStateSerializer Yicong Huang (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58191) Refactor SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_UDF and SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF Yicong Huang (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58191) Refactor SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_UDF and SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF Yicong Huang (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58191) Refactor SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_UDF and SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF Yicong Huang (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58029) Backtick the `*` selector in breeze.linalg import for Scala 3 compatibility Jira
• 2026/07/22 [jira] [Resolved] (SPARK-58029) Backtick the `*` selector in breeze.linalg import for Scala 3 compatibility Jira
• 2026/07/22 [jira] [Resolved] (SPARK-58184) Remove dead ExternalBlockStore executor exit codes Jira
• 2026/07/22 [jira] [Assigned] (SPARK-58184) Remove dead ExternalBlockStore executor exit codes Jira
• 2026/07/22 [jira] [Assigned] (SPARK-58195) Upgrade ORC to 2.3.1 Jira
• 2026/07/22 [jira] [Resolved] (SPARK-58195) Upgrade ORC to 2.3.1 Jira
• 2026/07/22 [jira] [Resolved] (SPARK-58233) Push down local sort to reduce redundant sorts within a stage Jira
• 2026/07/22 [jira] [Assigned] (SPARK-58233) Push down local sort to reduce redundant sorts within a stage Jira
• 2026/07/22 [jira] [Updated] (SPARK-58253) Add size estimates for RobustScalerModel, MinMaxScalerModel, MaxAbsScalerModel, and StandardScalerModel ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58065) Add support for column lists in the `INSERT REPLACE WHERE` statement Wenchen Fan (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58065) Add support for column lists in the `INSERT REPLACE WHERE` statement Wenchen Fan (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58185) [Part2] Route shuffles to a ShuffleManager by dependency type Wenchen Fan (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58185) [Part2] Route shuffles to a ShuffleManager by dependency type Wenchen Fan (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58226) DDL table resolution does not respect persistentCatalogFirst setting ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-53154) Add HMAC to pyspark.sql.functions Wenchen Fan (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58250) Add OneVsRest size estimate Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-53154) Add HMAC to pyspark.sql.functions Wenchen Fan (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-53154) Add HMAC to pyspark.sql.functions Wenchen Fan (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58249) Use native functions for NumPy math ufuncs ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58176) ASOF JOIN: Docs Wenchen Fan (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58176) ASOF JOIN: Docs Wenchen Fan (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58249) Use native functions for NumPy math ufuncs Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58249) Use native functions for NumPy math ufuncs Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58250) Add OneVsRest size estimate Ruifeng Zheng (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58250) Add OneVsRest size estimate ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58245) Fix AsyncEventQueue Shutdown Hang When Poison Pill Enqueue Is Interrupted Wenchen Fan (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58245) Fix AsyncEventQueue Shutdown Hang When Poison Pill Enqueue Is Interrupted Wenchen Fan (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-57822) Support Parquet predicate pushdown for nanosecond-precision timestamps ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58260) Add config to render Hive DDL in SHOW CREATE TABLE for Hive tables ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58260) Add config to render Hive DDL in SHOW CREATE TABLE for Hive tables Cheng Pan (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58259) Remove Jackson version declarations managed by jackson-bom Gilles Peiffer (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58259) Remove Jackson version declarations managed by jackson-bom Gilles Peiffer (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58255) Upgrade PostgreSQL JDBC driver to 42.7.13 Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58255) Upgrade PostgreSQL JDBC driver to 42.7.13 Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58258) Gate the columnar Arrow Python UDF passthrough on the vector shape matching the declared schema ASF GitHub Bot (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58258) Gate the columnar Arrow Python UDF passthrough on the vector shape matching the declared schema L. C. Hsieh (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58254) Upgrade `swift-system` to 1.7.5 Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Assigned] (SPARK-58254) Upgrade `swift-system` to 1.7.5 Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Resolved] (SPARK-58254) Upgrade `swift-system` to 1.7.5 Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-58241) Columnar Arrow Python UDF runner writes the input schema in the legacy protocol position, hanging the worker L. C. Hsieh (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-51531) Proper StructType for Schema Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-52387) Migrate to use the official Apache Arrow Swift package Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-51530) Client should support re-attachable execution Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-52747) Support timezone variations Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-52746) Fix `isLocal` Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Updated] (SPARK-54999) Re-enable `ConstraintTests` by moving into `IcebergTests` Dongjoon Hyun (Jira)
• 2026/07/22 [jira] [Created] (SPARK-58257) Release Spark Connect Swift Client 0.8.0 Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-58256) Fix npm vulnerabilities in dev and ui-test ASF GitHub Bot (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58256) Fix npm vulnerabilities in dev and ui-test Yang Jie (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-57877) DirectByteBuffer cleaner support Java 26 Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Assigned] (SPARK-57877) DirectByteBuffer cleaner support Java 26 Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-47013) Promote `spark.sql.streaming.minBatchesToRetain` to a public config Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-47013) Promote `spark.sql.streaming.minBatchesToRetain` to a public config Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Assigned] (SPARK-47013) Document the config spark.sql.streaming.minBatchesToRetain Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-47013) Promote `spark.sql.streaming.minBatchesToRetain` to a public config Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-47013) Document the config spark.sql.streaming.minBatchesToRetain Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-47013) Promote `spark.sql.streaming.minBatchesToRetain` to a public config Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-58255) Upgrade PostgreSQL JDBC driver to 42.7.13 ASF GitHub Bot (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58255) Upgrade PostgreSQL JDBC driver to 42.7.13 Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-58254) Upgrade `swift-system` to 1.7.5 ASF GitHub Bot (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58254) Upgrade `swift-system` to 1.7.5 Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Assigned] (SPARK-58178) Spark version comparison uses string and fails with 10 and 9 :p Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-58178) Spark version comparison uses string and fails with 10 and 9 :p Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-58178) Spark version comparison uses string and fails with 10 and 9 :p Dongjoon Hyun (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58253) Add size estimates for RobustScalerModel, MinMaxScalerModel, MaxAbsScalerModel, and StandardScalerModel Ruifeng Zheng (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-58252) Throw GROUP_BY_POS_OUT_OF_RANGE for out-of-range ordinal in pipe AGGREGATE GROUP BY ASF GitHub Bot (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58252) Throw GROUP_BY_POS_OUT_OF_RANGE for out-of-range ordinal in pipe AGGREGATE GROUP BY Yang Jie (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-58238) Assign names to the error conditions _LEGACY_ERROR_TEMP_3093-3095 Yang Jie (Jira)
• 2026/07/21 [jira] [Assigned] (SPARK-58238) Assign names to the error conditions _LEGACY_ERROR_TEMP_3093-3095 Yang Jie (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58251) Add size estimates for OneHotEncoderModel, PCAModel, StringIndexerModel, and IDFModel Ruifeng Zheng (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58250) Add OneVsRest size estimate Ruifeng Zheng (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-58181) Improve connect ML model size estimation ASF GitHub Bot (Jira)
• 2026/07/21 [jira] [Commented] (SPARK-52246) SPJ: Support auto-shuffle one side + less join keys than partition keys produces incorrect results Naveen Kumar Puppala (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-58246) [SQL] 7z archive read support Wenchen Fan (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58249) Use native functions for NumPy math ufuncs Ruifeng Zheng (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-58211) [SQL] Subexpression elimination evaluates short-circuited AND/OR operands, causing spurious errors Wenchen Fan (Jira)
• 2026/07/21 [jira] [Assigned] (SPARK-58211) [SQL] Subexpression elimination evaluates short-circuited AND/OR operands, causing spurious errors Wenchen Fan (Jira)
• 2026/07/21 [jira] [Assigned] (SPARK-58223) SparkSession.Builder.classic() builds a Connect session instead of a Classic one Yang Jie (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-58223) SparkSession.Builder.classic() builds a Connect session instead of a Classic one Yang Jie (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-58173) ASOF JOIN: SQL Function Verification Tests Wenchen Fan (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-55749) array_contains built in function result are inconsistent with other engines ASF GitHub Bot (Jira)
• 2026/07/21 [jira] [Created] (SPARK-58248) [SQL] Reuse single line inference path for JSON/XML archive inference Akshat Shenoi (Jira)
• 2026/07/21 [jira] [Updated] (SPARK-58241) Columnar Arrow Python UDF runner writes the input schema in the legacy protocol position, hanging the worker L. C. Hsieh (Jira)
• 2026/07/21 [jira] [Assigned] (SPARK-58241) Columnar Arrow Python UDF runner writes the input schema in the legacy protocol position, hanging the worker L. C. Hsieh (Jira)
• 2026/07/21 [jira] [Resolved] (SPARK-58241) Columnar Arrow Python UDF runner writes the input schema in the legacy protocol position, hanging the worker L. C. Hsieh (Jira)

• Earlier messages
• Later messages