Messages by Thread
-
[jira] [Created] (SPARK-59058) Backport SharedSparkSession to 4.0+
Jira
-
[jira] [Updated] (SPARK-59056) Pre-size HashSets in ParquetFilters IN/InSet predicate pushdown
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59042) PushProjectionThroughUnion fails on a correlated scalar subquery over UNION ALL
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59056) Pre-size HashSets in ParquetFilters IN/InSet predicate pushdown
David Mollitor (Jira)
-
[jira] [Updated] (SPARK-50569) Clearing dataframes/views persisted in isolated Connect session
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58641) Additional identifier clause testing in Analyzer
Jira
-
[jira] [Resolved] (SPARK-58641) Additional identifier clause testing in Analyzer
Jira
-
[jira] [Updated] (SPARK-59055) Report the application hold status to Spark Master
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59055) Report the application hold status to Spark Master
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59054) Fix KeyGroupedPartitioner to compare partition keys by value in storage-partitioned join shuffles
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59054) Fix silently lost SPJ join matches for binary partition keys when one side is shuffled
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59054) Fix silently lost SPJ join matches for binary partition keys when one side is shuffled
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59053) Warn when the executor pod template's service account drops the configured one
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-59052) Reduce LinearSVCModel transform closure size and improve prediction performance
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59052) Reduce LinearSVCModel transform closure size
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59052) Reduce LinearSVCModel transform closure size
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-57205) Declare SCAN_MERGING on the built-in file sources
Yang Jie (Jira)
-
[jira] [Created] (SPARK-59051) JDBC partition bounds should be compiled via the dialect instead of emitted as plain ISO literals
Jira
-
[jira] [Resolved] (SPARK-58944) Complete cherry pick as part of merge script
Nicholas Chammas (Jira)
-
[jira] [Updated] (SPARK-59050) SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59050) SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins
XiDuo You (Jira)
-
[jira] [Created] (SPARK-59049) Support udf chaining logic for external udfs
Haiyang Sun (Jira)
-
[jira] [Updated] (SPARK-59011) Series.rank with method='first' and ascending=False gives wrong ranks for tied values
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59048) Add column expression hooks to reduce classification transform closure sizes
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59048) Add column expression hooks to reduce classification transform closure sizes
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59047) Avoid retaining random forest tree weights
Ruifeng Zheng (Jira)
-
[jira] [Reopened] (SPARK-58856) Avoid per-leaf map for tree predictions
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59021) Import scg-store-memory and scg-pool-static crates into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-59046) Import scg-store-redis and scg-healthcheck crates into Spark Connect Gateway
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59046) Import scg-store-redis and scg-healthcheck crates into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-59045) Fix SPJ throw ClassCastException with different data type transforms
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59045) Fix ClassCastException in storage-partitioned join with compatible transforms
XiDuo You (Jira)
-
[jira] [Created] (SPARK-59044) Excluding EliminateOffsets causes OFFSET 0 to fail during physical planning
Yibo Dong (Jira)
-
[jira] [Created] (SPARK-59043) SimplifyCaseConversionExpressions changes Unicode case-conversion semantics
Yibo Dong (Jira)
-
[jira] [Created] (SPARK-59042) PushProjectionThroughUnion fails on a correlated scalar subquery over UNION ALL
Yibo Dong (Jira)
-
[jira] [Resolved] (SPARK-59041) [BUILD] Upgrade Jackson from 2.22.0 to 2.22.1
Anoopam Sharma (Jira)
-
[jira] [Created] (SPARK-59041) [BUILD] Upgrade Jackson from 2.22.0 to 2.22.1
Anoopam Sharma (Jira)
-
[jira] [Updated] (SPARK-59040) Assign a name to the error condition _LEGACY_ERROR_TEMP_1166,1167
Yang Jie (Jira)
-
[jira] [Created] (SPARK-59040) Assign a name to the error condition _LEGACY_ERROR_TEMP_1166,1167
Yang Jie (Jira)
-
[jira] [Created] (SPARK-59039) Add a README for our GitHub workflows
Nicholas Chammas (Jira)
-
[jira] [Updated] (SPARK-59038) Avoid broadcasting regression tree models for no-op transforms
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59038) Avoid broadcasting regression tree models for no-op transforms
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59037) Spark Connect Rust client ignores gRPC max message length (128 MiB parsed but never applied)
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59036) Support codegen for array_sort when it's comparator is default
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59037) Spark Connect Rust client ignores gRPC max message length (128 MiB parsed but never applied)
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-59036) Support codegen for array_sort when it's comparator is default
EdisonWang (Jira)
-
[jira] [Updated] (SPARK-58910) Executor pod template's serviceAccountName is overwritten when a service account is configured
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-59001) Empty2Null, text, and Hive prune fallback for CHAR/VARCHAR
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-59001) Empty2Null, text, and Hive prune fallback for CHAR/VARCHAR
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-59008) NullPointerException in ExecutorPodsLifecycleManager when pod is deleted between get() calls
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59008) NullPointerException in ExecutorPodsLifecycleManager when pod is deleted between get() calls
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59035) spark-connect-rust connect-rust-4.2.0 release
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-59034) merge_connect_rust_pr.py should set connect-rust-* fix versions, not core Spark versions
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-59032) Spark Connect client can hang on a wedged stream: gRPC keepalive is parsed but never applied
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-59027) Share grouped partition key ordering between `createShuffleSpec` and `GroupPartitionsExec`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59027) Share grouped partition key ordering between `createShuffleSpec` and `GroupPartitionsExec`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59027) Share grouped partition key ordering between `createShuffleSpec` and `GroupPartitionsExec`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59013) Remove redundant Python 3 boilerplate in PySpark serializers
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-59013) Remove redundant Python 3 boilerplate in PySpark serializers
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-59012) Improve SupportsRuntimeCatalystFiltering test coverage and reject nested filter attributes
Szehon Ho (Jira)
-
[jira] [Created] (SPARK-59035) spark-connect-rust connect-rust-4.2.0 release
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-52428) Develop a spark connect client in rust.
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-59034) merge_connect_rust_pr.py should set connect-rust-* fix versions, not core Spark versions
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59034) merge_connect_rust_pr.py should set connect-rust-* fix versions, not core Spark versions
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-53016) Replace actions-rs/toolchain with dtolnay/rust-toolchain
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-52941) Let GitHub Actions work for spark-connect-rust
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-59033) Coverage badges 404: published to a badges/ subdirectory instead of the branch root
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-59033) Coverage badges 404: published to a badges/ subdirectory instead of the branch root
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59033) Coverage badges 404: published to a badges/ subdirectory instead of the branch root
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-59025) Fix subset join key grouping when the keyed side reports a PartitioningCollection
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59033) Coverage badges 404: published to a badges/ subdirectory instead of the branch root
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-59032) Connect parity CI hangs on test_parity_arrow_python_udf.py
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-59025) Fix subset join key grouping when the keyed side reports a PartitioningCollection
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59022) Storage-partitioned join returns wrong results when the keyed side's partition keys are unsorted
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-59019) Excluding RewriteWithExpression causes an INTERNAL_ERROR for a legal BETWEEN query
Shrirang Mhalgi (Jira)
-
[jira] [Updated] (SPARK-59023) Support none mode in spark.sql.ui.explainMode to skip plan description in SQL events
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59017) Merge script skips or hangs at the Fix Version prompt when no version can be inferred
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-59017) Merge script skips or hangs at the Fix Version prompt when no version can be inferred
Szehon Ho (Jira)
-
[jira] [Updated] (SPARK-59031) Support best-effort Spark Connect commands that no-op when the server does not implement the API
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59031) Support best-effort Spark Connect commands that no-op when the server does not implement the API
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-59028) Transpilation: category inference is quadratic in expression length
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-59022) Storage-partitioned join returns wrong results when the keyed side's partition keys are unsorted
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59030) Support DSv2 Join pushdown for DB2 connector
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59030) Support DSv2 Join pushdown for DB2 connector
Shrirang Mhalgi (Jira)
-
[jira] [Reopened] (SPARK-59016) SimplifyCasts, V2 pushdown schema, and FunctionRegistry inventory for CHAR/VARCHAR
Daniel Tenedorio (Jira)
-
[jira] [Created] (SPARK-59029) Transpilation: resolve `self.<attr>` reads on a callable instance
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-59027) Ensure createShuffleSpec and GroupPartitionsExec sort grouped partition keys identically
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59016) SimplifyCasts, V2 pushdown schema, and FunctionRegistry inventory for CHAR/VARCHAR
Daniel Tenedorio (Jira)
-
[jira] [Assigned] (SPARK-59016) SimplifyCasts, V2 pushdown schema, and FunctionRegistry inventory for CHAR/VARCHAR
Daniel Tenedorio (Jira)
-
[jira] [Updated] (SPARK-58814) Format round-trips Parquet/ORC/Avro/CSV
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59027) Ensure createShuffleSpec and GroupPartitionsExec sort grouped partition keys identically
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59026) Propagate isNarrowed in KeyedPartitioning.toGrouped and KeyedShuffleSpec.createPartitioning
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59026) Propagate isNarrowed in KeyedPartitioning.toGrouped and KeyedShuffleSpec.createPartitioning
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59025) Fix subset join key grouping when the keyed side reports a PartitioningCollection
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59025) Fix subset join key grouping when the keyed side reports a PartitioningCollection
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59024) Support sequential cached name for anonymous cached tables
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59023) Support none mode in spark.sql.ui.explainMode to skip plan description in SQL events
Cheng Pan (Jira)
-
[jira] [Created] (SPARK-59024) Support sequential cached name for anonymous cached tables
Cheng Pan (Jira)
-
[jira] [Resolved] (SPARK-58987) [spark-connect-rust] Faster parity CI, Rust coverage gate, and drop-in pyspark API fidelity
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-58987) [spark-connect-rust] Faster parity CI, Rust coverage gate, and drop-in pyspark API fidelity
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-59022) Storage-partitioned join returns wrong results when the keyed side's partition keys are unsorted
Peter Toth (Jira)
-
[jira] [Created] (SPARK-59022) Storage-partitioned join returns wrong results when the keyed side's partition keys are unsorted
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59018) Add variant_array_length expression
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58991) Remove dead and broken AutoSerializer class
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58991) Remove dead and broken AutoSerializer class
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58601) Tighten mapInPandas return-value contract to require a strict Iterator
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-59021) Import scg-store-memory and scg-pool-static crates into Spark Connect Gateway
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59021) Import scg-store-memory and scg-pool-static crates into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-58988) Fix PartitioningCollection invariant violation exception when allowKeysSubsetOfPartitionKeys
XiDuo You (Jira)
-
[jira] [Resolved] (SPARK-58988) Fix PartitioningCollection invariant violation exception when allowKeysSubsetOfPartitionKeys
XiDuo You (Jira)
-
[jira] [Resolved] (SPARK-58984) Import scg-tenant crate into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Resolved] (SPARK-58993) Use Java HashMap for CountVectorizer vocabulary lookup
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58993) Use Java HashMap for CountVectorizer vocabulary lookup
Ruifeng Zheng (Jira)
-
[jira] [Commented] (SPARK-58974) requireAllClusterKeys bypasses the narrowed-partitioning skew guard in KeyedPartitioning.groupedSatisfies
Peter Toth (Jira)
-
[jira] [Resolved] (SPARK-58932) TransformWithStateInPySparkStateServer leaks the accepted socket
Jungtaek Lim (Jira)
-
[jira] [Assigned] (SPARK-58932) TransformWithStateInPySparkStateServer leaks the accepted socket
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-59020) Support DSv2 Parquet shredded Variant predicate pushdown
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59020) Support DSv2 Parquet shredded Variant predicate pushdown
EdisonWang (Jira)
-
[jira] [Assigned] (SPARK-58601) Tighten mapInPandas return-value contract to require a strict Iterator
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-58601) Tighten mapInPandas return-value contract to require a strict Iterator
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-58993) Use Java HashMap for CountVectorizer vocabulary lookup
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59010) Expose the application hold status through the REST API
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59019) Excluding RewriteWithExpression causes an INTERNAL_ERROR for a legal BETWEEN query
Yibo Dong (Jira)
-
[jira] [Created] (SPARK-59019) Excluding RewriteWithExpression causes an INTERNAL_ERROR for a legal BETWEEN query
Yibo Dong (Jira)
-
[jira] [Assigned] (SPARK-58977) TransformWithState in PySpark state server reports spurious daemon crash during early shutdown
Jungtaek Lim (Jira)
-
[jira] [Resolved] (SPARK-58977) TransformWithState in PySpark state server reports spurious daemon crash during early shutdown
Jungtaek Lim (Jira)
-
[jira] [Resolved] (SPARK-58964) Consolidate vector and matrix UDT column conversion
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58964) Consolidate vector and matrix UDT column conversion
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59018) Add variant_array_length expression
EdisonWang (Jira)
-
[jira] [Updated] (SPARK-59015) Rebind refreshed DSv2 relations to the current table schema
Yan Yan (Jira)
-
[jira] [Updated] (SPARK-59017) Merge script skips or hangs at the Fix Version prompt when no version can be inferred
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59016) SimplifyCasts, V2 pushdown schema, and FunctionRegistry inventory for CHAR/VARCHAR
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59017) Merge script skips or hangs at the Fix Version prompt when no version can be inferred
Szehon Ho (Jira)
-
[jira] [Created] (SPARK-59016) SimplifyCasts, V2 pushdown schema, and FunctionRegistry inventory for CHAR/VARCHAR
Serge Rielau (Jira)
-
[jira] [Created] (SPARK-59015) Rebind refreshed DSv2 relations to the current table schema
Yan Yan (Jira)
-
[jira] [Updated] (SPARK-59014) DataSourceV2 refresh validation misses a data column that hides a captured metadata column
Yan Yan (Jira)
-
[jira] [Created] (SPARK-59014) DataSourceV2 refresh validation misses a data column that hides a captured metadata column
Yan Yan (Jira)
-
[jira] [Resolved] (SPARK-58994) Fix prediction column metadata in GBTRegressionModel
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58994) Fix prediction column metadata in GBTRegressionModel
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59013) Remove redundant Python 3 boilerplate in PySpark serializers
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-59013) Remove redundant Python 3 boilerplate in PySpark serializers
Yicong Huang (Jira)