[jira] [Resolved] (SPARK-50869) Support evaluator

2025-01-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50869. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49547 [https://

[jira] [Resolved] (SPARK-50874) Support LinearRegression on connect

2025-01-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50874. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49553 [https://

[jira] [Created] (SPARK-50884) Evaluator: support isLargerBetter on connect ML

2025-01-17 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50884: -- Summary: Evaluator: support isLargerBetter on connect ML Key: SPARK-50884 URL: https://issues.apache.org/jira/browse/SPARK-50884 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-50855) Spark Connect Support for TransformWithState In Scala

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50855: --- Labels: pull-request-available (was: ) > Spark Connect Support for TransformWithState In Sc

[jira] [Created] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

2025-01-17 Thread Cuong Nguyen (Jira)
Cuong Nguyen created SPARK-50883: Summary: Support altering multiple columns in the same ALTER TABLE command Key: SPARK-50883 URL: https://issues.apache.org/jira/browse/SPARK-50883 Project: Spark

[jira] [Updated] (SPARK-50882) Skip `TPCDSCollationQueryTestSuite.q22-v2.7` test in GitHub Action CI

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50882: --- Labels: pull-request-available (was: ) > Skip `TPCDSCollationQueryTestSuite.q22-v2.7` test

[jira] [Created] (SPARK-50882) Skip `TPCDSCollationQueryTestSuite.q22-v2.7` test in GitHub Action CI

2025-01-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50882: - Summary: Skip `TPCDSCollationQueryTestSuite.q22-v2.7` test in GitHub Action CI Key: SPARK-50882 URL: https://issues.apache.org/jira/browse/SPARK-50882 Project: Spar

[jira] [Assigned] (SPARK-50871) Upgrade `scala-parallel-collections` to 1.2.0

2025-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50871: - Assignee: Yang Jie > Upgrade `scala-parallel-collections` to 1.2.0 > --

[jira] [Resolved] (SPARK-50871) Upgrade `scala-parallel-collections` to 1.2.0

2025-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50871. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49548 [https://

[jira] [Updated] (SPARK-50871) Upgrade `scala-parallel-collections` to 1.2.0

2025-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50871: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `scala-parallel

[jira] [Updated] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50883: --- Labels: pull-request-available (was: ) > Support altering multiple columns in the same ALTE

[jira] [Updated] (SPARK-50453) Upgrade Netty to 4.1.115.Final

2025-01-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50453: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade Netty to 4.1.11

[jira] [Updated] (SPARK-50856) Spark Connect Support for TransformWithStateInPandas In Python

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50856: --- Labels: pull-request-available (was: ) > Spark Connect Support for TransformWithStateInPand

[jira] [Updated] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

2025-01-17 Thread Cuong Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cuong Nguyen updated SPARK-50883: - Description: Current ALTER TABLE ... ALTER COLUMN syntax only allows altering one column at a t

[jira] [Resolved] (SPARK-50652) RocksDB V2 backward compatibility currently not suuported

2025-01-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50652. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49275 [https://gi

[jira] [Assigned] (SPARK-50652) RocksDB V2 backward compatibility currently not suuported

2025-01-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-50652: Assignee: Wei Liu > RocksDB V2 backward compatibility currently not suuported > -

[jira] [Updated] (SPARK-50870) DataSourceV2 relations may contain unresolved cast expressions after materializing current_timestamp()

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50870: --- Labels: pull-request-available (was: ) > DataSourceV2 relations may contain unresolved cast

[jira] [Created] (SPARK-50872) ToPrettyString expression make UI not pretty

2025-01-17 Thread Kent Yao (Jira)
Kent Yao created SPARK-50872: Summary: ToPrettyString expression make UI not pretty Key: SPARK-50872 URL: https://issues.apache.org/jira/browse/SPARK-50872 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-50851) Express ML params with `proto.Expression.Literal`

2025-01-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50851. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49529 [https://

[jira] [Created] (SPARK-50874) Support LinearRegression on connect

2025-01-17 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50874: - Summary: Support LinearRegression on connect Key: SPARK-50874 URL: https://issues.apache.org/jira/browse/SPARK-50874 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50874) Support LinearRegression on connect

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50874: --- Labels: pull-request-available (was: ) > Support LinearRegression on connect >

[jira] [Assigned] (SPARK-50793) MySQL JDBC Connector failed to cast DOUBLE, LONGTEXT, BIGINT and BLOB types

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50793: -- Assignee: (was: Apache Spark) > MySQL JDBC Connector failed to cast DOUBLE, LONGT

[jira] [Assigned] (SPARK-50793) MySQL JDBC Connector failed to cast DOUBLE, LONGTEXT, BIGINT and BLOB types

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50793: -- Assignee: Apache Spark > MySQL JDBC Connector failed to cast DOUBLE, LONGTEXT, BIGINT

[jira] [Created] (SPARK-50880) Add an new visitBinaryComparison method to V2ExpressionSQLBuilder

2025-01-17 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-50880: -- Summary: Add an new visitBinaryComparison method to V2ExpressionSQLBuilder Key: SPARK-50880 URL: https://issues.apache.org/jira/browse/SPARK-50880 Project: Spark

[jira] [Updated] (SPARK-50880) Add a new visitBinaryComparison method to V2ExpressionSQLBuilder

2025-01-17 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-50880: --- Summary: Add a new visitBinaryComparison method to V2ExpressionSQLBuilder (was: Add an new visitBin

[jira] [Updated] (SPARK-50880) Add a new visitBinaryComparison method to V2ExpressionSQLBuilder

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50880: --- Labels: pull-request-available (was: ) > Add a new visitBinaryComparison method to V2Expres

[jira] [Assigned] (SPARK-50739) Changes in ResolveWithCTE.scala to have the analyzer grok recursive anchors

2025-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50739: --- Assignee: Milan Cupac > Changes in ResolveWithCTE.scala to have the analyzer grok recursive

[jira] [Resolved] (SPARK-50739) Changes in ResolveWithCTE.scala to have the analyzer grok recursive anchors

2025-01-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50739. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49351 [https://gith

[jira] [Updated] (SPARK-50869) Support evaluator

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50869: --- Labels: pull-request-available (was: ) > Support evaluator > - > >

[jira] [Created] (SPARK-50870) DataSourceV2 relations may contain unresolved cast expressions after materializing current_timestamp()

2025-01-17 Thread Changgyoo Park (Jira)
Changgyoo Park created SPARK-50870: -- Summary: DataSourceV2 relations may contain unresolved cast expressions after materializing current_timestamp() Key: SPARK-50870 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Updated] (SPARK-50871) Upgrade `scala-parallel-collections` to 1.2.0

2025-01-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50871: - Priority: Minor (was: Major) > Upgrade `scala-parallel-collections` to 1.2.0 >

[jira] [Created] (SPARK-50871) Upgrade `scala-parallel-collections` to 1.2.0

2025-01-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-50871: Summary: Upgrade `scala-parallel-collections` to 1.2.0 Key: SPARK-50871 URL: https://issues.apache.org/jira/browse/SPARK-50871 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-50871) Upgrade `scala-parallel-collections` to 1.2.0

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50871: --- Labels: pull-request-available (was: ) > Upgrade `scala-parallel-collections` to 1.2.0 > --

[jira] [Assigned] (SPARK-50793) MySQL JDBC Connector failed to cast DOUBLE, LONGTEXT, BIGINT and BLOB types

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50793: -- Assignee: (was: Apache Spark) > MySQL JDBC Connector failed to cast DOUBLE, LONGT

[jira] [Assigned] (SPARK-50793) MySQL JDBC Connector failed to cast DOUBLE, LONGTEXT, BIGINT and BLOB types

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50793: -- Assignee: Apache Spark > MySQL JDBC Connector failed to cast DOUBLE, LONGTEXT, BIGINT

[jira] [Assigned] (SPARK-50869) Support evaluator

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50869: -- Assignee: (was: Apache Spark) > Support evaluator > - > >

[jira] [Assigned] (SPARK-50869) Support evaluator

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50869: -- Assignee: Apache Spark > Support evaluator > - > > Ke

[jira] [Updated] (SPARK-50838) Implement checkRecursion to check if all the rules about recursive queries are fulfilled. Adjust optimizer with Unionloop cases.

2025-01-17 Thread Milan Cupac (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Cupac updated SPARK-50838: Description: Add checkRecursion to check if all the rules about recursive queries are fullfilled.

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-01-17 Thread KeKe Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Attachment: query16-org.PNG > An optimization for SparkOptimizer to prune the column in subquery > -

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-01-17 Thread KeKe Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Description: I used Spark 3.5+iceberg 1.6.1 to run TPCDS test. When doing performance analysis, I found

[jira] [Updated] (SPARK-50872) ToPrettyString expression make UI not pretty

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50872: --- Labels: pull-request-available (was: ) > ToPrettyString expression make UI not pretty > ---

[jira] [Created] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-01-17 Thread KeKe Zhu (Jira)
KeKe Zhu created SPARK-50873: Summary: An optimization for SparkOptimizer to prune the column in subquery Key: SPARK-50873 URL: https://issues.apache.org/jira/browse/SPARK-50873 Project: Spark I

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-01-17 Thread KeKe Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Description: I used Spark 3.5+iceberg 1.6.1 to run TPCDS test. When doing performance analysis, I found

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-01-17 Thread KeKe Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Attachment: query16-opt.PNG > An optimization for SparkOptimizer to prune the column in subquery > -

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-01-17 Thread KeKe Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Description: I used Spark 3.5+iceberg 1.6.1 to run TPCDS test. When doing performance analysis, I found

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-01-17 Thread KeKe Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Description: I used Spark 3.5+iceberg 1.6.1 to run TPCDS test. When doing performance analysis, I found

[jira] [Created] (SPARK-50877) Support KMeans & BisectingKMeans on Connect

2025-01-17 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50877: - Summary: Support KMeans & BisectingKMeans on Connect Key: SPARK-50877 URL: https://issues.apache.org/jira/browse/SPARK-50877 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-50878) Support ALS on Connect

2025-01-17 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50878: - Summary: Support ALS on Connect Key: SPARK-50878 URL: https://issues.apache.org/jira/browse/SPARK-50878 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-50879) Support feature scalers on Connect

2025-01-17 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50879: - Summary: Support feature scalers on Connect Key: SPARK-50879 URL: https://issues.apache.org/jira/browse/SPARK-50879 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50875) Add RTRIM collation to TVF

2025-01-17 Thread Stevo Mitric (Jira)
Stevo Mitric created SPARK-50875: Summary: Add RTRIM collation to TVF Key: SPARK-50875 URL: https://issues.apache.org/jira/browse/SPARK-50875 Project: Spark Issue Type: Task Compone

[jira] [Updated] (SPARK-50876) Support Tree Regressors on Connect

2025-01-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50876: -- Summary: Support Tree Regressors on Connect (was: Support Tree Regressor on Connect) > Suppo

[jira] [Updated] (SPARK-50875) Add RTRIM collation to TVF

2025-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50875: --- Labels: pull-request-available (was: ) > Add RTRIM collation to TVF > -