[jira] [Commented] (SPARK-50903) Plan cache may contain yet-to-be analyzed plans

2025-01-21 Thread ci-cassandra.apache.org (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915712#comment-17915712 ] ci-cassandra.apache.org commented on SPARK-50903: - User 'changgyoopark-d

[jira] [Updated] (SPARK-50904) Fix collation expression walker query execution

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50904: --- Labels: pull-request-available (was: ) > Fix collation expression walker query execution >

[jira] [Assigned] (SPARK-50582) Add quote builtin function

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50582: -- Assignee: Kousuke Saruta (was: Apache Spark) > Add quote builtin function >

[jira] [Assigned] (SPARK-50582) Add quote builtin function

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50582: -- Assignee: Apache Spark (was: Kousuke Saruta) > Add quote builtin function >

[jira] [Created] (SPARK-50904) Fix collation expression walker query execution

2025-01-21 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-50904: - Summary: Fix collation expression walker query execution Key: SPARK-50904 URL: https://issues.apache.org/jira/browse/SPARK-50904 Project: Spark Issue Type:

[jira] [Commented] (SPARK-50617) Improve auto-generated column aliases for aggregate expressions

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915742#comment-17915742 ] Dongjoon Hyun commented on SPARK-50617: --- Hi, [~dtenedor]. Can we add this before F

[jira] [Created] (SPARK-50905) Rename `Customer*` to `Custom*` in `SparkSessionExtensionSuite`

2025-01-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50905: - Summary: Rename `Customer*` to `Custom*` in `SparkSessionExtensionSuite` Key: SPARK-50905 URL: https://issues.apache.org/jira/browse/SPARK-50905 Project: Spark

[jira] [Updated] (SPARK-50905) Rename `Customer*` to `Custom*` in `SparkSessionExtensionSuite`

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50905: --- Labels: pull-request-available (was: ) > Rename `Customer*` to `Custom*` in `SparkSessionEx

[jira] [Assigned] (SPARK-50751) Assign appropriate error condition for _LEGACY_ERROR_TEMP_1305: UNSUPPORTED_TABLE_CHANGE_IN_JDBC_CATALOG

2025-01-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50751: Assignee: Haejoon Lee > Assign appropriate error condition for _LEGACY_ERROR_TEMP_1305: > UNSUPP

[jira] [Assigned] (SPARK-50898) Support FPGrowth on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50898: - Assignee: Ruifeng Zheng > Support FPGrowth on connect > --- > >

[jira] [Resolved] (SPARK-50898) Support FPGrowth on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50898. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49579 [https://

[jira] [Resolved] (SPARK-50879) Support feature scalers on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50879. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49581 [https://

[jira] [Resolved] (SPARK-50617) Improve auto-generated column aliases for aggregate expressions

2025-01-21 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-50617. Resolution: Fixed > Improve auto-generated column aliases for aggregate expressions >

[jira] [Updated] (SPARK-45013) Flaky Test with NPE: track allocated resources by taskId

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45013: -- Fix Version/s: 3.5.5 > Flaky Test with NPE: track allocated resources by taskId >

[jira] [Resolved] (SPARK-50905) Rename `Customer*` to `Custom*` in `SparkSessionExtensionSuite`

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50905. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49587 [https://

[jira] [Updated] (SPARK-48163) Fix Flaky Test: `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48163: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix Flaky Test: `SparkConnectSe

[jira] [Updated] (SPARK-48163) Fix Flaky Test: `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48163: -- Summary: Fix Flaky Test: `SparkConnectServiceSuite.SPARK-43923: commands send events - get_res

[jira] [Updated] (SPARK-48163) Fix Flaky Test: `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48163: -- Description: This is a long standing flakiness from early 2024 to now. - https://github.com/ap

[jira] [Resolved] (SPARK-50902) Add `CRC32C` test cases

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50902. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49582 [https://

[jira] [Resolved] (SPARK-50904) Fix collation expression walker query execution

2025-01-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50904. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49586 [https://github.com

[jira] [Resolved] (SPARK-50895) Create common interface for expressions which produce default string type

2025-01-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50895. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49576 [https://github.com

[jira] [Assigned] (SPARK-50895) Create common interface for expressions which produce default string type

2025-01-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50895: Assignee: Stefan Kandic > Create common interface for expressions which produce default string ty

[jira] [Assigned] (SPARK-50904) Fix collation expression walker query execution

2025-01-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50904: Assignee: Stefan Kandic > Fix collation expression walker query execution > -

[jira] [Resolved] (SPARK-49555) SQL Pipe Syntax

2025-01-21 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-49555. Fix Version/s: 4.0.0 Resolution: Fixed > SQL Pipe Syntax > --- > > Key:

[jira] [Resolved] (SPARK-50880) Add a new visitBinaryComparison method to V2ExpressionSQLBuilder

2025-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50880. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49556 [https://gith

[jira] [Created] (SPARK-50903) Plan cache may contain yet-to-be analyzed plans

2025-01-21 Thread Changgyoo Park (Jira)
Changgyoo Park created SPARK-50903: -- Summary: Plan cache may contain yet-to-be analyzed plans Key: SPARK-50903 URL: https://issues.apache.org/jira/browse/SPARK-50903 Project: Spark Issue Typ

[jira] [Commented] (SPARK-38794) When ConfigMap creation fails, Spark driver starts but fails to start executors

2025-01-21 Thread zuotingbing (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17914918#comment-17914918 ] zuotingbing commented on SPARK-38794: - Is there a solution to the bug? > When Confi

[jira] [Created] (SPARK-50910) Fix flaky test KafkaMicroBatchV1SourceWithConsumerSuite

2025-01-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50910: Summary: Fix flaky test KafkaMicroBatchV1SourceWithConsumerSuite Key: SPARK-50910 URL: https://issues.apache.org/jira/browse/SPARK-50910 Project: Spark Issue

[jira] [Created] (SPARK-50912) Skip FrameTakeAdvParityTests.test_take_adv because of OOM for now

2025-01-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50912: Summary: Skip FrameTakeAdvParityTests.test_take_adv because of OOM for now Key: SPARK-50912 URL: https://issues.apache.org/jira/browse/SPARK-50912 Project: Spark

[jira] [Updated] (SPARK-50912) Skip FrameTakeAdvParityTests.test_take_adv because of OOM for now

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50912: --- Labels: pull-request-available (was: ) > Skip FrameTakeAdvParityTests.test_take_adv because

[jira] [Resolved] (SPARK-50912) Skip FrameTakeAdvParityTests.test_take_adv because of OOM for now

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50912. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Fixed Resolved in http

[jira] [Updated] (SPARK-50908) Fix flacky pyspark.sql.tests.pandas.test_pandas_transform_with_state.TransformWithStateInPandasTests

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-50908: - Summary: Fix flacky pyspark.sql.tests.pandas.test_pandas_transform_with_state.TransformWithState

[jira] [Created] (SPARK-50909) Setup faulthandler in PythonPlannerRunners.

2025-01-21 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-50909: - Summary: Setup faulthandler in PythonPlannerRunners. Key: SPARK-50909 URL: https://issues.apache.org/jira/browse/SPARK-50909 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-50911) Skip FrameParityTakeTests.test_take because of OOM for now

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915877#comment-17915877 ] Hyukjin Kwon commented on SPARK-50911: -- Fixed in https://github.com/apache/spark/pu

[jira] [Created] (SPARK-50911) Skip FrameParityTakeTests.test_take because of OOM for now

2025-01-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50911: Summary: Skip FrameParityTakeTests.test_take because of OOM for now Key: SPARK-50911 URL: https://issues.apache.org/jira/browse/SPARK-50911 Project: Spark Is

[jira] [Resolved] (SPARK-50911) Skip FrameParityTakeTests.test_take because of OOM for now

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50911. -- Assignee: Hyukjin Kwon Resolution: Duplicate > Skip FrameParityTakeTests.test_take becau

[jira] [Updated] (SPARK-50901) Support transformers

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50901: --- Labels: pull-request-available (was: ) > Support transformers > > >

[jira] [Updated] (SPARK-50909) Setup faulthandler in PythonPlannerRunners.

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50909: --- Labels: pull-request-available (was: ) > Setup faulthandler in PythonPlannerRunners. >

[jira] [Updated] (SPARK-50460) Generalize and simplify Connect exception handling

2025-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-50460: Parent: SPARK-50916 Issue Type: Sub-task (was: Improvement) > Generalize and simplify Con

[jira] [Updated] (SPARK-50916) Generalize error handling

2025-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-50916: Summary: Generalize error handling (was: Generalize Spark errors) > Generalize error handling > -

[jira] [Updated] (SPARK-50918) Support PipelineModel on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50918: -- Summary: Support PipelineModel on connect (was: Support Pipeline on connect) > Support Pipel

[jira] [Updated] (SPARK-50918) Support Pipeline on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50918: -- Summary: Support Pipeline on connect (was: Support PipelineModel on connect) > Support Pipel

[jira] [Updated] (SPARK-50918) Support Pipeline on connect

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50918: --- Labels: pull-request-available (was: ) > Support Pipeline on connect >

[jira] [Created] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

2025-01-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-50946: Summary: When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail. Key: SPARK-50946 URL: https://issues.apache.org/jira/browse/SPARK-50946

[jira] [Updated] (SPARK-50617) Improve auto-generated column aliases for aggregate expressions

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50617: --- Labels: pull-request-available (was: ) > Improve auto-generated column aliases for aggregat

[jira] [Updated] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

2025-01-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50946: - Description: {code:java} java -version openjdk version "17.0.13" 2024-10-15 LTS OpenJDK Runtime Environm

[jira] [Resolved] (SPARK-50820) Data Source V2: Conditional nullification of metadata columns in DML

2025-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50820. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49493 [https://gith

[jira] [Assigned] (SPARK-50820) Data Source V2: Conditional nullification of metadata columns in DML

2025-01-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50820: --- Assignee: Anton Okolnychyi > Data Source V2: Conditional nullification of metadata columns

[jira] [Updated] (SPARK-50915) Add getCondition and deprecate getErrorClass in PySparkException

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50915: --- Labels: pull-request-available (was: ) > Add getCondition and deprecate getErrorClass in Py

[jira] [Assigned] (SPARK-50913) Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evaluator

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50913: Assignee: Hyukjin Kwon > Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evalua

[jira] [Resolved] (SPARK-50913) Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evaluator

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50913. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49595 [https://gi

[jira] [Updated] (SPARK-50913) Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evaluator

2025-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50913: --- Labels: pull-request-available (was: ) > Fix flaky EvaluationTestsOnConnect.test_binary_cla

[jira] [Assigned] (SPARK-50913) Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evaluator

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50913: Assignee: Ruifeng Zheng (was: Hyukjin Kwon) > Fix flaky EvaluationTestsOnConnect.test_bi

[jira] [Updated] (SPARK-50913) Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evaluator

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-50913: - Fix Version/s: 4.0.0 (was: 4.1.0) > Fix flaky EvaluationTestsOnConnect.te

[jira] [Created] (SPARK-50940) Support CrossValidator on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50940: - Summary: Support CrossValidator on Connect Key: SPARK-50940 URL: https://issues.apache.org/jira/browse/SPARK-50940 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50941) Support TrainValidationSplit on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50941: - Summary: Support TrainValidationSplit on Connect Key: SPARK-50941 URL: https://issues.apache.org/jira/browse/SPARK-50941 Project: Spark Issue Type: Sub-tas

[jira] [Assigned] (SPARK-50941) Support TrainValidationSplit on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50941: - Assignee: Ruifeng Zheng > Support TrainValidationSplit on Connect > ---

[jira] [Created] (SPARK-50938) Support VectorSlicer on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50938: - Summary: Support VectorSlicer on Connect Key: SPARK-50938 URL: https://issues.apache.org/jira/browse/SPARK-50938 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50945) Support Summarizer on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50945: - Summary: Support Summarizer on Connect Key: SPARK-50945 URL: https://issues.apache.org/jira/browse/SPARK-50945 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-50944) Support KolmogorovSmirnovTest on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50944: - Assignee: (was: Ruifeng Zheng) > Support KolmogorovSmirnovTest on Connect > ---

[jira] [Assigned] (SPARK-50942) Support ChiSquareTest on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50942: - Assignee: (was: Ruifeng Zheng) > Support ChiSquareTest on Connect > ---

[jira] [Created] (SPARK-50944) Support KolmogorovSmirnovTest on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50944: - Summary: Support KolmogorovSmirnovTest on Connect Key: SPARK-50944 URL: https://issues.apache.org/jira/browse/SPARK-50944 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-50934) Support CountVectorizer on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50934: - Summary: Support CountVectorizer on Connect Key: SPARK-50934 URL: https://issues.apache.org/jira/browse/SPARK-50934 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50926) Support IsotonicRegression on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50926: - Summary: Support IsotonicRegression on Connect Key: SPARK-50926 URL: https://issues.apache.org/jira/browse/SPARK-50926 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50922) Support OneVsRest ON Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50922: - Summary: Support OneVsRest ON Connect Key: SPARK-50922 URL: https://issues.apache.org/jira/browse/SPARK-50922 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50928) Support GaussianMixture on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50928: - Summary: Support GaussianMixture on Connect Key: SPARK-50928 URL: https://issues.apache.org/jira/browse/SPARK-50928 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50927) Support FMRegressor on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50927: - Summary: Support FMRegressor on Connect Key: SPARK-50927 URL: https://issues.apache.org/jira/browse/SPARK-50927 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50929) Support LDA on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50929: - Summary: Support LDA on Connect Key: SPARK-50929 URL: https://issues.apache.org/jira/browse/SPARK-50929 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-50933) Support Feature Selectors on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50933: - Summary: Support Feature Selectors on Connect Key: SPARK-50933 URL: https://issues.apache.org/jira/browse/SPARK-50933 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50935) Support DCT on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50935: - Summary: Support DCT on Connect Key: SPARK-50935 URL: https://issues.apache.org/jira/browse/SPARK-50935 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-50925) Support GeneralizedLinearRegression on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50925: - Summary: Support GeneralizedLinearRegression on Connect Key: SPARK-50925 URL: https://issues.apache.org/jira/browse/SPARK-50925 Project: Spark Issue Type:

[jira] [Created] (SPARK-50924) Support AFTSurvivalRegression on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50924: - Summary: Support AFTSurvivalRegression on Connect Key: SPARK-50924 URL: https://issues.apache.org/jira/browse/SPARK-50924 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-50930) Support PowerIterationClustering ON Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50930: - Summary: Support PowerIterationClustering ON Connect Key: SPARK-50930 URL: https://issues.apache.org/jira/browse/SPARK-50930 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-50931) Support Binarizer on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50931: - Summary: Support Binarizer on connect Key: SPARK-50931 URL: https://issues.apache.org/jira/browse/SPARK-50931 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50936) Support HashingTF and IDF on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50936: - Summary: Support HashingTF and IDF on connect Key: SPARK-50936 URL: https://issues.apache.org/jira/browse/SPARK-50936 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50939) Support Word2Vec on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50939: - Summary: Support Word2Vec on Connect Key: SPARK-50939 URL: https://issues.apache.org/jira/browse/SPARK-50939 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50937) Support Imputer on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50937: - Summary: Support Imputer on Connect Key: SPARK-50937 URL: https://issues.apache.org/jira/browse/SPARK-50937 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-50943) Support Correlation on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50943: - Summary: Support Correlation on Connect Key: SPARK-50943 URL: https://issues.apache.org/jira/browse/SPARK-50943 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-50899) Support PrefixSpan on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50899: - Assignee: Ruifeng Zheng > Support PrefixSpan on connect > -

[jira] [Created] (SPARK-50942) Support ChiSquareTest on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50942: - Summary: Support ChiSquareTest on Connect Key: SPARK-50942 URL: https://issues.apache.org/jira/browse/SPARK-50942 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50932) Support Bucketizer on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50932: - Summary: Support Bucketizer on Connect Key: SPARK-50932 URL: https://issues.apache.org/jira/browse/SPARK-50932 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50908) Fix flay pyspark.sql.tests.pandas.test_pandas_transform_with_state.TransformWithStateInPandasTests

2025-01-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50908: Summary: Fix flay pyspark.sql.tests.pandas.test_pandas_transform_with_state.TransformWithStateInPandasTests Key: SPARK-50908 URL: https://issues.apache.org/jira/browse/SPARK-50908

[jira] [Created] (SPARK-50913) Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evaluator

2025-01-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50913: Summary: Fix flaky EvaluationTestsOnConnect.test_binary_classifier_evaluator Key: SPARK-50913 URL: https://issues.apache.org/jira/browse/SPARK-50913 Project: Spark

[jira] [Resolved] (SPARK-50901) Support transformers

2025-01-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50901. --- Fix Version/s: 4.0.0 (was: 4.1) Resolution: Fixed Issue resolv

[jira] [Created] (SPARK-50914) Fix flaky ResourceProfileTests.test_profile_before_sc_for_connect

2025-01-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50914: Summary: Fix flaky ResourceProfileTests.test_profile_before_sc_for_connect Key: SPARK-50914 URL: https://issues.apache.org/jira/browse/SPARK-50914 Project: Spark

[jira] [Created] (SPARK-50915) Add getCondition and deprecate getErrorClass in PySparkException

2025-01-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-50915: --- Summary: Add getCondition and deprecate getErrorClass in PySparkException Key: SPARK-50915 URL: https://issues.apache.org/jira/browse/SPARK-50915 Project: Spark

[jira] [Updated] (SPARK-50890) Skip test_take in Spark Connect only build

2025-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-50890: - Fix Version/s: 3.5.5 > Skip test_take in Spark Connect only build >

[jira] [Updated] (SPARK-50915) Add getCondition and deprecate getErrorClass in PySparkException

2025-01-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-50915: Parent: SPARK-50916 Issue Type: Sub-task (was: Bug) > Add getCondition and deprecate getE

[jira] [Created] (SPARK-50916) Generalize Spark errors

2025-01-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-50916: --- Summary: Generalize Spark errors Key: SPARK-50916 URL: https://issues.apache.org/jira/browse/SPARK-50916 Project: Spark Issue Type: Umbrella Componen

[jira] [Created] (SPARK-50921) Support MultilayerPerceptronClassifier on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50921: - Summary: Support MultilayerPerceptronClassifier on Connect Key: SPARK-50921 URL: https://issues.apache.org/jira/browse/SPARK-50921 Project: Spark Issue Typ

[jira] [Created] (SPARK-50920) Support NaiveBayes on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50920: - Summary: Support NaiveBayes on Connect Key: SPARK-50920 URL: https://issues.apache.org/jira/browse/SPARK-50920 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50919) Support LinearSVC on connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50919: - Summary: Support LinearSVC on connect Key: SPARK-50919 URL: https://issues.apache.org/jira/browse/SPARK-50919 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50923) Support FMClassifier on Connect

2025-01-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50923: - Summary: Support FMClassifier on Connect Key: SPARK-50923 URL: https://issues.apache.org/jira/browse/SPARK-50923 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50948) Support PCA and StringIndexer

2025-01-21 Thread Bobby Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated SPARK-50948: --- Fix Version/s: (was: 4.1) Affects Version/s: 4.1 > Support PCA and StringIndexer > -

[jira] [Created] (SPARK-50949) Support from_labels/from_arrays_of_labels in StringIndexModel

2025-01-21 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50949: -- Summary: Support from_labels/from_arrays_of_labels in StringIndexModel Key: SPARK-50949 URL: https://issues.apache.org/jira/browse/SPARK-50949 Project: Spark Is

[jira] [Created] (SPARK-50948) Support PCA and StringIndexer

2025-01-21 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50948: -- Summary: Support PCA and StringIndexer Key: SPARK-50948 URL: https://issues.apache.org/jira/browse/SPARK-50948 Project: Spark Issue Type: Sub-task Comp

[jira] [Created] (SPARK-50907) Recover CI in scheduled build

2025-01-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-50907: Summary: Recover CI in scheduled build Key: SPARK-50907 URL: https://issues.apache.org/jira/browse/SPARK-50907 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-50812) Support pyspark.ml on Connect

2025-01-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915921#comment-17915921 ] Dongjoon Hyun commented on SPARK-50812: --- Thank you so much for adding and sharing

[jira] [Commented] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

2025-01-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915925#comment-17915925 ] Yang Jie commented on SPARK-50946: -- Java 17.0.14 aligns more closely with the behavior

[jira] [Created] (SPARK-50947) Assign appropriate error class for duplicated artifacts

2025-01-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-50947: --- Summary: Assign appropriate error class for duplicated artifacts Key: SPARK-50947 URL: https://issues.apache.org/jira/browse/SPARK-50947 Project: Spark Issue T

  1   2   >