[jira] [Assigned] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50946: -- Assignee: Apache Spark > When using Java version 17.0.14, the `SPARK-35907: createDir

[jira] [Assigned] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50946: -- Assignee: (was: Apache Spark) > When using Java version 17.0.14, the `SPARK-35907

[jira] [Created] (SPARK-50951) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.6-slim

Luca Canali created SPARK-50951: --- Summary: Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.6-slim Key: SPARK-50951 URL: https://issues.apache.org/jira/browse/SPARK-50951 Project: Spark

[jira] [Updated] (SPARK-50951) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.6-slim

[ https://issues.apache.org/jira/browse/SPARK-50951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50951: --- Labels: pull-request-available (was: ) > Update OracleDatabaseOnDocker Docker Image Tag to

[jira] [Created] (SPARK-50950) Make `FilterExec` to support `subexpressionElimination` in the codegen scenario.

Pan Bingkun created SPARK-50950: --- Summary: Make `FilterExec` to support `subexpressionElimination` in the codegen scenario. Key: SPARK-50950 URL: https://issues.apache.org/jira/browse/SPARK-50950 Projec

[jira] [Resolved] (SPARK-50948) Support PCA and StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-50948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50948. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49600 [https://

[jira] [Assigned] (SPARK-50948) Support PCA and StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-50948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50948: - Assignee: Bobby Wang > Support PCA and StringIndexer > - >

[jira] [Updated] (SPARK-50948) Support PCA and StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-50948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50948: --- Labels: pull-request-available (was: ) > Support PCA and StringIndexer > --

[jira] [Resolved] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50946. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49599 [https://github.com

[jira] [Assigned] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50946: Assignee: Yang Jie > When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in

[jira] [Updated] (SPARK-50849) Basic, working project with Maven

[ https://issues.apache.org/jira/browse/SPARK-50849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50849: --- Labels: pull-request-available (was: ) > Basic, working project with Maven > -

[jira] [Updated] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50946: -- Fix Version/s: 3.5.5 > When using Java version 17.0.14, the `SPARK-35907: createDirectory` tes

[jira] [Commented] (SPARK-27881) Support CAST (... FORMAT ) expression

[ https://issues.apache.org/jira/browse/SPARK-27881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916176#comment-17916176 ] Dongjoon Hyun commented on SPARK-27881: --- Could you provide any update or additiona

[jira] [Updated] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50946: -- Fix Version/s: 3.5.5 > When using Java version 17.0.14, the `SPARK-35907: createDirectory` tes

[jira] [Updated] (SPARK-50952) Include `jjwt`-related libraries and provide `jjwt-provided`

[ https://issues.apache.org/jira/browse/SPARK-50952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50952: --- Labels: pull-request-available (was: ) > Include `jjwt`-related libraries and provide `jjwt

[jira] [Created] (SPARK-50952) Include `jjwt`-related libraries and provide `jjwt-provided`

Dongjoon Hyun created SPARK-50952: - Summary: Include `jjwt`-related libraries and provide `jjwt-provided` Key: SPARK-50952 URL: https://issues.apache.org/jira/browse/SPARK-50952 Project: Spark

[jira] [Assigned] (SPARK-50952) Include `jjwt`-related libraries and provide `jjwt-provided`

[ https://issues.apache.org/jira/browse/SPARK-50952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50952: - Assignee: Dongjoon Hyun > Include `jjwt`-related libraries and provide `jjwt-provided`

[jira] [Updated] (SPARK-50855) Spark Connect Support for TransformWithState In Scala

[ https://issues.apache.org/jira/browse/SPARK-50855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50855: -- Epic Link: (was: SPARK-46815) > Spark Connect Support for TransformWithState In Scala > --

[jira] [Updated] (SPARK-50855) Spark Connect Support for TransformWithState In Scala

[ https://issues.apache.org/jira/browse/SPARK-50855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50855: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Spark Connect Support for Tran

[jira] [Resolved] (SPARK-50951) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.6-slim

[ https://issues.apache.org/jira/browse/SPARK-50951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50951. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49605 [https://

[jira] [Resolved] (SPARK-50952) Include `jjwt`-related libraries and provide `jjwt-provided`

[ https://issues.apache.org/jira/browse/SPARK-50952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50952. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49608 [https://

[jira] [Updated] (SPARK-50946) When using Java version 17.0.14, the `SPARK-35907: createDirectory` test in UtilsSuite will fail.

[ https://issues.apache.org/jira/browse/SPARK-50946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50946: -- Fix Version/s: (was: 3.5.5) > When using Java version 17.0.14, the `SPARK-35907: createDir

[jira] [Reopened] (SPARK-50118) Spark removes working directory while Python UDF runs

[ https://issues.apache.org/jira/browse/SPARK-50118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-50118: -- Reverted at https://github.com/apache/spark/commit/3bbb12cbd5e67f725b8a31057370e332bdf19d8d and

[jira] [Updated] (SPARK-50118) Spark removes working directory while Python UDF runs

[ https://issues.apache.org/jira/browse/SPARK-50118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-50118: - Fix Version/s: (was: 4.0.0) > Spark removes working directory while Python UDF runs > --

[jira] [Created] (SPARK-50953) Allow variant_get with non-literal paths

Harsh Motwani created SPARK-50953: - Summary: Allow variant_get with non-literal paths Key: SPARK-50953 URL: https://issues.apache.org/jira/browse/SPARK-50953 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-50951) Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:23.6-slim

[ https://issues.apache.org/jira/browse/SPARK-50951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50951: - Assignee: Luca Canali > Update OracleDatabaseOnDocker Docker Image Tag to oracle-free:2

[jira] [Commented] (SPARK-50846) Consolidate Aggregator handling in ColumnNodeToProtoConverter

[ https://issues.apache.org/jira/browse/SPARK-50846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916189#comment-17916189 ] Dmytro Tsyliuryk commented on SPARK-50846: -- hi [~xupaddy]. Can i take it to wor

[jira] [Commented] (SPARK-50846) Consolidate Aggregator handling in ColumnNodeToProtoConverter

[ https://issues.apache.org/jira/browse/SPARK-50846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916195#comment-17916195 ] Pengfei Xu commented on SPARK-50846: Hey [~ostronaut], this task depends on a PR tha

[jira] [Comment Edited] (SPARK-50846) Consolidate Aggregator handling in ColumnNodeToProtoConverter

[ https://issues.apache.org/jira/browse/SPARK-50846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916195#comment-17916195 ] Pengfei Xu edited comment on SPARK-50846 at 1/22/25 9:37 PM: -

[jira] [Updated] (SPARK-50953) Allow variant_get with non-literal paths

[ https://issues.apache.org/jira/browse/SPARK-50953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50953: --- Labels: pull-request-available (was: ) > Allow variant_get with non-literal paths > ---

[jira] [Resolved] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

[ https://issues.apache.org/jira/browse/SPARK-50883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50883. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49559 [https://gith

[jira] [Assigned] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

[ https://issues.apache.org/jira/browse/SPARK-50883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50883: --- Assignee: Cuong Nguyen > Support altering multiple columns in the same ALTER TABLE command

[jira] [Resolved] (SPARK-50091) Query fails when aggregate expression is in left-hand operand of IN-subquery

[ https://issues.apache.org/jira/browse/SPARK-50091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50091. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48627 [https://gith

[jira] [Assigned] (SPARK-50091) Query fails when aggregate expression is in left-hand operand of IN-subquery

[ https://issues.apache.org/jira/browse/SPARK-50091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50091: --- Assignee: Bruce Robbins > Query fails when aggregate expression is in left-hand operand of

[jira] [Created] (SPARK-50955) combine the estimator read/write and model read/write together

Bobby Wang created SPARK-50955: -- Summary: combine the estimator read/write and model read/write together Key: SPARK-50955 URL: https://issues.apache.org/jira/browse/SPARK-50955 Project: Spark I

[jira] [Updated] (SPARK-50812) Support pyspark.ml on Connect

[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50812: --- Labels: pull-request-available (was: ) > Support pyspark.ml on Connect > --

[jira] [Resolved] (SPARK-50812) Support pyspark.ml on Connect

[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50812. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49610 [https://

[jira] [Created] (SPARK-50957) Make protobuf.utils.SchemaConverters private

Siying Dong created SPARK-50957: --- Summary: Make protobuf.utils.SchemaConverters private Key: SPARK-50957 URL: https://issues.apache.org/jira/browse/SPARK-50957 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-50957) Make protobuf.utils.SchemaConverters private

[ https://issues.apache.org/jira/browse/SPARK-50957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50957: --- Labels: pull-request-available (was: ) > Make protobuf.utils.SchemaConverters private > ---

[jira] [Created] (SPARK-50954) Support client side model path overwrite

Ruifeng Zheng created SPARK-50954: - Summary: Support client side model path overwrite Key: SPARK-50954 URL: https://issues.apache.org/jira/browse/SPARK-50954 Project: Spark Issue Type: Sub-ta

[jira] [Resolved] (SPARK-50956) Skip EvaluationTestsOnConnect.test_multiclass_classifier_evaluator

[ https://issues.apache.org/jira/browse/SPARK-50956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50956. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49611 [https://

[jira] [Assigned] (SPARK-50956) Skip EvaluationTestsOnConnect.test_multiclass_classifier_evaluator

[ https://issues.apache.org/jira/browse/SPARK-50956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50956: - Assignee: Ruifeng Zheng > Skip EvaluationTestsOnConnect.test_multiclass_classifier_eval

[jira] [Assigned] (SPARK-50939) Support Word2Vec on Connect

[ https://issues.apache.org/jira/browse/SPARK-50939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50939: - Assignee: Ruifeng Zheng > Support Word2Vec on Connect > --- > >

[jira] [Created] (SPARK-50958) Support Word2VecModel.findSynonymsArray

Ruifeng Zheng created SPARK-50958: - Summary: Support Word2VecModel.findSynonymsArray Key: SPARK-50958 URL: https://issues.apache.org/jira/browse/SPARK-50958 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-50939) Support Word2Vec on Connect

[ https://issues.apache.org/jira/browse/SPARK-50939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50939: --- Labels: pull-request-available (was: ) > Support Word2Vec on Connect >

[jira] [Updated] (SPARK-50938) Support VectorSlicer and VectorSizeHint on Connect

[ https://issues.apache.org/jira/browse/SPARK-50938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50938: -- Summary: Support VectorSlicer and VectorSizeHint on Connect (was: Support VectorSlicer on Con

[jira] [Assigned] (SPARK-50938) Support VectorSlicer on Connect

[ https://issues.apache.org/jira/browse/SPARK-50938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50938: - Assignee: Ruifeng Zheng > Support VectorSlicer on Connect > ---

[jira] [Updated] (SPARK-50938) Support VectorSlicer on Connect

[ https://issues.apache.org/jira/browse/SPARK-50938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50938: -- Summary: Support VectorSlicer on Connect (was: Support VectorSlicer and VectorSizeHint on Con

[jira] [Updated] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

[ https://issues.apache.org/jira/browse/SPARK-50883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cuong Nguyen updated SPARK-50883: - Description: Current ALTER TABLE ... ALTER COLUMN syntax only allows altering one column at a t

[jira] [Updated] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

[ https://issues.apache.org/jira/browse/SPARK-50883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cuong Nguyen updated SPARK-50883: - Affects Version/s: 4.0.0 (was: 3.5.4) > Support altering multiple col

[jira] [Assigned] (SPARK-50909) Setup faulthandler in PythonPlannerRunners.

[ https://issues.apache.org/jira/browse/SPARK-50909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-50909: - Assignee: Takuya Ueshin > Setup faulthandler in PythonPlannerRunners. > ---

[jira] [Resolved] (SPARK-50909) Setup faulthandler in PythonPlannerRunners.

[ https://issues.apache.org/jira/browse/SPARK-50909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-50909. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49592 [https://

[jira] [Created] (SPARK-50956) Skip EvaluationTestsOnConnect.test_multiclass_classifier_evaluator

Ruifeng Zheng created SPARK-50956: - Summary: Skip EvaluationTestsOnConnect.test_multiclass_classifier_evaluator Key: SPARK-50956 URL: https://issues.apache.org/jira/browse/SPARK-50956 Project: Spark

[jira] [Updated] (SPARK-50956) Skip EvaluationTestsOnConnect.test_multiclass_classifier_evaluator

[ https://issues.apache.org/jira/browse/SPARK-50956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50956: --- Labels: pull-request-available (was: ) > Skip EvaluationTestsOnConnect.test_multiclass_clas

[jira] [Updated] (SPARK-50883) Support altering multiple columns in the same ALTER TABLE command

[ https://issues.apache.org/jira/browse/SPARK-50883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cuong Nguyen updated SPARK-50883: - Affects Version/s: 3.5.4 (was: 4.0.0) > Support altering multiple col

[jira] [Updated] (SPARK-50959) ImportError: sys.meta_path is None, Python is likely shutting down Exception ignored in:

[ https://issues.apache.org/jira/browse/SPARK-50959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50959: --- Labels: pull-request-available (was: ) > ImportError: sys.meta_path is None, Python is like

[jira] [Assigned] (SPARK-50957) Make protobuf.utils.SchemaConverters private

[ https://issues.apache.org/jira/browse/SPARK-50957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-50957: Assignee: Siying Dong > Make protobuf.utils.SchemaConverters private > --

[jira] [Resolved] (SPARK-50957) Make protobuf.utils.SchemaConverters private

[ https://issues.apache.org/jira/browse/SPARK-50957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50957. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49613 [https://gi

[jira] [Created] (SPARK-50960) Add InvalidPlanInput to Spark Connect Python client

Haejoon Lee created SPARK-50960: --- Summary: Add InvalidPlanInput to Spark Connect Python client Key: SPARK-50960 URL: https://issues.apache.org/jira/browse/SPARK-50960 Project: Spark Issue Type:

[jira] [Updated] (SPARK-50960) Add InvalidPlanInput to Spark Connect Python client

[ https://issues.apache.org/jira/browse/SPARK-50960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50960: --- Labels: pull-request-available (was: ) > Add InvalidPlanInput to Spark Connect Python clien

[jira] [Resolved] (SPARK-50918) Support Pipeline on connect

[ https://issues.apache.org/jira/browse/SPARK-50918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50918. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49596 [https://

[jira] [Created] (SPARK-50959) ImportError: sys.meta_path is None, Python is likely shutting down Exception ignored in:

Bobby Wang created SPARK-50959: -- Summary: ImportError: sys.meta_path is None, Python is likely shutting down Exception ignored in: Key: SPARK-50959 URL: https://issues.apache.org/jira/browse/SPARK-50959