[jira] [Resolved] (SPARK-50896) Add Daily Maven CI to branch-4.0

2025-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50896. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49578 [https://

[jira] [Resolved] (SPARK-50875) Add RTRIM collation to TVF

2025-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50875. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49554 [https://gith

[jira] [Assigned] (SPARK-50870) DataSourceV2 relations may contain unresolved cast expressions after materializing current_timestamp()

2025-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50870: --- Assignee: Changgyoo Park > DataSourceV2 relations may contain unresolved cast expressions a

[jira] [Assigned] (SPARK-50718) Support `addArtifact(s)` for PySpark

2025-01-20 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reassigned SPARK-50718: --- Assignee: Haejoon Lee > Support `addArtifact(s)` for PySpark >

[jira] [Resolved] (SPARK-50718) Support `addArtifact(s)` for PySpark

2025-01-20 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-50718. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49572 [https://gith

[jira] [Updated] (SPARK-50888) Fix Flaky Test: `SparkConnectServiceSuite.SPARK-44776: LocalTableScanExe`

2025-01-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50888: -- Description: - `branch-4.0`: https://github.com/apache/spark/actions/runs/12879810930/job/359

[jira] [Resolved] (SPARK-50751) Assign appropriate error condition for _LEGACY_ERROR_TEMP_1305: UNSUPPORTED_TABLE_CHANGE_IN_JDBC_CATALOG

2025-01-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50751. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49395 [https://github.com

[jira] [Created] (SPARK-50898) Support FPGrowth on connect

2025-01-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50898: - Summary: Support FPGrowth on connect Key: SPARK-50898 URL: https://issues.apache.org/jira/browse/SPARK-50898 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50898) Support FPGrowth on connect

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50898: --- Labels: pull-request-available (was: ) > Support FPGrowth on connect >

[jira] [Created] (SPARK-50897) Don't instantiate the class when loading by ServiceLoader

2025-01-20 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50897: -- Summary: Don't instantiate the class when loading by ServiceLoader Key: SPARK-50897 URL: https://issues.apache.org/jira/browse/SPARK-50897 Project: Spark Issue T

[jira] [Resolved] (SPARK-50900) Add VectorUDT and MatrixUDT to ProtoDataTypes

2025-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50900. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49580 [https://

[jira] [Updated] (SPARK-50902) Add `CRC32C` test cases

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50902: --- Labels: pull-request-available (was: ) > Add `CRC32C` test cases > ---

[jira] [Created] (SPARK-50902) Add `CRC32C` test cases

2025-01-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50902: - Summary: Add `CRC32C` test cases Key: SPARK-50902 URL: https://issues.apache.org/jira/browse/SPARK-50902 Project: Spark Issue Type: Sub-task Comp

[jira] [Assigned] (SPARK-50844) make ML model to be loaded by ServiceLoader

2025-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50844: - Assignee: Bobby Wang > make ML model to be loaded by ServiceLoader > --

[jira] [Resolved] (SPARK-50844) make ML model to be loaded by ServiceLoader

2025-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50844. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49569 [https://

[jira] [Updated] (SPARK-50900) Add VectorUDT and MatrixUDT to ProtoDataTypes

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50900: --- Labels: pull-request-available (was: ) > Add VectorUDT and MatrixUDT to ProtoDataTypes > --

[jira] [Resolved] (SPARK-50870) DataSourceV2 relations may contain unresolved cast expressions after materializing current_timestamp()

2025-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50870. - Fix Version/s: 3.5.5 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Created] (SPARK-50899) Support PrefixSpan on connect

2025-01-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50899: - Summary: Support PrefixSpan on connect Key: SPARK-50899 URL: https://issues.apache.org/jira/browse/SPARK-50899 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-50900) Add VectorUDT and MatrixUDT to ProtoDataTypes

2025-01-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50900: - Summary: Add VectorUDT and MatrixUDT to ProtoDataTypes Key: SPARK-50900 URL: https://issues.apache.org/jira/browse/SPARK-50900 Project: Spark Issue Type: S

[jira] [Created] (SPARK-50901) Support transformers

2025-01-20 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50901: -- Summary: Support transformers Key: SPARK-50901 URL: https://issues.apache.org/jira/browse/SPARK-50901 Project: Spark Issue Type: Sub-task Components: C

[jira] [Assigned] (SPARK-50894) Upgrade postgresql driver to properly connect to Redshift

2025-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50894: --- Assignee: Vladan Vasić > Upgrade postgresql driver to properly connect to Redshift > --

[jira] [Resolved] (SPARK-50894) Upgrade postgresql driver to properly connect to Redshift

2025-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50894. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49575 [https://gith

[jira] [Resolved] (SPARK-50897) Don't instantiate the class when loading by ServiceLoader

2025-01-20 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund resolved SPARK-50897. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49577 [https://gi

[jira] [Updated] (SPARK-50897) Don't instantiate the class when loading by ServiceLoader

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50897: --- Labels: pull-request-available (was: ) > Don't instantiate the class when loading by Servic

[jira] [Updated] (SPARK-50879) Support feature scalers on Connect

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50879: --- Labels: pull-request-available (was: ) > Support feature scalers on Connect > -

[jira] [Updated] (SPARK-50718) Support `addArtifact(s)` for PySpark

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50718: --- Labels: pull-request-available (was: ) > Support `addArtifact(s)` for PySpark > ---

[jira] [Resolved] (SPARK-50878) Support ALS on Connect

2025-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50878. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49570 [https://

[jira] [Created] (SPARK-50892) Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries

2025-01-20 Thread Milan Cupac (Jira)
Milan Cupac created SPARK-50892: --- Summary: Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries Key: SPARK-50892 URL: https://issues.apache.org/jira/browse/SPARK-50892

[jira] [Updated] (SPARK-50892) Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50892: --- Labels: pull-request-available (was: ) > Add UnionLoopExec, physical operator for recursion

[jira] [Resolved] (SPARK-50877) Support KMeans & BisectingKMeans on Connect

2025-01-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50877. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49567 [https://

[jira] [Updated] (SPARK-50878) Support ALS on Connect

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50878: --- Labels: pull-request-available (was: ) > Support ALS on Connect > -- >

[jira] [Commented] (SPARK-27881) Support CAST (... FORMAT ) expression

2025-01-20 Thread Sujith Chacko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17914713#comment-17914713 ] Sujith Chacko commented on SPARK-27881: --- [~dongjoon] [~petertoth] Can we revisit t

[jira] [Created] (SPARK-50895) Create common interface for expressions which produce default string type

2025-01-20 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-50895: - Summary: Create common interface for expressions which produce default string type Key: SPARK-50895 URL: https://issues.apache.org/jira/browse/SPARK-50895 Project:

[jira] [Updated] (SPARK-50895) Create common interface for expressions which produce default string type

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50895: --- Labels: pull-request-available (was: ) > Create common interface for expressions which prod

[jira] [Created] (SPARK-50896) Add Daily Maven CI to branch-4.0

2025-01-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50896: - Summary: Add Daily Maven CI to branch-4.0 Key: SPARK-50896 URL: https://issues.apache.org/jira/browse/SPARK-50896 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50896) Add Daily Maven CI to branch-4.0

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50896: --- Labels: pull-request-available (was: ) > Add Daily Maven CI to branch-4.0 > ---

[jira] [Updated] (SPARK-50894) Upgrade postgresql driver to properly connect to Redshift

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50894: --- Labels: pull-request-available (was: ) > Upgrade postgresql driver to properly connect to R

[jira] [Created] (SPARK-50894) Upgrade postgresql driver to properly connect to Redshift

2025-01-20 Thread Jira
Vladan Vasić created SPARK-50894: Summary: Upgrade postgresql driver to properly connect to Redshift Key: SPARK-50894 URL: https://issues.apache.org/jira/browse/SPARK-50894 Project: Spark Iss

[jira] [Resolved] (SPARK-50893) Mark UDT.DataType optional

2025-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50893. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49574 [https://gi

[jira] [Assigned] (SPARK-50735) Infinite lifetime of a query after an exception in ExecuteResponseObserver

2025-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50735: Assignee: Changgyoo Park > Infinite lifetime of a query after an exception in ExecuteResp

[jira] [Resolved] (SPARK-50735) Infinite lifetime of a query after an exception in ExecuteResponseObserver

2025-01-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50735. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49370 [https://gi

[jira] [Updated] (SPARK-50894) Upgrade postgresql driver to properly connect to Redshift

2025-01-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-50894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladan Vasić updated SPARK-50894: - Description: In this [PR|https://github.com/apache/spark/pull/47810] the version of `postgresql

[jira] [Assigned] (SPARK-50870) DataSourceV2 relations may contain unresolved cast expressions after materializing current_timestamp()

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50870: -- Assignee: Apache Spark > DataSourceV2 relations may contain unresolved cast expressio

[jira] [Assigned] (SPARK-50870) DataSourceV2 relations may contain unresolved cast expressions after materializing current_timestamp()

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50870: -- Assignee: (was: Apache Spark) > DataSourceV2 relations may contain unresolved cas

[jira] [Assigned] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50847: -- Assignee: Apache Spark > Deny ApplyCharTypePadding from applying on specific In expre

[jira] [Assigned] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50847: -- Assignee: (was: Apache Spark) > Deny ApplyCharTypePadding from applying on specif

[jira] [Commented] (SPARK-47520) Precision issues with sum of floats/doubles leads to incorrect data after repartition stage retry

2025-01-20 Thread William Montaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17914587#comment-17914587 ] William Montaz commented on SPARK-47520: Hello, I see no activity regarding thi

[jira] [Resolved] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50847. -- Fix Version/s: 4.0.0 (was: 4.1.0) Resolution: Fixed Issue resolved by pu

[jira] [Assigned] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50847: Assignee: Mihailo Aleksic > Deny ApplyCharTypePadding from applying on specific In expressions >