[jira] [Created] (SPARK-51256) Increase parallelism if joining with small bucket table

2025-02-19 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-51256: --- Summary: Increase parallelism if joining with small bucket table Key: SPARK-51256 URL: https://issues.apache.org/jira/browse/SPARK-51256 Project: Spark Issue T

[jira] [Updated] (SPARK-51256) Increase parallelism if joining with small bucket table

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51256: --- Labels: pull-request-available (was: ) > Increase parallelism if joining with small bucket

[jira] [Resolved] (SPARK-51248) Move subquery validation out of CheckAnalysis

2025-02-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51248. -- Fix Version/s: 4.0.0 Assignee: Vladimir Golubev Resolution: Fixed Resolved by https://

[jira] [Created] (SPARK-51257) Add ORDER BY alias golden files

2025-02-19 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-51257: --- Summary: Add ORDER BY alias golden files Key: SPARK-51257 URL: https://issues.apache.org/jira/browse/SPARK-51257 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-51259) Refactor and improve performance for natural and using join keys computation

2025-02-19 Thread Mihailo Timotic (Jira)
Mihailo Timotic created SPARK-51259: --- Summary: Refactor and improve performance for natural and using join keys computation Key: SPARK-51259 URL: https://issues.apache.org/jira/browse/SPARK-51259 Pr

[jira] [Updated] (SPARK-51259) Refactor and improve performance for natural and using join keys computation

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51259: --- Labels: pull-request-available (was: ) > Refactor and improve performance for natural and u

[jira] [Resolved] (SPARK-50655) Move virt col family related mapping into db layer instead of encoder

2025-02-19 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50655. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49304 [https://gi

[jira] [Assigned] (SPARK-51247) [M1] Refactor EXECUTE IMMEDIATE to work properly with local variables.

2025-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51247: --- Assignee: Dusan Tisma > [M1] Refactor EXECUTE IMMEDIATE to work properly with local variabl

[jira] [Resolved] (SPARK-51247) [M1] Refactor EXECUTE IMMEDIATE to work properly with local variables.

2025-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51247. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49993 [https://gith

[jira] [Resolved] (SPARK-51257) Add ORDER BY alias golden files

2025-02-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51257. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50007 [https://github.com

[jira] [Assigned] (SPARK-51257) Add ORDER BY alias golden files

2025-02-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51257: Assignee: Mihailo Aleksic > Add ORDER BY alias golden files > --- > >

[jira] [Updated] (SPARK-51257) Add ORDER BY alias golden files

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51257: --- Labels: pull-request-available (was: ) > Add ORDER BY alias golden files >

[jira] [Created] (SPARK-51264) JDBC write keeps driver connection open unnecessarily

2025-02-19 Thread Jira
Ángel Álvarez Pascua created SPARK-51264: Summary: JDBC write keeps driver connection open unnecessarily Key: SPARK-51264 URL: https://issues.apache.org/jira/browse/SPARK-51264 Project: Spark

[jira] [Created] (SPARK-51265) StackOverflowError or Internal Error have raised when executing eagerlyExecuteCommands containing streaming source

2025-02-19 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-51265: Summary: StackOverflowError or Internal Error have raised when executing eagerlyExecuteCommands containing streaming source Key: SPARK-51265 URL: https://issues.apache.org/jira/br

[jira] [Updated] (SPARK-51265) StackOverflowError or Internal Error have raised when executing eagerlyExecuteCommands containing streaming source

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51265: --- Labels: pull-request-available (was: ) > StackOverflowError or Internal Error have raised w

[jira] [Updated] (SPARK-51264) JDBC write keeps driver connection open unnecessarily

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51264: --- Labels: pull-request-available (was: ) > JDBC write keeps driver connection open unnecessar

[jira] [Updated] (SPARK-51266) Remove the no longer used definition of `private[spark] object TaskDetailsClassNames`

2025-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51266: - Priority: Minor (was: Major) > Remove the no longer used definition of `private[spark] object > TaskDe

[jira] [Created] (SPARK-51266) Remove the no longer used definition of `private[spark] object TaskDetailsClassNames`

2025-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-51266: Summary: Remove the no longer used definition of `private[spark] object TaskDetailsClassNames` Key: SPARK-51266 URL: https://issues.apache.org/jira/browse/SPARK-51266 Project

[jira] [Created] (SPARK-51267) Match local Spark Connect server logic between Python and Scala

2025-02-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-51267: Summary: Match local Spark Connect server logic between Python and Scala Key: SPARK-51267 URL: https://issues.apache.org/jira/browse/SPARK-51267 Project: Spark

[jira] [Updated] (SPARK-51266) Remove the no longer used definition of `private[spark] object TaskDetailsClassNames`

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51266: --- Labels: pull-request-available (was: ) > Remove the no longer used definition of `private[s

[jira] [Commented] (SPARK-51249) Fix version encoding bug in NoPrefixKeyStateEncoder

2025-02-19 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928560#comment-17928560 ] Anish Shrigondekar commented on SPARK-51249: cc - [~kabhwan] [~cloud_fan] -

[jira] [Updated] (SPARK-51249) Fix version encoding bug in NoPrefixKeyStateEncoder

2025-02-19 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-51249: --- Fix Version/s: 4.0.0 > Fix version encoding bug in NoPrefixKeyStateEncoder > ---

[jira] [Updated] (SPARK-51249) Fix version encoding bug in NoPrefixKeyStateEncoder

2025-02-19 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-51249: --- Epic Link: SPARK-46815 > Fix version encoding bug in NoPrefixKeyStateEncoder > -

[jira] [Created] (SPARK-51260) Move V2ExpressionBuilder and PushableExpression to Catalyst module

2025-02-19 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-51260: -- Summary: Move V2ExpressionBuilder and PushableExpression to Catalyst module Key: SPARK-51260 URL: https://issues.apache.org/jira/browse/SPARK-51260 Project: Spark

[jira] [Created] (SPARK-51262) exceptAll not working with drop_duplicates using subset

2025-02-19 Thread Nicolai Balbino (Jira)
Nicolai Balbino created SPARK-51262: --- Summary: exceptAll not working with drop_duplicates using subset Key: SPARK-51262 URL: https://issues.apache.org/jira/browse/SPARK-51262 Project: Spark

[jira] [Resolved] (SPARK-51254) Disallow --master with Spark Connect URL

2025-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51254. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 5 [https://gi

[jira] [Created] (SPARK-51263) Clean up unnecessary `invokePrivate` method calls in the test code.

2025-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-51263: Summary: Clean up unnecessary `invokePrivate` method calls in the test code. Key: SPARK-51263 URL: https://issues.apache.org/jira/browse/SPARK-51263 Project: Spark

[jira] [Updated] (SPARK-51249) Fix version encoding bug in NoPrefixKeyStateEncoder

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51249: --- Labels: pull-request-available (was: ) > Fix version encoding bug in NoPrefixKeyStateEncode

[jira] [Resolved] (SPARK-51260) Move V2ExpressionBuilder and PushableExpression to Catalyst module

2025-02-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51260. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50011 [https:

[jira] [Updated] (SPARK-51261) Introduce model size estimation to control ml cache

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51261: --- Labels: pull-request-available (was: ) > Introduce model size estimation to control ml cach

[jira] [Commented] (SPARK-46820) Fix error message regression by restoring new_msg

2025-02-19 Thread Vinicius Errero (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928545#comment-17928545 ] Vinicius Errero commented on SPARK-46820: - Hi [~gurwls223], Thank you for worki

[jira] [Updated] (SPARK-51267) Match local Spark Connect server logic between Python and Scala

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51267: --- Labels: pull-request-available (was: ) > Match local Spark Connect server logic between Pyt

[jira] [Resolved] (SPARK-51259) Refactor and improve performance for natural and using join keys computation

2025-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51259. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50009 [https://gith

[jira] [Assigned] (SPARK-51259) Refactor and improve performance for natural and using join keys computation

2025-02-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51259: --- Assignee: Mihailo Timotic > Refactor and improve performance for natural and using join key

[jira] [Updated] (SPARK-51260) Move V2ExpressionBuilder and PushableExpression to Catalyst module

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51260: --- Labels: pull-request-available (was: ) > Move V2ExpressionBuilder and PushableExpression to

[jira] [Commented] (SPARK-51249) Fix version encoding bug in NoPrefixKeyStateEncoder

2025-02-19 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928632#comment-17928632 ] Jungtaek Lim commented on SPARK-51249: -- Thanks for flagging, I've marked as a block

[jira] [Updated] (SPARK-51249) Fix version encoding bug in NoPrefixKeyStateEncoder

2025-02-19 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-51249: - Priority: Blocker (was: Major) > Fix version encoding bug in NoPrefixKeyStateEncoder >