[jira] [Created] (SPARK-51668) Collect metrics for data source V2 in case the command fails

Jan-Ole Sasse created SPARK-51668: - Summary: Collect metrics for data source V2 in case the command fails Key: SPARK-51668 URL: https://issues.apache.org/jira/browse/SPARK-51668 Project: Spark

[jira] [Commented] (SPARK-33598) Support Java Class with circular references

[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17939572#comment-17939572 ] Tim Robertson commented on SPARK-33598: --- Chiming in just to say I've just encounte

[jira] [Updated] (SPARK-51672) Regenerate golden files with collation aliases in branch-4.0

[ https://issues.apache.org/jira/browse/SPARK-51672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51672: --- Labels: pull-request-available (was: ) > Regenerate golden files with collation aliases in

[jira] [Updated] (SPARK-51669) Generate random TIME values in tests

[ https://issues.apache.org/jira/browse/SPARK-51669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51669: --- Labels: pull-request-available (was: ) > Generate random TIME values in tests > ---

[jira] [Resolved] (SPARK-51669) Generate random TIME values in tests

[ https://issues.apache.org/jira/browse/SPARK-51669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51669. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50462 [https://github.com

[jira] [Resolved] (SPARK-51664) Support the TIME data type in the Hash expression

[ https://issues.apache.org/jira/browse/SPARK-51664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51664. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50456 [https://github.com

[jira] [Created] (SPARK-51669) Generate random TIME values in tests

Max Gekk created SPARK-51669: Summary: Generate random TIME values in tests Key: SPARK-51669 URL: https://issues.apache.org/jira/browse/SPARK-51669 Project: Spark Issue Type: Sub-task C

[jira] [Resolved] (SPARK-51663) Short circuit && operation for JoinSelectionHelper

[ https://issues.apache.org/jira/browse/SPARK-51663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng resolved SPARK-51663. Fix Version/s: 4.1.0 Resolution: Fixed > Short circuit && operation for JoinSelectionHelper

[jira] [Updated] (SPARK-36600) Optimise speed and memory with Pyspark when create DataFrame (with patch)

[ https://issues.apache.org/jira/browse/SPARK-36600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-36600: --- Labels: easyfix pull-request-available (was: easyfix) > Optimise speed and memory with Pysp

[jira] [Created] (SPARK-51671) Add column pruning to Recursive CTEs

Pavle Martinović created SPARK-51671: Summary: Add column pruning to Recursive CTEs Key: SPARK-51671 URL: https://issues.apache.org/jira/browse/SPARK-51671 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-51673) Apply default collation for Alter view query

Marko Ilic created SPARK-51673: -- Summary: Apply default collation for Alter view query Key: SPARK-51673 URL: https://issues.apache.org/jira/browse/SPARK-51673 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-51673) Apply default collation for Alter view query

[ https://issues.apache.org/jira/browse/SPARK-51673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51673: --- Labels: pull-request-available (was: ) > Apply default collation for Alter view query > ---

[jira] [Commented] (SPARK-30451) Stage level Sched: ExecutorResourceRequests/TaskResourceRequests should have functions to remove requests

[ https://issues.apache.org/jira/browse/SPARK-30451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17939692#comment-17939692 ] Jayadeep Jayaraman commented on SPARK-30451: Hi [~tgraves] - I would like to

[jira] [Comment Edited] (SPARK-30451) Stage level Sched: ExecutorResourceRequests/TaskResourceRequests should have functions to remove requests

[ https://issues.apache.org/jira/browse/SPARK-30451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17939692#comment-17939692 ] Jayadeep Jayaraman edited comment on SPARK-30451 at 3/31/25 1:23 PM: -

[jira] [Updated] (SPARK-51670) Refactor Intersect and Except to follow Union example to reuse in single-pass Analyzer

[ https://issues.apache.org/jira/browse/SPARK-51670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51670: --- Labels: pull-request-available (was: ) > Refactor Intersect and Except to follow Union exam

[jira] [Assigned] (SPARK-51670) Refactor Intersect and Except to follow Union example to reuse in single-pass Analyzer

[ https://issues.apache.org/jira/browse/SPARK-51670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51670: --- Assignee: Mihailo Milosevic > Refactor Intersect and Except to follow Union example to reus

[jira] [Assigned] (SPARK-51675) Fix issue around creating col family after db open to avoid redundant snapshot creation

[ https://issues.apache.org/jira/browse/SPARK-51675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51675: Assignee: Anish Shrigondekar > Fix issue around creating col family after db open to avoi

[jira] [Commented] (SPARK-45598) Delta table 3.0.0 not working with Spark Connect 3.5.0

[ https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17939922#comment-17939922 ] Bobby Wang commented on SPARK-45598: I believe this issue has been fixed by https:/

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17939920#comment-17939920 ] Bobby Wang commented on SPARK-46762: Hi [~tenstriker] [~snowch] , I encountered the

[jira] [Created] (SPARK-51674) Remove unnecessary Spark Connect doc link from Spark website

Pengfei Xu created SPARK-51674: -- Summary: Remove unnecessary Spark Connect doc link from Spark website Key: SPARK-51674 URL: https://issues.apache.org/jira/browse/SPARK-51674 Project: Spark Iss

[jira] [Assigned] (SPARK-51666) Fix sparkStageCompleted executorRunTime metric calculation

[ https://issues.apache.org/jira/browse/SPARK-51666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-51666: -- Assignee: Weichen Xu > Fix sparkStageCompleted executorRunTime metric calculation >

[jira] [Assigned] (SPARK-51537) Failed to run third-party Spark ML library on Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-51537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51537: Assignee: Bobby Wang > Failed to run third-party Spark ML library on Spark Connect > ---

[jira] [Resolved] (SPARK-51537) Failed to run third-party Spark ML library on Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-51537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51537. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50334 [https://gi

[jira] [Updated] (SPARK-51537) Failed to run third-party Spark ML library on Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-51537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51537: - Fix Version/s: 4.0.0 (was: 4.1.0) > Failed to run third-party Spark ML li

[jira] [Assigned] (SPARK-51667) [TWS + Python] Disable Nagle's algorithm between Python worker and State Server

[ https://issues.apache.org/jira/browse/SPARK-51667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51667: Assignee: Jungtaek Lim > [TWS + Python] Disable Nagle's algorithm between Python worker a

[jira] [Resolved] (SPARK-51676) Support `printSchema` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51676. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 3

[jira] [Assigned] (SPARK-51676) Support `printSchema` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51676: - Assignee: Dongjoon Hyun > Support `printSchema` for `DataFrame` > -

[jira] [Updated] (SPARK-51637) Python Data Sources columnar read

[ https://issues.apache.org/jira/browse/SPARK-51637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51637: --- Labels: pull-request-available (was: ) > Python Data Sources columnar read > --

[jira] [Created] (SPARK-51676) Support `printSchema` for `DataFrame`

Dongjoon Hyun created SPARK-51676: - Summary: Support `printSchema` for `DataFrame` Key: SPARK-51676 URL: https://issues.apache.org/jira/browse/SPARK-51676 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51676) Support `printSchema` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51676: --- Labels: pull-request-available (was: ) > Support `printSchema` for `DataFrame` > --

[jira] [Updated] (SPARK-51674) Remove unnecessary Spark Connect doc link from Spark website

[ https://issues.apache.org/jira/browse/SPARK-51674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengfei Xu updated SPARK-51674: --- Description: We now have all Classic-only APIs annotated with @ClassicOnly. This tag will be visibl

[jira] [Updated] (SPARK-51674) Remove unnecessary Spark Connect doc link from Spark website

[ https://issues.apache.org/jira/browse/SPARK-51674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengfei Xu updated SPARK-51674: --- Description: We now have all Classic-only APIs annotated with @ClassicOnly. This tag will be visibl

[jira] [Updated] (SPARK-50131) Update isin to accept DataFrame to work as IN subquery

[ https://issues.apache.org/jira/browse/SPARK-50131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50131: --- Labels: pull-request-available (was: ) > Update isin to accept DataFrame to work as IN subq

[jira] [Assigned] (SPARK-51657) UTF8_BINARY default table collation shown by default in Desc As JSON (v1)

[ https://issues.apache.org/jira/browse/SPARK-51657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-51657: -- Assignee: Amanda Liu > UTF8_BINARY default table collation shown by default in Desc A

[jira] [Resolved] (SPARK-51657) UTF8_BINARY default table collation shown by default in Desc As JSON (v1)

[ https://issues.apache.org/jira/browse/SPARK-51657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51657. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50451 [https:

[jira] [Resolved] (SPARK-51670) Refactor Intersect and Except to follow Union example to reuse in single-pass Analyzer

[ https://issues.apache.org/jira/browse/SPARK-51670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51670. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50465 [https://gith

[jira] [Assigned] (SPARK-51650) Support delete ml cached objects in batch

[ https://issues.apache.org/jira/browse/SPARK-51650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51650: - Assignee: Ruifeng Zheng > Support delete ml cached objects in batch > -

[jira] [Updated] (SPARK-51674) Remove unnecessary Spark Connect doc link from Spark website

[ https://issues.apache.org/jira/browse/SPARK-51674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51674: --- Labels: pull-request-available (was: ) > Remove unnecessary Spark Connect doc link from Spa

[jira] [Created] (SPARK-51675) Fix issue around creating col family after db open

Anish Shrigondekar created SPARK-51675: -- Summary: Fix issue around creating col family after db open Key: SPARK-51675 URL: https://issues.apache.org/jira/browse/SPARK-51675 Project: Spark