[jira] [Resolved] (SPARK-51622) Titling sections on ExecutionPage

[ https://issues.apache.org/jira/browse/SPARK-51622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51622. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50424 [https://github.com

[jira] [Updated] (SPARK-51627) Add a schedule workflow for numpy 2.1.3

[ https://issues.apache.org/jira/browse/SPARK-51627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51627: --- Labels: pull-request-available (was: ) > Add a schedule workflow for numpy 2.1.3 >

[jira] [Updated] (SPARK-51628) Clean up the assembly module before maven testing in maven daily test

[ https://issues.apache.org/jira/browse/SPARK-51628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51628: - Summary: Clean up the assembly module before maven testing in maven daily test (was: Clean up the assem

[jira] [Created] (SPARK-51628) Clean up the assembly module before maven testing

Yang Jie created SPARK-51628: Summary: Clean up the assembly module before maven testing Key: SPARK-51628 URL: https://issues.apache.org/jira/browse/SPARK-51628 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-51629) Add a download link on ExecutionPage for svg/dot/txt format plans

Kent Yao created SPARK-51629: Summary: Add a download link on ExecutionPage for svg/dot/txt format plans Key: SPARK-51629 URL: https://issues.apache.org/jira/browse/SPARK-51629 Project: Spark Is

[jira] [Assigned] (SPARK-51622) Titling sections on ExecutionPage

[ https://issues.apache.org/jira/browse/SPARK-51622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-51622: Assignee: Kent Yao > Titling sections on ExecutionPage > - > >

[jira] [Updated] (SPARK-51628) Clean up the assembly module before maven testing in maven daily test

[ https://issues.apache.org/jira/browse/SPARK-51628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51628: --- Labels: pull-request-available (was: ) > Clean up the assembly module before maven testing

[jira] [Created] (SPARK-51621) Support `sparkSession` for `DataFrame`

Dongjoon Hyun created SPARK-51621: - Summary: Support `sparkSession` for `DataFrame` Key: SPARK-51621 URL: https://issues.apache.org/jira/browse/SPARK-51621 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51626) Support `DataFrameReader`

[ https://issues.apache.org/jira/browse/SPARK-51626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51626: --- Labels: pull-request-available (was: ) > Support `DataFrameReader` > --

[jira] [Assigned] (SPARK-51605) If the `logs` directory does not exist, the first launch of `bin/spark-shell --remote local` will fail.

[ https://issues.apache.org/jira/browse/SPARK-51605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51605: Assignee: Yang Jie > If the `logs` directory does not exist, the first launch of `bin/spark-shell

[jira] [Assigned] (SPARK-51626) Support `DataFrameReader`

[ https://issues.apache.org/jira/browse/SPARK-51626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51626: - Assignee: Dongjoon Hyun > Support `DataFrameReader` > - > >

[jira] [Comment Edited] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0

[ https://issues.apache.org/jira/browse/SPARK-32166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938784#comment-17938784 ] jiacai Guo edited comment on SPARK-32166 at 3/27/25 5:29 AM: -

[jira] [Created] (SPARK-51627) Add a schedule workflow for numpy 2.1.3

Ruifeng Zheng created SPARK-51627: - Summary: Add a schedule workflow for numpy 2.1.3 Key: SPARK-51627 URL: https://issues.apache.org/jira/browse/SPARK-51627 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-51619) Support UDT in Arrow-optimized Python UDF.

Takuya Ueshin created SPARK-51619: - Summary: Support UDT in Arrow-optimized Python UDF. Key: SPARK-51619 URL: https://issues.apache.org/jira/browse/SPARK-51619 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-51628) Clean up the assembly module before maven testing in maven daily test

[ https://issues.apache.org/jira/browse/SPARK-51628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51628: - Description: Before actually executing `mvn test` in the Maven daily test, a process of `mvn clean -pl a

[jira] [Updated] (SPARK-51628) Clean up the assembly module before maven testing in maven daily test

[ https://issues.apache.org/jira/browse/SPARK-51628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51628: - Issue Type: Bug (was: Test) > Clean up the assembly module before maven testing in maven daily test > -

[jira] [Resolved] (SPARK-51626) Support `DataFrameReader`

[ https://issues.apache.org/jira/browse/SPARK-51626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51626. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Created] (SPARK-51608) Better log exception in python udf worker.

Dmitry created SPARK-51608: -- Summary: Better log exception in python udf worker. Key: SPARK-51608 URL: https://issues.apache.org/jira/browse/SPARK-51608 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51609) Optimize simple queries

[ https://issues.apache.org/jira/browse/SPARK-51609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavle Martinović updated SPARK-51609: - Description: We would like to speed up the execution RecursiveCTEs. It is possible to op

[jira] [Created] (SPARK-51610) Support the TIME data type in the parquet datasource

Max Gekk created SPARK-51610: Summary: Support the TIME data type in the parquet datasource Key: SPARK-51610 URL: https://issues.apache.org/jira/browse/SPARK-51610 Project: Spark Issue Type: Sub-

[jira] [Assigned] (SPARK-51574) Implement filters

[ https://issues.apache.org/jira/browse/SPARK-51574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51574: --- Assignee: Haoyu Weng > Implement filters > - > > Key: SPARK

[jira] [Resolved] (SPARK-51496) CaseInsensitiveStringMap comparison should ignore case

[ https://issues.apache.org/jira/browse/SPARK-51496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51496. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50275 [https://gith

[jira] [Created] (SPARK-51611) Implement new single-pass Analyzer functionality

Vladimir Golubev created SPARK-51611: Summary: Implement new single-pass Analyzer functionality Key: SPARK-51611 URL: https://issues.apache.org/jira/browse/SPARK-51611 Project: Spark Issu

[jira] [Commented] (SPARK-45900) Expand hash functionalities from to include XXH3

[ https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938631#comment-17938631 ] Dmitry Kravchuk commented on SPARK-45900: - We also need this feature) > Expand

[jira] [Updated] (SPARK-51611) Implement new single-pass Analyzer functionality

[ https://issues.apache.org/jira/browse/SPARK-51611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51611: --- Labels: pull-request-available (was: ) > Implement new single-pass Analyzer functionality >

[jira] [Resolved] (SPARK-51600) Should prepend `sql/hive`/`sql/hive-thriftserver` when `isTesting || isTestingSql` is true

[ https://issues.apache.org/jira/browse/SPARK-51600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51600. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50385 [https://github.com

[jira] [Created] (SPARK-51615) Refactor ShowNamespaces to use RunnableCommand

Szehon Ho created SPARK-51615: - Summary: Refactor ShowNamespaces to use RunnableCommand Key: SPARK-51615 URL: https://issues.apache.org/jira/browse/SPARK-51615 Project: Spark Issue Type: New Feat

[jira] [Updated] (SPARK-51615) Refactor ShowNamespaces to use RunnableCommand

[ https://issues.apache.org/jira/browse/SPARK-51615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51615: --- Labels: pull-request-available (was: ) > Refactor ShowNamespaces to use RunnableCommand > -

[jira] [Updated] (SPARK-51614) Fix error message when there is a Generate under an UnresolvedHaving

[ https://issues.apache.org/jira/browse/SPARK-51614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51614: --- Labels: pull-request-available (was: ) > Fix error message when there is a Generate under a

[jira] [Updated] (SPARK-51609) Optimize Recursive CTE execution for simple queries

[ https://issues.apache.org/jira/browse/SPARK-51609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51609: --- Labels: pull-request-available (was: ) > Optimize Recursive CTE execution for simple querie

[jira] [Updated] (SPARK-51587) [PySpark] Fix an issue where timestamp cannot be used in ListState when multiple state data is involved

[ https://issues.apache.org/jira/browse/SPARK-51587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-51587: - Issue Type: Bug (was: Task) > [PySpark] Fix an issue where timestamp cannot be used in ListStat

[jira] [Commented] (SPARK-51606) After exiting the remote local connect shell, the SparkConnectServer will not terminate.

[ https://issues.apache.org/jira/browse/SPARK-51606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938496#comment-17938496 ] Yang Jie commented on SPARK-51606: -- cc [~gurwls223]  > After exiting the remote local

[jira] [Assigned] (SPARK-51607) the configuration for `maven-shade-plugin` should be set to `combine.self = "override"` In the `connect` modules

[ https://issues.apache.org/jira/browse/SPARK-51607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51607: Assignee: Yang Jie > the configuration for `maven-shade-plugin` should be set to `combine.self =

[jira] [Assigned] (SPARK-51600) Should prepend `sql/hive`/`sql/hive-thriftserver` when `isTesting || isTestingSql` is true

[ https://issues.apache.org/jira/browse/SPARK-51600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51600: Assignee: Yang Jie > Should prepend `sql/hive`/`sql/hive-thriftserver` when `isTesting || > isTe

[jira] [Created] (SPARK-51614) Fix error message when there is a Generate under an UnresolvedHaving

Mihailo Aleksic created SPARK-51614: --- Summary: Fix error message when there is a Generate under an UnresolvedHaving Key: SPARK-51614 URL: https://issues.apache.org/jira/browse/SPARK-51614 Project: S

[jira] [Resolved] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51577. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-51577) Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds

[ https://issues.apache.org/jira/browse/SPARK-51577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51577: - Assignee: Zhou JIANG > Make gradle build to automatically append SNAPSHOT suffix to ver

[jira] [Created] (SPARK-51612) Display view creation confs in Desc As Json

Amanda Liu created SPARK-51612: -- Summary: Display view creation confs in Desc As Json Key: SPARK-51612 URL: https://issues.apache.org/jira/browse/SPARK-51612 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-51613) Improve Spark Operator metrics

Damon Cortesi created SPARK-51613: - Summary: Improve Spark Operator metrics Key: SPARK-51613 URL: https://issues.apache.org/jira/browse/SPARK-51613 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-51607) the configuration for `maven-shade-plugin` should be set to `combine.self = "override"` In the `connect` modules

[ https://issues.apache.org/jira/browse/SPARK-51607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51607. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50401 [https://github.com

[jira] [Updated] (SPARK-51612) Display Spark confs set at view creation in Desc As Json

[ https://issues.apache.org/jira/browse/SPARK-51612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-51612: --- Summary: Display Spark confs set at view creation in Desc As Json (was: Display view creation confs

[jira] [Updated] (SPARK-51610) Support the TIME data type in the parquet datasource

[ https://issues.apache.org/jira/browse/SPARK-51610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51610: --- Labels: pull-request-available (was: ) > Support the TIME data type in the parquet datasour

[jira] [Updated] (SPARK-51615) Refactor ShowNamespaces to use RunnableCommand

[ https://issues.apache.org/jira/browse/SPARK-51615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated SPARK-51615: -- Issue Type: Improvement (was: New Feature) > Refactor ShowNamespaces to use RunnableCommand > ---

[jira] [Updated] (SPARK-51612) Display Spark confs set at view creation in Desc As Json

[ https://issues.apache.org/jira/browse/SPARK-51612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51612: --- Labels: pull-request-available (was: ) > Display Spark confs set at view creation in Desc A

[jira] [Resolved] (SPARK-51318) Remove `jar` files from Apache Spark repository and disable affected tests

[ https://issues.apache.org/jira/browse/SPARK-51318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51318. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50378 [https://gi

[jira] [Assigned] (SPARK-51318) Remove `jar` files from Apache Spark repository and disable affected tests

[ https://issues.apache.org/jira/browse/SPARK-51318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51318: Assignee: Hyukjin Kwon > Remove `jar` files from Apache Spark repository and disable affe

[jira] [Created] (SPARK-51620) Support `columns` for `DataFrame`

Dongjoon Hyun created SPARK-51620: - Summary: Support `columns` for `DataFrame` Key: SPARK-51620 URL: https://issues.apache.org/jira/browse/SPARK-51620 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51620) Support `columns` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51620: --- Labels: pull-request-available (was: ) > Support `columns` for `DataFrame` > --

[jira] [Assigned] (SPARK-51612) Display Spark confs set at view creation in Desc As Json

[ https://issues.apache.org/jira/browse/SPARK-51612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-51612: -- Assignee: Amanda Liu > Display Spark confs set at view creation in Desc As Json > ---

[jira] [Resolved] (SPARK-51612) Display Spark confs set at view creation in Desc As Json

[ https://issues.apache.org/jira/browse/SPARK-51612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51612. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50407 [https:

[jira] [Assigned] (SPARK-51588) Validate default values handling in micro-batch streaming writes

[ https://issues.apache.org/jira/browse/SPARK-51588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51588: Assignee: Anton Okolnychyi > Validate default values handling in micro-batch streaming wr

[jira] [Resolved] (SPARK-51588) Validate default values handling in micro-batch streaming writes

[ https://issues.apache.org/jira/browse/SPARK-51588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51588. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50351 [https://gi

[jira] [Created] (SPARK-51616) Run CollationTypeCasts explicitly before assigning aliases

Vladimir Golubev created SPARK-51616: Summary: Run CollationTypeCasts explicitly before assigning aliases Key: SPARK-51616 URL: https://issues.apache.org/jira/browse/SPARK-51616 Project: Spark

[jira] [Assigned] (SPARK-51617) Explicitly commit/revert jar removals

[ https://issues.apache.org/jira/browse/SPARK-51617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51617: Assignee: Hyukjin Kwon > Explicitly commit/revert jar removals >

[jira] [Resolved] (SPARK-51617) Explicitly commit/revert jar removals

[ https://issues.apache.org/jira/browse/SPARK-51617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51617. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50415 [https://gi

[jira] [Updated] (SPARK-51617) Explicitly commit/revert jar removals

[ https://issues.apache.org/jira/browse/SPARK-51617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51617: - Summary: Explicitly commit/revert jar removals (was: Restore the test jars at the end of releas

[jira] [Updated] (SPARK-51617) Explicitly commit/revert jar removals

[ https://issues.apache.org/jira/browse/SPARK-51617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51617: --- Labels: pull-request-available (was: ) > Explicitly commit/revert jar removals > --

[jira] [Created] (SPARK-51618) Add a check for jars in CI

Hyukjin Kwon created SPARK-51618: Summary: Add a check for jars in CI Key: SPARK-51618 URL: https://issues.apache.org/jira/browse/SPARK-51618 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-51585) Oracle dialect supports pushdown datetime functions.

Jiaan Geng created SPARK-51585: -- Summary: Oracle dialect supports pushdown datetime functions. Key: SPARK-51585 URL: https://issues.apache.org/jira/browse/SPARK-51585 Project: Spark Issue Type:

[jira] [Updated] (SPARK-51619) Support UDT in Arrow-optimized Python UDF.

[ https://issues.apache.org/jira/browse/SPARK-51619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51619: --- Labels: pull-request-available (was: ) > Support UDT in Arrow-optimized Python UDF. > -

[jira] [Resolved] (SPARK-51544) Add only unique and necessary metadata columns

[ https://issues.apache.org/jira/browse/SPARK-51544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51544. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50304 [https://gith

[jira] [Created] (SPARK-51617) Restore the test jars at the end of release process

Hyukjin Kwon created SPARK-51617: Summary: Restore the test jars at the end of release process Key: SPARK-51617 URL: https://issues.apache.org/jira/browse/SPARK-51617 Project: Spark Issue Typ

[jira] [Commented] (SPARK-51605) If the `logs` directory does not exist, the first launch of `bin/spark-shell --remote local` will fail.

[ https://issues.apache.org/jira/browse/SPARK-51605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938758#comment-17938758 ] Hyukjin Kwon commented on SPARK-51605: -- Ack > If the `logs` directory does not exi

[jira] [Updated] (SPARK-51621) Support `sparkSession` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51621: --- Labels: pull-request-available (was: ) > Support `sparkSession` for `DataFrame` > -

[jira] [Commented] (SPARK-46860) Credentials with https url not working for --jars, --files, --archives & --py-files options on spark-submit command

[ https://issues.apache.org/jira/browse/SPARK-46860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938513#comment-17938513 ] Krzysztof Ruta commented on SPARK-46860: I did some research and experiments. I

[jira] [Comment Edited] (SPARK-46860) Credentials with https url not working for --jars, --files, --archives & --py-files options on spark-submit command

[ https://issues.apache.org/jira/browse/SPARK-46860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938513#comment-17938513 ] Krzysztof Ruta edited comment on SPARK-46860 at 3/26/25 9:37 AM: -

[jira] [Commented] (SPARK-46860) Credentials with https url not working for --jars, --files, --archives & --py-files options on spark-submit command

[ https://issues.apache.org/jira/browse/SPARK-46860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938515#comment-17938515 ] Krzysztof Ruta commented on SPARK-46860: Anyway I am not sure what's gonna happe

[jira] [Updated] (SPARK-51609) Optimize Recursive CTE execution forsimple queries

[ https://issues.apache.org/jira/browse/SPARK-51609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavle Martinović updated SPARK-51609: - Summary: Optimize Recursive CTE execution forsimple queries (was: Optimize simple queri

[jira] [Updated] (SPARK-51609) Optimize Recursive CTE execution for simple queries

[ https://issues.apache.org/jira/browse/SPARK-51609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavle Martinović updated SPARK-51609: - Summary: Optimize Recursive CTE execution for simple queries (was: Optimize Recursive C

[jira] [Updated] (SPARK-51574) Implement filters

[ https://issues.apache.org/jira/browse/SPARK-51574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51574: --- Labels: pull-request-available (was: ) > Implement filters > - > >

[jira] [Resolved] (SPARK-51574) Implement filters

[ https://issues.apache.org/jira/browse/SPARK-51574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51574. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50252 [https://gith

[jira] [Updated] (SPARK-51587) [PySpark] Fix an issue where timestamp cannot be used in ListState when multiple state data is involved

[ https://issues.apache.org/jira/browse/SPARK-51587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-51587: - Fix Version/s: 4.0.0 (was: 4.1.0) > [PySpark] Fix an issue where timestam

[jira] [Updated] (SPARK-51608) Better log exception in python udf worker.

[ https://issues.apache.org/jira/browse/SPARK-51608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51608: --- Labels: pull-request-available (was: ) > Better log exception in python udf worker. > -

[jira] [Created] (SPARK-51609) Optimize simple queries

Pavle Martinović created SPARK-51609: Summary: Optimize simple queries Key: SPARK-51609 URL: https://issues.apache.org/jira/browse/SPARK-51609 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-51605) If the `logs` directory does not exist, the first launch of `bin/spark-shell --remote local` will fail.

[ https://issues.apache.org/jira/browse/SPARK-51605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938497#comment-17938497 ] Yang Jie commented on SPARK-51605: -- cc [~gurwls223]  > If the `logs` directory does no

[jira] [Updated] (SPARK-51606) After exiting the remote local connect shell, the SparkConnectServer will not terminate.

[ https://issues.apache.org/jira/browse/SPARK-51606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51606: - Affects Version/s: 4.0.0 > After exiting the remote local connect shell, the SparkConnectServer will not

[jira] [Updated] (SPARK-51605) If the `logs` directory does not exist, the first launch of `bin/spark-shell --remote local` will fail.

[ https://issues.apache.org/jira/browse/SPARK-51605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51605: - Affects Version/s: 4.0.0 > If the `logs` directory does not exist, the first launch of `bin/spark-shell

[jira] [Commented] (SPARK-51606) After exiting the remote local connect shell, the SparkConnectServer will not terminate.

[ https://issues.apache.org/jira/browse/SPARK-51606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938500#comment-17938500 ] Hyukjin Kwon commented on SPARK-51606: -- thanks. Will take a look. > After exiting

[jira] [Created] (SPARK-51604) split test_connect_session

Ruifeng Zheng created SPARK-51604: - Summary: split test_connect_session Key: SPARK-51604 URL: https://issues.apache.org/jira/browse/SPARK-51604 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column after RewriteSubquery

[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Summary: An optimization for SparkOptimizer to prune the column after RewriteSubquery (was: An optimiz

[jira] [Updated] (SPARK-51604) split test_connect_session

[ https://issues.apache.org/jira/browse/SPARK-51604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51604: --- Labels: pull-request-available (was: ) > split test_connect_session > -

[jira] [Resolved] (SPARK-51350) Implement Show Procedures

[ https://issues.apache.org/jira/browse/SPARK-51350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51350. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50109 [https://gith

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column after RewriteSubquery

[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Summary: An optimization for SparkOptimizer to prune the column after RewriteSubquery (was: An optimiza

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune column after RewriteSubquery

[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Summary: An optimization for SparkOptimizer to prune column after RewriteSubquery (was: An optimization

[jira] [Created] (SPARK-51605) If the `logs` directory does not exist, the first launch of `bin/spark-shell --remote local` will fail.

Yang Jie created SPARK-51605: Summary: If the `logs` directory does not exist, the first launch of `bin/spark-shell --remote local` will fail. Key: SPARK-51605 URL: https://issues.apache.org/jira/browse/SPARK-51605

[jira] [Created] (SPARK-51606) After exiting the remote local connect shell, the SparkConnectServer will not terminate.

Yang Jie created SPARK-51606: Summary: After exiting the remote local connect shell, the SparkConnectServer will not terminate. Key: SPARK-51606 URL: https://issues.apache.org/jira/browse/SPARK-51606 Proj

[jira] [Resolved] (SPARK-51604) split test_connect_session

[ https://issues.apache.org/jira/browse/SPARK-51604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51604. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50397 [https://

[jira] [Updated] (SPARK-51607) the configuration for `maven-shade-plugin` should be set to `combine.self = "override"` In the `connect` modules

[ https://issues.apache.org/jira/browse/SPARK-51607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51607: --- Labels: pull-request-available (was: ) > the configuration for `maven-shade-plugin` should

[jira] [Created] (SPARK-51607) the configuration for `maven-shade-plugin` should be set to `combine.self = "override"` In the `connect` modules

Yang Jie created SPARK-51607: Summary: the configuration for `maven-shade-plugin` should be set to `combine.self = "override"` In the `connect` modules Key: SPARK-51607 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Created] (SPARK-51622) Titling sections on ExecutionPage

Kent Yao created SPARK-51622: Summary: Titling sections on ExecutionPage Key: SPARK-51622 URL: https://issues.apache.org/jira/browse/SPARK-51622 Project: Spark Issue Type: Improvement C

[jira] [Updated] (SPARK-51622) Titling sections on ExecutionPage

[ https://issues.apache.org/jira/browse/SPARK-51622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51622: --- Labels: pull-request-available (was: ) > Titling sections on ExecutionPage > --

[jira] [Created] (SPARK-51624) Propagate GetStructField metadata in CreateNamedStruct.dataType

Andy Lam created SPARK-51624: Summary: Propagate GetStructField metadata in CreateNamedStruct.dataType Key: SPARK-51624 URL: https://issues.apache.org/jira/browse/SPARK-51624 Project: Spark Issu

[jira] [Assigned] (SPARK-51573) Fix Streaming State Checkpoint v2 checkpointInfo race condition

[ https://issues.apache.org/jira/browse/SPARK-51573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51573: Assignee: Livia Zhu > Fix Streaming State Checkpoint v2 checkpointInfo race condition > -

[jira] [Assigned] (SPARK-51621) Support `sparkSession` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51621: - Assignee: Dongjoon Hyun > Support `sparkSession` for `DataFrame` >

[jira] [Resolved] (SPARK-51621) Support `sparkSession` for `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51621. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Updated] (SPARK-51623) Remove class files in source releases

[ https://issues.apache.org/jira/browse/SPARK-51623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51623: --- Labels: pull-request-available (was: ) > Remove class files in source releases > --

[jira] [Resolved] (SPARK-51573) Fix Streaming State Checkpoint v2 checkpointInfo race condition

[ https://issues.apache.org/jira/browse/SPARK-51573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51573. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50344 [https://gi

[jira] [Resolved] (SPARK-51605) If the `logs` directory does not exist, the first launch of `bin/spark-shell --remote local` will fail.

[ https://issues.apache.org/jira/browse/SPARK-51605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51605. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50421 [https://github.com

[jira] [Resolved] (SPARK-51618) Add a check for jars in CI

[ https://issues.apache.org/jira/browse/SPARK-51618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51618. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50416 [https://gi

[jira] [Assigned] (SPARK-51618) Add a check for jars in CI

[ https://issues.apache.org/jira/browse/SPARK-51618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51618: Assignee: Hyukjin Kwon > Add a check for jars in CI > -- > >

  1   2   >