[jira] [Updated] (SPARK-53789) Unify error condition CANNOT_MODIFY_CONFIG

[ https://issues.apache.org/jira/browse/SPARK-53789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53789: --- Labels: pull-request-available (was: ) > Unify error condition CANNOT_MODIFY_CON

[jira] [Created] (SPARK-53782) Use `slf4j-api` as a direct dependency

Dongjoon Hyun created SPARK-53782: - Summary: Use `slf4j-api` as a direct dependency Key: SPARK-53782 URL: https://issues.apache.org/jira/browse/SPARK-53782 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-53789) Unify error condition CANNOT_MODIFY_CONFIG

Cheng Pan created SPARK-53789: - Summary: Unify error condition CANNOT_MODIFY_CONFIG Key: SPARK-53789 URL: https://issues.apache.org/jira/browse/SPARK-53789 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-53786) Default value should not conflict with special column name

Szehon Ho created SPARK-53786: - Summary: Default value should not conflict with special column name Key: SPARK-53786 URL: https://issues.apache.org/jira/browse/SPARK-53786 Project: Spark Issue

[jira] [Assigned] (SPARK-53787) Upgrade Spark to 4.1.0-preview2

[ https://issues.apache.org/jira/browse/SPARK-53787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53787: - Assignee: Dongjoon Hyun > Upgrade Spark to 4.1.0-previ

[jira] [Assigned] (SPARK-52604) Release Spark Kubernetes Operator 0.5.0 (v1)

[ https://issues.apache.org/jira/browse/SPARK-52604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52604: - Assignee: Dongjoon Hyun > Release Spark Kubernetes Operator 0.5.0

[jira] [Updated] (SPARK-53788) Move VersionUtils to common utils

[ https://issues.apache.org/jira/browse/SPARK-53788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53788: --- Labels: pull-request-available (was: ) > Move VersionUtils to common ut

[jira] [Resolved] (SPARK-53787) Upgrade Spark to 4.1.0-preview2

[ https://issues.apache.org/jira/browse/SPARK-53787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53787. --- Fix Version/s: kubernetes-operator-0.6.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-53781) Exclude Spark's transitive dependencies consistently across modules

[ https://issues.apache.org/jira/browse/SPARK-53781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53781. --- Fix Version/s: kubernetes-operator-0.6.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-52604) Release Spark Kubernetes Operator 0.5.0 (v1)

[ https://issues.apache.org/jira/browse/SPARK-52604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52604. --- Fix Version/s: kubernetes-operator-0.5.0 Resolution: Fixed > Release Sp

[jira] [Created] (SPARK-53788) Move VersionUtils to common utils

Cheng Pan created SPARK-53788: - Summary: Move VersionUtils to common utils Key: SPARK-53788 URL: https://issues.apache.org/jira/browse/SPARK-53788 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-53787) Upgrade Spark to 4.1.0-preview2

[ https://issues.apache.org/jira/browse/SPARK-53787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53787: --- Labels: pull-request-available (was: ) > Upgrade Spark to 4.1.0-previ

[jira] [Created] (SPARK-53787) Upgrade Spark to 4.1.0-preview2

Dongjoon Hyun created SPARK-53787: - Summary: Upgrade Spark to 4.1.0-preview2 Key: SPARK-53787 URL: https://issues.apache.org/jira/browse/SPARK-53787 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-53447) How to configure multiple Hive Metastores in a single Spark session?

[ https://issues.apache.org/jira/browse/SPARK-53447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024218#comment-18024218 ] Cheng Pan commented on SPARK-53447: --- Apache Kyuubi has a Spark Hive Connector b

[jira] [Updated] (SPARK-53780) `spark-submission-worker` should depend on `io.fabric8` directly

[ https://issues.apache.org/jira/browse/SPARK-53780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53780: --- Labels: pull-request-available (was: ) > `spark-submission-worker` should depend

[jira] [Updated] (SPARK-53786) Default value should not conflict with special column name

[ https://issues.apache.org/jira/browse/SPARK-53786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53786: --- Labels: pull-request-available (was: ) > Default value should not conflict with spec

[jira] [Updated] (SPARK-53785) Memory Source for RTM

[ https://issues.apache.org/jira/browse/SPARK-53785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53785: --- Labels: pull-request-available (was: ) > Memory Source for

[jira] [Created] (SPARK-53785) Memory Source for RTM

Boyang Jerry Peng created SPARK-53785: - Summary: Memory Source for RTM Key: SPARK-53785 URL: https://issues.apache.org/jira/browse/SPARK-53785 Project: Spark Issue Type: Story

[jira] [Updated] (SPARK-53784) Additional Source APIs needed to support RTM execution

[ https://issues.apache.org/jira/browse/SPARK-53784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53784: --- Labels: pull-request-available (was: ) > Additional Source APIs needed to support

[jira] [Updated] (SPARK-53784) Additional Source APIs needed to support RTM execution

[ https://issues.apache.org/jira/browse/SPARK-53784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-53784: -- Description: Currently in Structured Streaming, start and end offsets are determined

[jira] [Updated] (SPARK-53784) Additional Source APIs needed to support RTM execution

[ https://issues.apache.org/jira/browse/SPARK-53784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-53784: -- Description: Currently in Structured Streaming, start and end offsets are determined

[jira] [Updated] (SPARK-53783) Use `log4j2` instead of `log4j`

[ https://issues.apache.org/jira/browse/SPARK-53783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53783: -- Priority: Critical (was: Major) > Use `log4j2` instead of `lo

[jira] [Created] (SPARK-53783) Use `log4j2` instead of `log4j`

Dongjoon Hyun created SPARK-53783: - Summary: Use `log4j2` instead of `log4j` Key: SPARK-53783 URL: https://issues.apache.org/jira/browse/SPARK-53783 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-53784) Additional Source APIs needed to support RTM execution

[ https://issues.apache.org/jira/browse/SPARK-53784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-53784: -- Description: Currently in Structured Streaming, start and end offsets are determined

[jira] [Updated] (SPARK-53736) Real-time Mode in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-53736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-53736: -- Shepherd: L. C. Hsieh > Real-time Mode in Structured Stream

[jira] [Created] (SPARK-53784) Additional Source APIs needed to support RTM execution

Boyang Jerry Peng created SPARK-53784: - Summary: Additional Source APIs needed to support RTM execution Key: SPARK-53784 URL: https://issues.apache.org/jira/browse/SPARK-53784 Project: Spark

[jira] [Assigned] (SPARK-53783) Use `log4j2` instead of `log4j`

[ https://issues.apache.org/jira/browse/SPARK-53783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53783: - Assignee: Dongjoon Hyun > Use `log4j2` instead of `lo

[jira] [Resolved] (SPARK-53783) Use `log4j2` instead of `log4j`

[ https://issues.apache.org/jira/browse/SPARK-53783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53783. --- Fix Version/s: kubernetes-operator-0.6.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-53782) Use `slf4j-api` as a direct dependency

[ https://issues.apache.org/jira/browse/SPARK-53782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53782: - Assignee: Dongjoon Hyun > Use `slf4j-api` as a direct depende

[jira] [Updated] (SPARK-53783) Use `log4j2` instead of `log4j`

[ https://issues.apache.org/jira/browse/SPARK-53783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53783: --- Labels: pull-request-available (was: ) > Use `log4j2` instead of `lo

[jira] [Updated] (SPARK-53783) Use `log4j2` instead of `log4j`

[ https://issues.apache.org/jira/browse/SPARK-53783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53783: -- Summary: Use `log4j2` instead of `log4j` (was: Use `log4j2` instead of `log4j` consistently

[jira] [Updated] (SPARK-53783) Use `log4j2` instead of `log4j` consistently

[ https://issues.apache.org/jira/browse/SPARK-53783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53783: -- Summary: Use `log4j2` instead of `log4j` consistently (was: Use `log4j2` instead of `log4j

[jira] [Created] (SPARK-53781) Exclude Spark's transitive dependencies consistently

Dongjoon Hyun created SPARK-53781: - Summary: Exclude Spark's transitive dependencies consistently Key: SPARK-53781 URL: https://issues.apache.org/jira/browse/SPARK-53781 Project: Spark

[jira] [Resolved] (SPARK-53782) Use `slf4j-api` as a direct dependency

[ https://issues.apache.org/jira/browse/SPARK-53782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53782. --- Fix Version/s: kubernetes-operator-0.6.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-53782) Use `slf4j-api` as a direct dependency

[ https://issues.apache.org/jira/browse/SPARK-53782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53782: --- Labels: pull-request-available (was: ) > Use `slf4j-api` as a direct depende

[jira] [Assigned] (SPARK-53777) Update `Spark Connect`-generated `Swift` source code with 4.1.0-preview2

[ https://issues.apache.org/jira/browse/SPARK-53777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53777: - Assignee: Dongjoon Hyun > Update `Spark Connect`-generated `Swift` source code w

[jira] [Assigned] (SPARK-53781) Exclude Spark's transitive dependencies consistently across modules

[ https://issues.apache.org/jira/browse/SPARK-53781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53781: - Assignee: Dongjoon Hyun > Exclude Spark's transitive dependencies consistentl

[jira] [Updated] (SPARK-53776) Support Spark Context Manager Support in Connect Mode

[ https://issues.apache.org/jira/browse/SPARK-53776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53776: --- Labels: pull-request-available (was: ) > Support Spark Context Manager Support in Conn

[jira] [Assigned] (SPARK-53780) `spark-submission-worker` should depend on `io.fabric8` directly

[ https://issues.apache.org/jira/browse/SPARK-53780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53780: - Assignee: Dongjoon Hyun > `spark-submission-worker` should depend on `io.fabr

[jira] [Resolved] (SPARK-53780) `spark-submission-worker` should depend on `io.fabric8` directly

[ https://issues.apache.org/jira/browse/SPARK-53780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53780. --- Fix Version/s: kubernetes-operator-0.6.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-53737) Add Real-time Mode trigger

[ https://issues.apache.org/jira/browse/SPARK-53737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-53737: --- Assignee: Boyang Jerry Peng > Add Real-time Mode trig

[jira] [Resolved] (SPARK-52614) Support row encoder inside product

[ https://issues.apache.org/jira/browse/SPARK-52614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-52614. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51319

[jira] [Assigned] (SPARK-52614) Support row encoder inside product

[ https://issues.apache.org/jira/browse/SPARK-52614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-52614: - Assignee: Emil Ejbyfeldt > Support row encoder inside prod

[jira] [Created] (SPARK-53780) `spark-submission-worker` should depend on `io.fabric8` directly

Dongjoon Hyun created SPARK-53780: - Summary: `spark-submission-worker` should depend on `io.fabric8` directly Key: SPARK-53780 URL: https://issues.apache.org/jira/browse/SPARK-53780 Project: Spark

[jira] [Commented] (SPARK-53771) Add config to use LargeListType in Arrow Schema

[ https://issues.apache.org/jira/browse/SPARK-53771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024154#comment-18024154 ] Yicong Huang commented on SPARK-53771: -- PR opened https://github.com/apache/s

[jira] [Updated] (SPARK-53778) Use JDK25 Gradle Image

[ https://issues.apache.org/jira/browse/SPARK-53778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53778: --- Labels: pull-request-available (was: ) > Use JDK25 Gradle Im

[jira] [Assigned] (SPARK-53778) Use JDK25 Gradle Image as builder images

[ https://issues.apache.org/jira/browse/SPARK-53778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53778: - Assignee: Dongjoon Hyun > Use JDK25 Gradle Image as builder ima

[jira] [Updated] (SPARK-53778) Use JDK25 Gradle Image as builder images

[ https://issues.apache.org/jira/browse/SPARK-53778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53778: -- Summary: Use JDK25 Gradle Image as builder images (was: Use JDK25 Gradle Image) > Use JD

[jira] [Created] (SPARK-53778) Use JDK25 Gradle Image

Dongjoon Hyun created SPARK-53778: - Summary: Use JDK25 Gradle Image Key: SPARK-53778 URL: https://issues.apache.org/jira/browse/SPARK-53778 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-53777) Update `Spark Connect`-generated `Swift` source code with 4.1.0-preview2

[ https://issues.apache.org/jira/browse/SPARK-53777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53777. --- Fix Version/s: connect-swift-0.5.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-53777) Update `Spark Connect`-generated `Swift` source code with 4.1.0-preview2

Dongjoon Hyun created SPARK-53777: - Summary: Update `Spark Connect`-generated `Swift` source code with 4.1.0-preview2 Key: SPARK-53777 URL: https://issues.apache.org/jira/browse/SPARK-53777 Project

[jira] [Resolved] (SPARK-52377) Release Spark Connect Swift Client 0.4.0

[ https://issues.apache.org/jira/browse/SPARK-52377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52377. --- Fix Version/s: connect-swift-0.4.0 Assignee: Dongjoon Hyun Resolution: Fixed

[jira] [Created] (SPARK-53775) Spark 4 on k3s NoSuchMethodError in io.netty.util.internal.PlatformDependent

rami created SPARK-53775: Summary: Spark 4 on k3s NoSuchMethodError in io.netty.util.internal.PlatformDependent Key: SPARK-53775 URL: https://issues.apache.org/jira/browse/SPARK-53775 Project: Spark

[jira] [Resolved] (SPARK-53741) Upgrade ORC to 2.2.1

[ https://issues.apache.org/jira/browse/SPARK-53741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53741. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52478 [https

[jira] [Resolved] (SPARK-53774) Update Spark Connect-generated Swift code with protoc-gen-grpc-swift-2 v2.1.1

[ https://issues.apache.org/jira/browse/SPARK-53774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53774. --- Fix Version/s: connect-swift-0.5.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-53536) Add a Golden File Test With Randomly Generated SQL Scripts

[ https://issues.apache.org/jira/browse/SPARK-53536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-53536. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52287 [https

[jira] [Updated] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-33349: --- Labels: pull-request-available (was: ) > ExecutorPodsWatchSnapshotSource: Kuberne

[jira] [Created] (SPARK-53763) Update `integration-test-ubuntu-spark41` to use Spark `4.1.0-preview2`

Dongjoon Hyun created SPARK-53763: - Summary: Update `integration-test-ubuntu-spark41` to use Spark `4.1.0-preview2` Key: SPARK-53763 URL: https://issues.apache.org/jira/browse/SPARK-53763 Project

[jira] [Created] (SPARK-53771) Add config to use LargeListType in Arrow Schema

Yicong Huang created SPARK-53771: Summary: Add config to use LargeListType in Arrow Schema Key: SPARK-53771 URL: https://issues.apache.org/jira/browse/SPARK-53771 Project: Spark Issue Type

[jira] [Assigned] (SPARK-53767) Upgrade `Dropwizard` metrics to 4.2.33

[ https://issues.apache.org/jira/browse/SPARK-53767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53767: - Assignee: Dongjoon Hyun > Upgrade `Dropwizard` metrics to 4.2

[jira] [Commented] (SPARK-53771) Add config to use LargeListType in Arrow Schema

[ https://issues.apache.org/jira/browse/SPARK-53771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18023955#comment-18023955 ] Yicong Huang commented on SPARK-53771: -- I will work on this. > Add config

[jira] [Comment Edited] (SPARK-53758) EXIT handler not exiting properly if triggered from another EXIT handler

[ https://issues.apache.org/jira/browse/SPARK-53758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18023827#comment-18023827 ] David Milicevic edited comment on SPARK-53758 at 9/30/25 2:2

[jira] [Updated] (SPARK-53762) Add date and time conversions simplifier rule to optimizer

[ https://issues.apache.org/jira/browse/SPARK-53762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53762: --- Labels: pull-request-available (was: ) > Add date and time conversions simplifier rule

[jira] [Assigned] (SPARK-53770) Upgrade `mockito` to 5.20.0

[ https://issues.apache.org/jira/browse/SPARK-53770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53770: - Assignee: Dongjoon Hyun > Upgrade `mockito` to 5.2

[jira] [Updated] (SPARK-53769) Enable `Annotation Processing` during compilation

[ https://issues.apache.org/jira/browse/SPARK-53769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53769: -- Summary: Enable `Annotation Processing` during compilation (was: Enable `Annotation

[jira] [Assigned] (SPARK-53768) Upgrade `lombok` to 1.18.42

[ https://issues.apache.org/jira/browse/SPARK-53768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53768: - Assignee: Dongjoon Hyun > Upgrade `lombok` to 1.18

[jira] [Updated] (SPARK-53766) Document improvements to EXECUTE IMMEDIATE

[ https://issues.apache.org/jira/browse/SPARK-53766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53766: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Document improveme

[jira] [Assigned] (SPARK-53765) Remove Daily `integration-test-linux` GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-53765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53765: - Assignee: Dongjoon Hyun > Remove Daily `integration-test-linux` GitHub Action

[jira] [Resolved] (SPARK-53621) Add support for executing CONTINUE HANDLER

[ https://issues.apache.org/jira/browse/SPARK-53621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-53621. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52371 [https

[jira] [Updated] (SPARK-53762) Add DataTime conversion simlifier rule to optimizer

[ https://issues.apache.org/jira/browse/SPARK-53762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-53762: --- Summary: Add DataTime conversion simlifier rule to optimizer (was: Add DataTime conversion

[jira] [Commented] (SPARK-53758) EXIT handler not exiting properly if triggered from another EXIT handler

[ https://issues.apache.org/jira/browse/SPARK-53758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18023827#comment-18023827 ] David Milicevic commented on SPARK-53758: - The issue is originating

[jira] [Updated] (SPARK-53730) Switch Spark 3.5 Java 11 docker registry images to 11-jammy

[ https://issues.apache.org/jira/browse/SPARK-53730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53730: --- Labels: pull-request-available (was: ) > Switch Spark 3.5 Java 11 docker registry ima

[jira] [Assigned] (SPARK-53734) Prefer table column over LCA in `UnresolvedExtractValue` extractor

[ https://issues.apache.org/jira/browse/SPARK-53734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-53734: --- Assignee: Mihailo Timotic > Prefer table column over LCA in `UnresolvedExtractVa

[jira] [Updated] (SPARK-53751) [SDP] Explicit Checkpoint Location

[ https://issues.apache.org/jira/browse/SPARK-53751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53751: --- Labels: pull-request-available (was: ) > [SDP] Explicit Checkpoint Locat

[jira] [Updated] (SPARK-53756) Flaky test: FileStreamSinkSuite."cleanup complete but invalid output for aborted job"

[ https://issues.apache.org/jira/browse/SPARK-53756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53756: --- Labels: pull-request-available (was: ) > Flaky test: FileStreamSinkSuite."cleanup

[jira] [Updated] (SPARK-53752) Publish Apache Spark 4.1.0-preview2 to docker registry

[ https://issues.apache.org/jira/browse/SPARK-53752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53752: --- Labels: pull-request-available (was: ) > Publish Apache Spark 4.1.0-preview2 to doc

[jira] [Updated] (SPARK-53067) Increase GCLockerRetryAllocationCount for SBT

[ https://issues.apache.org/jira/browse/SPARK-53067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53067: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Incre

[jira] [Resolved] (SPARK-53739) Add `pi-preview-with-eventlog.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-53739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-53739. --- Fix Version/s: kubernetes-operator-0.6.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-53748) Support CREATE OR REFRESH syntax in pipelines SQL files

Sanford Ryza created SPARK-53748: Summary: Support CREATE OR REFRESH syntax in pipelines SQL files Key: SPARK-53748 URL: https://issues.apache.org/jira/browse/SPARK-53748 Project: Spark

[jira] [Assigned] (SPARK-53728) [SDP] Print Event with Error In Test

[ https://issues.apache.org/jira/browse/SPARK-53728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-53728: -- Assignee: Jacky Wang > [SDP] Print Event with Error In T

[jira] [Resolved] (SPARK-53728) [SDP] Print Event with Error In Test

[ https://issues.apache.org/jira/browse/SPARK-53728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-53728. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 52463 [https

[jira] [Assigned] (SPARK-53735) Hide server-side JVM stack traces by default in spark-pipelines output

[ https://issues.apache.org/jira/browse/SPARK-53735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-53735: -- Assignee: Sanford Ryza > Hide server-side JVM stack traces by default in spark-pipeli

[jira] [Assigned] (SPARK-53575) Retry entire consumer stages for ShuffleFetchFailed when the producer stage is non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-53575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-53575: --- Assignee: Tengfei Huang > Retry entire consumer stages for ShuffleFetchFailed when

[jira] [Created] (SPARK-53744) Update Python black to 24.3.0

Cameron created SPARK-53744: --- Summary: Update Python black to 24.3.0 Key: SPARK-53744 URL: https://issues.apache.org/jira/browse/SPARK-53744 Project: Spark Issue Type: Dependency upgrade

[jira] [Updated] (SPARK-53690) SS | `avgOffsetsBehindLatest` in progress report show values in exponential notation for large numbers

[ https://issues.apache.org/jira/browse/SPARK-53690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-53690: - Fix Version/s: (was: 4.0.0) (was: 3.5.2) (was

[jira] [Updated] (SPARK-53743) ListState fetchWithArrow option does not work with PySpark Row type API

[ https://issues.apache.org/jira/browse/SPARK-53743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-53743: - Description: We got a report that TWS PySpark with Row type API failed on requesting

[jira] [Updated] (SPARK-53743) ListState fetchWithArrow option does not work with PySpark Row type API

[ https://issues.apache.org/jira/browse/SPARK-53743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-53743: - Description: We got a report that TWS PySpark with Row type API failed on requesting

[jira] [Updated] (SPARK-53742) Push down the filter used in the count_if function

[ https://issues.apache.org/jira/browse/SPARK-53742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ji Jun Tang updated SPARK-53742: Issue Type: Improvement (was: Bug) > Push down the filter used in the count_if funct

[jira] [Created] (SPARK-53742) Push down the filter used in the count_if function

Ji Jun Tang created SPARK-53742: --- Summary: Push down the filter used in the count_if function Key: SPARK-53742 URL: https://issues.apache.org/jira/browse/SPARK-53742 Project: Spark Issue Type

[jira] [Created] (SPARK-53739) Add `pi-preview-with-eventlog.yaml`

Dongjoon Hyun created SPARK-53739: - Summary: Add `pi-preview-with-eventlog.yaml` Key: SPARK-53739 URL: https://issues.apache.org/jira/browse/SPARK-53739 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-53673) Fix a flaky test failure in `SparkSessionE2ESuite - interrupt tag` caused by the usage of `ForkJoinPool`

[ https://issues.apache.org/jira/browse/SPARK-53673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53673: -- Fix Version/s: 3.5.8 > Fix a flaky test failure in `SparkSessionE2ESuite - interrupt

[jira] [Assigned] (SPARK-53739) Add `pi-preview-with-eventlog.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-53739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53739: - Assignee: Dongjoon Hyun > Add `pi-preview-with-eventlog.yaml` exam

[jira] [Created] (SPARK-53741) Upgrade ORC to 2.2.1

Dongjoon Hyun created SPARK-53741: - Summary: Upgrade ORC to 2.2.1 Key: SPARK-53741 URL: https://issues.apache.org/jira/browse/SPARK-53741 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-53741) Upgrade ORC to 2.2.1

[ https://issues.apache.org/jira/browse/SPARK-53741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53741: --- Labels: pull-request-available (was: ) > Upgrade ORC to 2.

[jira] [Assigned] (SPARK-53740) Update `(pi|spark-history-server)-preview.yaml` to use `4.1.0-preview2`

[ https://issues.apache.org/jira/browse/SPARK-53740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-53740: - Assignee: Dongjoon Hyun > Update `(pi|spark-history-server)-preview.yaml` to

[jira] [Updated] (SPARK-53740) Update `(pi|spark-history-server)-preview.yaml` to use `4.1.0-preview2`

[ https://issues.apache.org/jira/browse/SPARK-53740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53740: --- Labels: pull-request-available (was: ) > Update `(pi|spark-history-server)-preview.y

[jira] [Created] (SPARK-53740) Update `(pi|spark-history-server)-preview.yaml` to use `4.1.0-preview2`

Dongjoon Hyun created SPARK-53740: - Summary: Update `(pi|spark-history-server)-preview.yaml` to use `4.1.0-preview2` Key: SPARK-53740 URL: https://issues.apache.org/jira/browse/SPARK-53740 Project

[jira] [Updated] (SPARK-53739) Add `pi-preview-with-eventlog.yaml`

[ https://issues.apache.org/jira/browse/SPARK-53739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-53739: --- Labels: pull-request-available (was: ) > Add `pi-preview-with-eventlog.y

[jira] [Updated] (SPARK-53739) Add `pi-preview-with-eventlog.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-53739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53739: -- Summary: Add `pi-preview-with-eventlog.yaml` example (was: Add `pi-preview-with

[jira] [Updated] (SPARK-53673) Fix a flaky test failure in `SparkSessionE2ESuite - interrupt tag` caused by the usage of `ForkJoinPool`

[ https://issues.apache.org/jira/browse/SPARK-53673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-53673: -- Fix Version/s: 4.0.2 > Fix a flaky test failure in `SparkSessionE2ESuite - interrupt

  1   2   3   4   5   6   7   8   9   10   >