[jira] [Resolved] (SPARK-51187) Implement the graceful deprecation of incorrect config introduced in SPARK-49699

[ https://issues.apache.org/jira/browse/SPARK-51187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51187. --- Fix Version/s: 3.5.5 Resolution: Fixed Issue resolved by pull request 49985 [https://

[jira] [Updated] (SPARK-51273) Spark Connect Call Procedure runs the procedure twice

[ https://issues.apache.org/jira/browse/SPARK-51273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51273: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Spark Connect Call Procedure ru

[jira] [Created] (SPARK-51296) Support collecting corrupt data in singleVariantColumn mode

Chenhao Li created SPARK-51296: -- Summary: Support collecting corrupt data in singleVariantColumn mode Key: SPARK-51296 URL: https://issues.apache.org/jira/browse/SPARK-51296 Project: Spark Issu

[jira] [Updated] (SPARK-51292) Remove unnecessary inheritance from PlanTestBase, ExpressionEvalHelper and PlanTest

[ https://issues.apache.org/jira/browse/SPARK-51292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51292: --- Labels: pull-request-available (was: ) > Remove unnecessary inheritance from PlanTestBase,

[jira] [Updated] (SPARK-51296) Support collecting corrupt data in singleVariantColumn mode

[ https://issues.apache.org/jira/browse/SPARK-51296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51296: --- Labels: pull-request-available (was: ) > Support collecting corrupt data in singleVariantCo

[jira] [Assigned] (SPARK-51156) Provide a basic authentication token when running Spark Connect server locally

[ https://issues.apache.org/jira/browse/SPARK-51156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51156: Assignee: Hyukjin Kwon > Provide a basic authentication token when running Spark Connect

[jira] [Resolved] (SPARK-51156) Provide a basic authentication token when running Spark Connect server locally

[ https://issues.apache.org/jira/browse/SPARK-51156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51156. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50006 [https://gi

[jira] [Created] (SPARK-51293) Cleanup unused private function from test

Yang Jie created SPARK-51293: Summary: Cleanup unused private function from test Key: SPARK-51293 URL: https://issues.apache.org/jira/browse/SPARK-51293 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51293) Cleanup unused private function from test

[ https://issues.apache.org/jira/browse/SPARK-51293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51293: --- Labels: pull-request-available (was: ) > Cleanup unused private function from test > --

[jira] [Updated] (SPARK-51294) Improve the readability by split the variable of jars and configs for SparkConnectServerUtils.

[ https://issues.apache.org/jira/browse/SPARK-51294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-51294: --- Summary: Improve the readability by split the variable of jars and configs for SparkConnectServerUti

[jira] [Updated] (SPARK-51294) Improve the readability by split the variable of jars and configs for SparkConnectServerUtils.

[ https://issues.apache.org/jira/browse/SPARK-51294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51294: --- Labels: pull-request-available (was: ) > Improve the readability by split the variable of j

[jira] [Created] (SPARK-51295) \d failure in CLI client for postgres v15 and above for corelated subquery

Chhavi Bansal created SPARK-51295: - Summary: \d failure in CLI client for postgres v15 and above for corelated subquery Key: SPARK-51295 URL: https://issues.apache.org/jira/browse/SPARK-51295 Project:

[jira] [Comment Edited] (SPARK-48092) Spark images are based of Python 3.8 which is soon EOL

[ https://issues.apache.org/jira/browse/SPARK-48092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929422#comment-17929422 ] Dongjoon Hyun edited comment on SPARK-48092 at 2/23/25 6:15 AM: --

[jira] [Closed] (SPARK-48092) Spark images are based of Python 3.8 which is soon EOL

[ https://issues.apache.org/jira/browse/SPARK-48092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-48092. - > Spark images are based of Python 3.8 which is soon EOL > -

[jira] [Closed] (SPARK-47842) Spark job relying over Hudi are blocked after one or zero commit

[ https://issues.apache.org/jira/browse/SPARK-47842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47842. - > Spark job relying over Hudi are blocked after one or zero commit > ---

[jira] [Resolved] (SPARK-47842) Spark job relying over Hudi are blocked after one or zero commit

[ https://issues.apache.org/jira/browse/SPARK-47842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47842. --- Resolution: Incomplete Since all old Spark versions less than v3.5.0 reached the end of supp

[jira] [Updated] (SPARK-46702) Spark Cluster Crashing

[ https://issues.apache.org/jira/browse/SPARK-46702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46702: -- Priority: Critical (was: Blocker) > Spark Cluster Crashing > -- > >

[jira] [Updated] (SPARK-48423) Unable to write MLPipeline to blob storage using .option attribute

[ https://issues.apache.org/jira/browse/SPARK-48423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48423: -- Priority: Critical (was: Blocker) > Unable to write MLPipeline to blob storage using .option

[jira] [Updated] (SPARK-48652) Casting Issue in Spark SQL: String Column Compared to Integer Value Yields Empty Results

[ https://issues.apache.org/jira/browse/SPARK-48652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48652: -- Priority: Critical (was: Blocker) > Casting Issue in Spark SQL: String Column Compared to Int

[jira] [Resolved] (SPARK-48092) Spark images are based of Python 3.8 which is soon EOL

[ https://issues.apache.org/jira/browse/SPARK-48092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48092. --- Resolution: Not A Problem Please use the latest version, which is Apache Spark 3.5.4 with Py

[jira] [Resolved] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47766. --- Resolution: Invalid This is superseded by SPARK-45393 and SPARK-49550 for Apache Spark 4.0.0

[jira] [Updated] (SPARK-47650) Spark DataFrame processed the same partition twice, which can be reproduced with very simple code.

[ https://issues.apache.org/jira/browse/SPARK-47650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47650: -- Priority: Critical (was: Blocker) > Spark DataFrame processed the same partition twice, which

[jira] [Closed] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47766. - > Extend spark 3.5.1 to support hadoop-client-api 3.4.0, > hadoop-client-runtime-3.4.0 > --

[jira] [Updated] (SPARK-47842) Spark job relying over Hudi are blocked after one or zero commit

[ https://issues.apache.org/jira/browse/SPARK-47842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47842: -- Priority: Major (was: Blocker) > Spark job relying over Hudi are blocked after one or zero co

[jira] [Updated] (SPARK-48899) Fix `ENV` key value format in K8s Dockerfiles

[ https://issues.apache.org/jira/browse/SPARK-48899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48899: -- Fix Version/s: 3.5.5 > Fix `ENV` key value format in K8s Dockerfiles > ---

[jira] [Updated] (SPARK-48899) Fix `ENV` key value format in K8s Dockerfiles

[ https://issues.apache.org/jira/browse/SPARK-48899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48899: -- Affects Version/s: 3.5.4 > Fix `ENV` key value format in K8s Dockerfiles > ---

[jira] [Updated] (SPARK-51173) Add `configName` Scalastyle rule

[ https://issues.apache.org/jira/browse/SPARK-51173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51173: -- Fix Version/s: 3.5.5 > Add `configName` Scalastyle rule > > >