[jira] [Created] (SPARK-51049) Increase S3A Vector IO threshold for range merge

2025-01-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51049: - Summary: Increase S3A Vector IO threshold for range merge Key: SPARK-51049 URL: https://issues.apache.org/jira/browse/SPARK-51049 Project: Spark Issue Type

[jira] [Updated] (SPARK-51049) Increase S3A Vector IO threshold for range merge

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51049: --- Labels: pull-request-available (was: ) > Increase S3A Vector IO threshold for range merge >

[jira] [Updated] (SPARK-51042) Read and write CalendarIntervals using one call to get/putLong consistently

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51042: --- Labels: big-endian pull-request-available (was: big-endian) > Read and write CalendarInterv

[jira] [Updated] (SPARK-50967) Add option to skip emitting initial state keys within the FMGWS operator

2025-01-30 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-50967: --- Description: Add option to skip emitting initial state keys within the FMGWS operato

[jira] [Updated] (SPARK-50967) Add option to skip emitting initial state keys within the FMGWS operator

2025-01-30 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-50967: --- Summary: Add option to skip emitting initial state keys within the FMGWS operator (

[jira] [Updated] (SPARK-50954) Support client side model path overwrite for CV/PL/TVS

2025-01-30 Thread Bobby Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated SPARK-50954: --- Summary: Support client side model path overwrite for CV/PL/TVS (was: Support client side model pat

[jira] [Resolved] (SPARK-49428) Rename/Reorg Connect Client Packages

2025-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-49428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49428. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49695 [

[jira] [Assigned] (SPARK-49428) Rename/Reorg Connect Client Packages

2025-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-49428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-49428: - Assignee: Herman van Hövell > Rename/Reorg Connect Client Packages > --

[jira] [Created] (SPARK-51046) `SubExprEliminationBenchmark` fails at `CodeGenerator`

2025-01-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51046: - Summary: `SubExprEliminationBenchmark` fails at `CodeGenerator` Key: SPARK-51046 URL: https://issues.apache.org/jira/browse/SPARK-51046 Project: Spark Issu

[jira] [Updated] (SPARK-50974) CrossValidator: support foldCol

2025-01-30 Thread Bobby Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated SPARK-50974: --- Summary: CrossValidator: support foldCol (was: CrossValidator: foldCol is not supported) > CrossVa

[jira] [Updated] (SPARK-50974) CrossValidator: support foldCol

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50974: --- Labels: pull-request-available (was: ) > CrossValidator: support foldCol >

[jira] [Created] (SPARK-51043) Spark Connect Streaming ForeachBatch log improvement

2025-01-30 Thread Wei Liu (Jira)
Wei Liu created SPARK-51043: --- Summary: Spark Connect Streaming ForeachBatch log improvement Key: SPARK-51043 URL: https://issues.apache.org/jira/browse/SPARK-51043 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-51015) Fix RFormulaModel.toString

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51015: --- Labels: pull-request-available (was: ) > Fix RFormulaModel.toString > -

[jira] [Updated] (SPARK-51048) Support stop java spark context with exit code

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51048: --- Labels: pull-request-available (was: ) > Support stop java spark context with exit code >

[jira] [Created] (SPARK-51048) Support stop java spark context with exit code

2025-01-30 Thread Prathit Malik (Jira)
Prathit Malik created SPARK-51048: - Summary: Support stop java spark context with exit code Key: SPARK-51048 URL: https://issues.apache.org/jira/browse/SPARK-51048 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44111) Prepare Apache Spark 4.0.0

2025-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44111: -- Labels: (was: pull-request-available) > Prepare Apache Spark 4.0.0 > ---

[jira] [Created] (SPARK-51045) Regenerate benchmark results after upgrading to Scala 2.13.16

2025-01-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51045: - Summary: Regenerate benchmark results after upgrading to Scala 2.13.16 Key: SPARK-51045 URL: https://issues.apache.org/jira/browse/SPARK-51045 Project: Spark

[jira] [Updated] (SPARK-51045) Regenerate benchmark results after upgrading to Scala 2.13.16

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51045: --- Labels: pull-request-available (was: ) > Regenerate benchmark results after upgrading to Sc

[jira] [Updated] (SPARK-51030) Add a check before Utils.deleteRecursively(tempDir) to ensure tempDir won't be cleaned up by the ShutdownHook in afterEach of LocalRootDirsTest

2025-01-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51030: - Issue Type: Bug (was: Improvement) > Add a check before Utils.deleteRecursively(tempDir) to ensure temp

[jira] [Assigned] (SPARK-51030) Add a check before Utils.deleteRecursively(tempDir) to ensure tempDir won't be cleaned up by the ShutdownHook in afterEach of LocalRootDirsTest

2025-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51030: - Assignee: Yang Jie > Add a check before Utils.deleteRecursively(tempDir) to ensure temp

[jira] [Updated] (SPARK-51030) Add a check before Utils.deleteRecursively(tempDir) to ensure tempDir won't be cleaned up by the ShutdownHook in afterEach of LocalRootDirsTest

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51030: --- Labels: pull-request-available (was: ) > Add a check before Utils.deleteRecursively(tempDir

[jira] [Resolved] (SPARK-51030) Add a check before Utils.deleteRecursively(tempDir) to ensure tempDir won't be cleaned up by the ShutdownHook in afterEach of LocalRootDirsTest

2025-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51030. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49723 [https://

[jira] [Created] (SPARK-51041) Add `hive-llap-client` and `hive-llap-common` as test dependency of `hive-thriftserver`

2025-01-30 Thread Yang Jie (Jira)
Yang Jie created SPARK-51041: Summary: Add `hive-llap-client` and `hive-llap-common` as test dependency of `hive-thriftserver` Key: SPARK-51041 URL: https://issues.apache.org/jira/browse/SPARK-51041 Proje

[jira] [Created] (SPARK-51040) Enforce determinism when assigning implicit aliases to collation types

2025-01-30 Thread Mihailo Timotic (Jira)
Mihailo Timotic created SPARK-51040: --- Summary: Enforce determinism when assigning implicit aliases to collation types Key: SPARK-51040 URL: https://issues.apache.org/jira/browse/SPARK-51040 Project:

[jira] [Updated] (SPARK-51041) Add `hive-llap-client` and `hive-llap-common` as test dependency of `hive-thriftserver`

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51041: --- Labels: pull-request-available (was: ) > Add `hive-llap-client` and `hive-llap-common` as t

[jira] [Updated] (SPARK-51021) Log throttling infra to avoid log flooding

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51021: --- Labels: pull-request-available (was: ) > Log throttling infra to avoid log flooding > -

[jira] [Assigned] (SPARK-51041) Add `hive-llap-client` and `hive-llap-common` as test dependency of `hive-thriftserver`

2025-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51041: - Assignee: Yang Jie > Add `hive-llap-client` and `hive-llap-common` as test dependency o

[jira] [Assigned] (SPARK-51021) Log throttling infra to avoid log flooding

2025-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-51021: - Assignee: Zhipeng Mao > Log throttling infra to avoid log flooding > --

[jira] [Resolved] (SPARK-51021) Log throttling infra to avoid log flooding

2025-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-51021. --- Fix Version/s: 4.0.0 Resolution: Fixed > Log throttling infra to avoid log fl

[jira] [Resolved] (SPARK-51041) Add `hive-llap-client` and `hive-llap-common` as test dependency of `hive-thriftserver`

2025-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51041. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49736 [https://

[jira] [Updated] (SPARK-50903) Plan cache may contain yet-to-be analyzed plans

2025-01-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50903: --- Labels: pull-request-available (was: ) > Plan cache may contain yet-to-be analyzed plans >

[jira] [Created] (SPARK-51042) Read and write CalendarIntervals using one call to get/putLong consistently

2025-01-30 Thread Jonathan Albrecht (Jira)
Jonathan Albrecht created SPARK-51042: - Summary: Read and write CalendarIntervals using one call to get/putLong consistently Key: SPARK-51042 URL: https://issues.apache.org/jira/browse/SPARK-51042