[jira] [Assigned] (SPARK-51369) [M1] Fix cursor variable in FOR statement to work with mixed case names

2025-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51369: --- Assignee: David Milicevic > [M1] Fix cursor variable in FOR statement to work with mixed ca

[jira] [Resolved] (SPARK-51369) [M1] Fix cursor variable in FOR statement to work with mixed case names

2025-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51369. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50132 [https://gith

[jira] [Updated] (SPARK-51363) `Desc As JSON` clustering column names

2025-03-03 Thread Amanda Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu updated SPARK-51363: --- Summary: `Desc As JSON` clustering column names (was: Delegate `Desc As JSON` clustering info to re

[jira] [Created] (SPARK-51371) Change toString to toPrettySQL when building Aliases in ResolveAggregateFunctions

2025-03-03 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-51371: --- Summary: Change toString to toPrettySQL when building Aliases in ResolveAggregateFunctions Key: SPARK-51371 URL: https://issues.apache.org/jira/browse/SPARK-51371

[jira] [Created] (SPARK-51372) Introduce a TableBuilder in DataSourcev2 TableCatalog

2025-03-03 Thread Anoop Johnson (Jira)
Anoop Johnson created SPARK-51372: - Summary: Introduce a TableBuilder in DataSourcev2 TableCatalog Key: SPARK-51372 URL: https://issues.apache.org/jira/browse/SPARK-51372 Project: Spark Issue

[jira] [Resolved] (SPARK-49489) 'TTransportException: MaxMessageSize reached' occurs if get a table with a large number of partitions

2025-03-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-49489. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50022 [https://github.com

[jira] [Updated] (SPARK-51369) [M1] Fix cursor variable in FOR statement to work with mixed case names

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51369: --- Labels: pull-request-available (was: ) > [M1] Fix cursor variable in FOR statement to work

[jira] [Created] (SPARK-51369) [M1] Fix cursor variable in FOR statement to work with mixed case names

2025-03-03 Thread David Milicevic (Jira)
David Milicevic created SPARK-51369: --- Summary: [M1] Fix cursor variable in FOR statement to work with mixed case names Key: SPARK-51369 URL: https://issues.apache.org/jira/browse/SPARK-51369 Project

[jira] [Updated] (SPARK-51353) dyn/closer.lua might not be retried before falling back to archive

2025-03-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-51353: - Fix Version/s: (was: 4.0.0) (was: 3.5.6) > dyn/closer.lua might not be retrie

[jira] (SPARK-51353) dyn/closer.lua might not be retried before falling back to archive

2025-03-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51353 ] Kent Yao deleted comment on SPARK-51353: -- was (Author: yao): Issue resolved by pull request 50114 [https://github.com/apache/spark/pull/50114] > dyn/closer.lua might not be retried before falli

[jira] [Commented] (SPARK-51360) Spark counts the total no of records twice in forEachBatch

2025-03-03 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931970#comment-17931970 ] Ramakrishna commented on SPARK-51360: - This is found in Delta's documentation   [h

[jira] [Commented] (SPARK-51360) Spark counts the total no of records twice in forEachBatch

2025-03-03 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931971#comment-17931971 ] Ramakrishna commented on SPARK-51360: - Closing it since its mentioned in documentati

[jira] [Closed] (SPARK-51360) Spark counts the total no of records twice in forEachBatch

2025-03-03 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna closed SPARK-51360. --- > Spark counts the total no of records twice in forEachBatch > -

[jira] [Resolved] (SPARK-51360) Spark counts the total no of records twice in forEachBatch

2025-03-03 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna resolved SPARK-51360. - Resolution: Workaround > Spark counts the total no of records twice in forEachBatch > --

[jira] [Created] (SPARK-51370) Code clarity improvements for INSERT INTO parsing codes in AstBuilder.scala

2025-03-03 Thread Thang Long Vu (Jira)
Thang Long Vu created SPARK-51370: - Summary: Code clarity improvements for INSERT INTO parsing codes in AstBuilder.scala Key: SPARK-51370 URL: https://issues.apache.org/jira/browse/SPARK-51370 Project

[jira] [Created] (SPARK-51373) Removing extra copy for column family prefix from 'ReplyChangelog'

2025-03-03 Thread Eric Marnadi (Jira)
Eric Marnadi created SPARK-51373: Summary: Removing extra copy for column family prefix from 'ReplyChangelog' Key: SPARK-51373 URL: https://issues.apache.org/jira/browse/SPARK-51373 Project: Spark

[jira] [Resolved] (SPARK-51229) Connect common maven dependency

2025-03-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-51229. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49971 [

[jira] [Assigned] (SPARK-51229) Connect common maven dependency

2025-03-03 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-51229: - Assignee: Vlad Rozov > Connect common maven dependency > --

[jira] [Resolved] (SPARK-51370) Code clarity improvements for INSERT INTO parsing codes in AstBuilder.scala

2025-03-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51370. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50135 [https:

[jira] [Assigned] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2025-03-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47240: -- Assignee: Apache Spark > SPIP: Structured Logging Framework for Apache Spark > --

[jira] [Commented] (SPARK-51365) OOM occurred during macOS daily tests

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932038#comment-17932038 ] Dongjoon Hyun commented on SPARK-51365: --- Thank you for pinging me, [~LuciferYang].

[jira] [Comment Edited] (SPARK-51365) OOM occurred during macOS daily tests

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932038#comment-17932038 ] Dongjoon Hyun edited comment on SPARK-51365 at 3/3/25 6:04 PM: ---

[jira] [Comment Edited] (SPARK-51365) OOM occurred during macOS daily tests

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932038#comment-17932038 ] Dongjoon Hyun edited comment on SPARK-51365 at 3/3/25 6:04 PM: ---

[jira] [Updated] (SPARK-51370) Code clarity improvements for INSERT INTO parsing codes in AstBuilder.scala

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51370: --- Labels: pull-request-available (was: ) > Code clarity improvements for INSERT INTO parsing

[jira] [Comment Edited] (SPARK-51365) OOM occurred during macOS daily tests

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932038#comment-17932038 ] Dongjoon Hyun edited comment on SPARK-51365 at 3/3/25 6:05 PM: ---

[jira] [Assigned] (SPARK-51370) Code clarity improvements for INSERT INTO parsing codes in AstBuilder.scala

2025-03-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-51370: -- Assignee: Thang Long Vu > Code clarity improvements for INSERT INTO parsing codes in

[jira] [Created] (SPARK-51377) invalid PYTHONPATH shell command in PySpark installation docs page

2025-03-03 Thread Scott Van Woudenberg (Jira)
Scott Van Woudenberg created SPARK-51377: Summary: invalid PYTHONPATH shell command in PySpark installation docs page Key: SPARK-51377 URL: https://issues.apache.org/jira/browse/SPARK-51377 Pr

[jira] [Created] (SPARK-51378) JsonProtocol's accumulableExcludeList should also be applied in TaskEndReason and ExecutorMetricsUpdate events

2025-03-03 Thread Josh Rosen (Jira)
Josh Rosen created SPARK-51378: -- Summary: JsonProtocol's accumulableExcludeList should also be applied in TaskEndReason and ExecutorMetricsUpdate events Key: SPARK-51378 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Created] (SPARK-51379) Move final aggregation from driver to executor

2025-03-03 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-51379: - Summary: Move final aggregation from driver to executor Key: SPARK-51379 URL: https://issues.apache.org/jira/browse/SPARK-51379 Project: Spark Issue Type:

[jira] [Updated] (SPARK-51379) Move treeAggregate's final aggregation from driver to executor

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51379: --- Labels: pull-request-available (was: ) > Move treeAggregate's final aggregation from driver

[jira] [Updated] (SPARK-51378) JsonProtocol's accumulableExcludeList should also be applied in TaskEndReason and ExecutorMetricsUpdate events

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51378: --- Labels: pull-request-available (was: ) > JsonProtocol's accumulableExcludeList should also

[jira] [Updated] (SPARK-51379) Move treeAggregate's final aggregation from driver to executor

2025-03-03 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-51379: -- Summary: Move treeAggregate's final aggregation from driver to executor (was: Move final aggr

[jira] [Updated] (SPARK-51375) Suppress `SparkConnectExecutionManager.periodicMaintenance` log messages

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51375: --- Labels: pull-request-available (was: ) > Suppress `SparkConnectExecutionManager.periodicMai

[jira] [Created] (SPARK-51375) Suppress `SparkConnectExecutionManager.periodicMaintenance` log messages

2025-03-03 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51375: - Summary: Suppress `SparkConnectExecutionManager.periodicMaintenance` log messages Key: SPARK-51375 URL: https://issues.apache.org/jira/browse/SPARK-51375 Project: S

[jira] [Updated] (SPARK-51376) TransformWithState should prescribe RocksDB in its error message when HDFS is in use

2025-03-03 Thread Neil Ramaswamy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil Ramaswamy updated SPARK-51376: --- Summary: TransformWithState should prescribe RocksDB in its error message when HDFS is in us

[jira] [Created] (SPARK-51376) TransformWithState should throw a nice error message when HDFS is in use

2025-03-03 Thread Neil Ramaswamy (Jira)
Neil Ramaswamy created SPARK-51376: -- Summary: TransformWithState should throw a nice error message when HDFS is in use Key: SPARK-51376 URL: https://issues.apache.org/jira/browse/SPARK-51376 Project:

[jira] [Commented] (SPARK-51365) OOM occurred during macOS daily tests

2025-03-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932130#comment-17932130 ] Yang Jie commented on SPARK-51365: -- Thank you for your explanation [~dongjoon] , but wh

[jira] [Updated] (SPARK-51371) Change toString to toPrettySQL when building Aliases in ResolveAggregateFunctions

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51371: --- Labels: pull-request-available (was: ) > Change toString to toPrettySQL when building Alias

[jira] [Updated] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-17604: --- Labels: pull-request-available (was: ) > Support purging aged file entry for FileStreamSour

[jira] [Updated] (SPARK-51374) Switch to Using java.util.Map in Logging APIs

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51374: --- Labels: pull-request-available (was: ) > Switch to Using java.util.Map in Logging APIs > --

[jira] [Resolved] (SPARK-51374) Switch to Using java.util.Map in Logging APIs

2025-03-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51374. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50138 [https:

[jira] [Resolved] (SPARK-51355) Add a brief explanation for Spark Connect at PySpark Overview page

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51355. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50117 [https://

[jira] [Assigned] (SPARK-51355) Add a brief explanation for Spark Connect at PySpark Overview page

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51355: - Assignee: Hyukjin Kwon > Add a brief explanation for Spark Connect at PySpark Overview

[jira] [Resolved] (SPARK-51382) Add `submit-spark-connect-server.sh` example

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51382. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-51382) Add `submit-spark-connect-server.sh` example

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51382: - Assignee: Dongjoon Hyun > Add `submit-spark-connect-server.sh` example > --

[jira] [Created] (SPARK-51381) Show `Session ID` in `Spark Connect Session` page

2025-03-03 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51381: - Summary: Show `Session ID` in `Spark Connect Session` page Key: SPARK-51381 URL: https://issues.apache.org/jira/browse/SPARK-51381 Project: Spark Issue Typ

[jira] [Created] (SPARK-51382) Add `Spark Connect Server` example

2025-03-03 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51382: - Summary: Add `Spark Connect Server` example Key: SPARK-51382 URL: https://issues.apache.org/jira/browse/SPARK-51382 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-51362) Change toJSON to use NextIterator API to reduce record-level latency

2025-03-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51362: Assignee: Yuchen Liu > Change toJSON to use NextIterator API to reduce record-level laten

[jira] [Resolved] (SPARK-51381) Show `Session ID` in `Spark Connect Session` page

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51381. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50144 [https://

[jira] [Resolved] (SPARK-50855) Spark Connect Support for TransformWithState In Scala

2025-03-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50855. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49488 [https://gi

[jira] [Assigned] (SPARK-50855) Spark Connect Support for TransformWithState In Scala

2025-03-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-50855: Assignee: Jing Zhan > Spark Connect Support for TransformWithState In Scala > ---

[jira] [Resolved] (SPARK-51378) JsonProtocol's accumulableExcludeList should also be applied in TaskEndReason and ExecutorMetricsUpdate events

2025-03-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51378. -- Fix Version/s: 4.0.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/50

[jira] [Commented] (SPARK-51365) OOM occurred during macOS daily tests

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932141#comment-17932141 ] Dongjoon Hyun commented on SPARK-51365: --- Ack. I agree with you that the situation

[jira] [Updated] (SPARK-51368) Fix flaky schema evolution TransformWithState test in Spark connect

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51368: --- Labels: pull-request-available (was: ) > Fix flaky schema evolution TransformWithState test

[jira] [Updated] (SPARK-51382) Add `submit-spark-connect-server.sh` example

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51382: -- Summary: Add `submit-spark-connect-server.sh` example (was: Add `Spark Connect Server` exampl

[jira] [Updated] (SPARK-51382) Add `submit-spark-connect-server.sh` example

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51382: --- Labels: pull-request-available (was: ) > Add `submit-spark-connect-server.sh` example > ---

[jira] [Resolved] (SPARK-51363) `Desc As JSON` clustering column names

2025-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51363. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50125 [https://gith

[jira] [Assigned] (SPARK-51363) `Desc As JSON` clustering column names

2025-03-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51363: --- Assignee: Amanda Liu > `Desc As JSON` clustering column names > ---

[jira] [Assigned] (SPARK-51375) Suppress `SparkConnectExecutionManager.periodicMaintenance` log messages

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51375: - Assignee: Dongjoon Hyun > Suppress `SparkConnectExecutionManager.periodicMaintenance` l

[jira] [Resolved] (SPARK-51375) Suppress `SparkConnectExecutionManager.periodicMaintenance` log messages

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51375. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50139 [https://

[jira] [Resolved] (SPARK-51362) Change toJSON to use NextIterator API to reduce record-level latency

2025-03-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51362. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50124 [https://gi

[jira] [Updated] (SPARK-51381) Show `Session ID` in `Spark Connect Session` page

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51381: --- Labels: pull-request-available (was: ) > Show `Session ID` in `Spark Connect Session` page

[jira] [Commented] (SPARK-51118) Use Arrow python UDF for ml internal code

2025-03-03 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932163#comment-17932163 ] Ruifeng Zheng commented on SPARK-51118: --- The minimum reproducer is    {code:java}

[jira] [Comment Edited] (SPARK-51118) Use Arrow python UDF for ml internal code

2025-03-03 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932163#comment-17932163 ] Ruifeng Zheng edited comment on SPARK-51118 at 3/4/25 6:16 AM: ---

[jira] [Updated] (SPARK-51375) Suppress `SparkConnectExecutionManager.periodicMaintenance` log messages

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51375: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Suppress `SparkConnectExecutio

[jira] [Assigned] (SPARK-51381) Show `Session ID` in `Spark Connect Session` page

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51381: - Assignee: Dongjoon Hyun > Show `Session ID` in `Spark Connect Session` page > -

[jira] [Updated] (SPARK-51381) Show `Session ID` in `Spark Connect Session` page

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51381: -- Component/s: Web UI > Show `Session ID` in `Spark Connect Session` page >

[jira] [Updated] (SPARK-51381) Show `Session ID` in `Spark Connect Session` page

2025-03-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51381: -- Issue Type: Improvement (was: Task) > Show `Session ID` in `Spark Connect Session` page > ---

[jira] [Updated] (SPARK-51373) Removing extra copy for column family prefix from 'ReplyChangelog'

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51373: --- Labels: pull-request-available (was: ) > Removing extra copy for column family prefix from

[jira] [Updated] (SPARK-51372) Introduce a TableBuilder in DataSourcev2 TableCatalog

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51372: --- Labels: pull-request-available (was: ) > Introduce a TableBuilder in DataSourcev2 TableCata

[jira] [Created] (SPARK-51374) Switch to Using java.util.Map in Logging APIs

2025-03-03 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-51374: -- Summary: Switch to Using java.util.Map in Logging APIs Key: SPARK-51374 URL: https://issues.apache.org/jira/browse/SPARK-51374 Project: Spark Issue Type: