[jira] [Resolved] (SPARK-50155) Move `scala` and `java` files to their default folders

[ https://issues.apache.org/jira/browse/SPARK-50155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50155. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48691 [https://github.com

[jira] [Created] (SPARK-50159) Refine docstrings for aggregation functions - part 1

Ruifeng Zheng created SPARK-50159: - Summary: Refine docstrings for aggregation functions - part 1 Key: SPARK-50159 URL: https://issues.apache.org/jira/browse/SPARK-50159 Project: Spark Issue

[jira] [Resolved] (SPARK-49637) Remove the ANSI config suggestion in INVALID_FRACTION_OF_SECOND

[ https://issues.apache.org/jira/browse/SPARK-49637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49637. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48656 [https://github.com

[jira] [Assigned] (SPARK-49637) Remove the ANSI config suggestion in INVALID_FRACTION_OF_SECOND

[ https://issues.apache.org/jira/browse/SPARK-49637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49637: Assignee: Marko Nikacevic > Remove the ANSI config suggestion in INVALID_FRACTION_OF_SECOND > ---

[jira] [Resolved] (SPARK-50071) Add TryMakeTimestampLTZ and TryMakeTimestampNTZ expression alternatives

[ https://issues.apache.org/jira/browse/SPARK-50071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50071. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48624 [https://github.com

[jira] [Assigned] (SPARK-50069) Integrate _LEGACY_ERROR_TEMP_0028 into UNSUPPORTED_FROM_TO_EXPRESSION

[ https://issues.apache.org/jira/browse/SPARK-50069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50069: Assignee: Haejoon Lee > Integrate _LEGACY_ERROR_TEMP_0028 into UNSUPPORTED_FROM_TO_EXPRESSION > -

[jira] [Resolved] (SPARK-50069) Integrate _LEGACY_ERROR_TEMP_0028 into UNSUPPORTED_FROM_TO_EXPRESSION

[ https://issues.apache.org/jira/browse/SPARK-50069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50069. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48597 [https://github.com

[jira] [Created] (SPARK-50157) Using SQLConf provided by SparkSession first.

Jiaan Geng created SPARK-50157: -- Summary: Using SQLConf provided by SparkSession first. Key: SPARK-50157 URL: https://issues.apache.org/jira/browse/SPARK-50157 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-50159) Refine docstrings for aggregation functions - part 1

[ https://issues.apache.org/jira/browse/SPARK-50159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50159: --- Labels: pull-request-available (was: ) > Refine docstrings for aggregation functions - part

[jira] [Updated] (SPARK-50157) Using SQLConf provided by SparkSession first.

[ https://issues.apache.org/jira/browse/SPARK-50157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50157: --- Labels: pull-request-available (was: ) > Using SQLConf provided by SparkSession first. > --

[jira] [Created] (SPARK-50155) Move Scala and Java files to their default folders

BingKun Pan created SPARK-50155: --- Summary: Move Scala and Java files to their default folders Key: SPARK-50155 URL: https://issues.apache.org/jira/browse/SPARK-50155 Project: Spark Issue Type:

[jira] [Updated] (SPARK-50155) Move Scala and Java files to their default folders

[ https://issues.apache.org/jira/browse/SPARK-50155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50155: --- Labels: pull-request-available (was: ) > Move Scala and Java files to their default folders

[jira] [Created] (SPARK-50160) KafkaWriteTask: support timestamp customisation

Peter Schulz created SPARK-50160: Summary: KafkaWriteTask: support timestamp customisation Key: SPARK-50160 URL: https://issues.apache.org/jira/browse/SPARK-50160 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-49562) AGGREGATE operator

[ https://issues.apache.org/jira/browse/SPARK-49562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49562: --- Assignee: Daniel > AGGREGATE operator > -- > > Key: SPARK-4

[jira] [Resolved] (SPARK-50159) Refine docstrings for aggregation functions - part 1

[ https://issues.apache.org/jira/browse/SPARK-50159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50159. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48694 [https://

[jira] [Updated] (SPARK-50165) Upgrade jackson to 2.18.1

[ https://issues.apache.org/jira/browse/SPARK-50165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50165: --- Labels: pull-request-available (was: ) > Upgrade jackson to 2.18.1 > --

[jira] [Assigned] (SPARK-50117) Should using maven/sbt plugin to generate StateMessage.java

[ https://issues.apache.org/jira/browse/SPARK-50117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-50117: Assignee: Yang Jie > Should using maven/sbt plugin to generate StateMessage.java > --

[jira] [Assigned] (SPARK-50159) Refine docstrings for aggregation functions - part 1

[ https://issues.apache.org/jira/browse/SPARK-50159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50159: - Assignee: Ruifeng Zheng > Refine docstrings for aggregation functions - part 1 > --

[jira] [Created] (SPARK-50165) Upgrade jackson to 2.18.1

BingKun Pan created SPARK-50165: --- Summary: Upgrade jackson to 2.18.1 Key: SPARK-50165 URL: https://issues.apache.org/jira/browse/SPARK-50165 Project: Spark Issue Type: Improvement Com

[jira] [Resolved] (SPARK-46866) Streaming python data source API

[ https://issues.apache.org/jira/browse/SPARK-46866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46866. - Fix Version/s: 4.0.0 Assignee: Chenhao Li Resolution: Fixed > Streaming python d

[jira] [Updated] (SPARK-50163) Fix Streaming RocksDB AcquireLock double release

[ https://issues.apache.org/jira/browse/SPARK-50163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50163: --- Labels: pull-request-available (was: ) > Fix Streaming RocksDB AcquireLock double release >

[jira] [Resolved] (SPARK-49562) AGGREGATE operator

[ https://issues.apache.org/jira/browse/SPARK-49562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49562. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48529 [https://gith

[jira] [Assigned] (SPARK-46866) Streaming python data source API

[ https://issues.apache.org/jira/browse/SPARK-46866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46866: Assignee: Chaoqin Li (was: Chenhao Li) > Streaming python data source API >

[jira] [Created] (SPARK-50163) Fix Streaming RocksDB AcquireLock double release

Livia Zhu created SPARK-50163: - Summary: Fix Streaming RocksDB AcquireLock double release Key: SPARK-50163 URL: https://issues.apache.org/jira/browse/SPARK-50163 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-50164) Spark Kubernetes support requires vulnerable okhttp dependency

Kevin Bowman created SPARK-50164: Summary: Spark Kubernetes support requires vulnerable okhttp dependency Key: SPARK-50164 URL: https://issues.apache.org/jira/browse/SPARK-50164 Project: Spark

[jira] [Assigned] (SPARK-50161) Upgrade Kafka to 3.8.1

[ https://issues.apache.org/jira/browse/SPARK-50161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50161: - Assignee: Dongjoon Hyun > Upgrade Kafka to 3.8.1 > -- > >

[jira] [Created] (SPARK-50162) Add support for start snapshot batch id with tws queries and state data source

Anish Shrigondekar created SPARK-50162: -- Summary: Add support for start snapshot batch id with tws queries and state data source Key: SPARK-50162 URL: https://issues.apache.org/jira/browse/SPARK-50162

[jira] [Assigned] (SPARK-50071) Add TryMakeTimestampLTZ and TryMakeTimestampNTZ expression alternatives

[ https://issues.apache.org/jira/browse/SPARK-50071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50071: Assignee: Marko Nikacevic > Add TryMakeTimestampLTZ and TryMakeTimestampNTZ expression alternativ

[jira] [Resolved] (SPARK-50161) Upgrade Kafka to 3.8.1

[ https://issues.apache.org/jira/browse/SPARK-50161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-50161. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48696 [https://github.com

[jira] [Resolved] (SPARK-49506) Optimize ArrayBinarySearch for foldable array

[ https://issues.apache.org/jira/browse/SPARK-49506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49506. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48225 [https://gith

[jira] [Updated] (SPARK-50160) KafkaWriteTask: support timestamp customisation

[ https://issues.apache.org/jira/browse/SPARK-50160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50160: --- Labels: pull-request-available (was: ) > KafkaWriteTask: support timestamp customisation >

[jira] [Updated] (SPARK-50161) Upgrade Kafka to 3.8.1

[ https://issues.apache.org/jira/browse/SPARK-50161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50161: --- Labels: pull-request-available (was: ) > Upgrade Kafka to 3.8.1 > -- >

[jira] [Updated] (SPARK-50156) Integrate _LEGACY_ERROR_TEMP_2113 into UNRECOGNIZED_STATISTIC

[ https://issues.apache.org/jira/browse/SPARK-50156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50156: --- Labels: pull-request-available (was: ) > Integrate _LEGACY_ERROR_TEMP_2113 into UNRECOGNIZE

[jira] [Updated] (SPARK-50155) Move `scala` and `java` files to their default folders

[ https://issues.apache.org/jira/browse/SPARK-50155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-50155: Summary: Move `scala` and `java` files to their default folders (was: Move Scala and Java files t

[jira] [Assigned] (SPARK-50011) Add a separate docker file for doc build

[ https://issues.apache.org/jira/browse/SPARK-50011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50011: -- Assignee: Apache Spark > Add a separate docker file for doc build > -

[jira] [Assigned] (SPARK-50011) Add a separate docker file for doc build

[ https://issues.apache.org/jira/browse/SPARK-50011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50011: -- Assignee: (was: Apache Spark) > Add a separate docker file for doc build > --

[jira] [Updated] (SPARK-49663) Enable suggestions with trim specifiers

[ https://issues.apache.org/jira/browse/SPARK-49663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49663: --- Labels: pull-request-available (was: ) > Enable suggestions with trim specifiers >

[jira] [Assigned] (SPARK-50011) Add a separate docker file for doc build

[ https://issues.apache.org/jira/browse/SPARK-50011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50011: -- Assignee: (was: Apache Spark) > Add a separate docker file for doc build > --

[jira] [Created] (SPARK-50156) Integrate _LEGACY_ERROR_TEMP_2113 into UNRECOGNIZED_STATISTIC

Haejoon Lee created SPARK-50156: --- Summary: Integrate _LEGACY_ERROR_TEMP_2113 into UNRECOGNIZED_STATISTIC Key: SPARK-50156 URL: https://issues.apache.org/jira/browse/SPARK-50156 Project: Spark

[jira] [Created] (SPARK-50166) Fix shade and relocation rule of `sql/core` module

Yang Jie created SPARK-50166: Summary: Fix shade and relocation rule of `sql/core` module Key: SPARK-50166 URL: https://issues.apache.org/jira/browse/SPARK-50166 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-50167) Improve plotting error messages

Xinrong Meng created SPARK-50167: Summary: Improve plotting error messages Key: SPARK-50167 URL: https://issues.apache.org/jira/browse/SPARK-50167 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50171) Make numpy optional for KDE plot

[ https://issues.apache.org/jira/browse/SPARK-50171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50171: --- Labels: pull-request-available (was: ) > Make numpy optional for KDE plot > ---

[jira] [Created] (SPARK-50168) Connect session is not released if not calling spark.stop() explicitly

Bobby Wang created SPARK-50168: -- Summary: Connect session is not released if not calling spark.stop() explicitly Key: SPARK-50168 URL: https://issues.apache.org/jira/browse/SPARK-50168 Project: Spark

[jira] [Created] (SPARK-50170) Move `_invoke_internal_function_over_columns` to `pyspark.sql.utils`

Ruifeng Zheng created SPARK-50170: - Summary: Move `_invoke_internal_function_over_columns` to `pyspark.sql.utils` Key: SPARK-50170 URL: https://issues.apache.org/jira/browse/SPARK-50170 Project: Spark

[jira] [Updated] (SPARK-50170) Move `_invoke_internal_function_over_columns` to `pyspark.sql.utils`

[ https://issues.apache.org/jira/browse/SPARK-50170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50170: --- Labels: pull-request-available (was: ) > Move `_invoke_internal_function_over_columns` to `

[jira] [Assigned] (SPARK-50011) Add a separate docker file for doc build

[ https://issues.apache.org/jira/browse/SPARK-50011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50011: -- Assignee: Apache Spark > Add a separate docker file for doc build > -

[jira] [Updated] (SPARK-50167) Improve PySpark plotting error messages and imports

[ https://issues.apache.org/jira/browse/SPARK-50167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50167: --- Labels: pull-request-available (was: ) > Improve PySpark plotting error messages and import

[jira] [Updated] (SPARK-50171) Make numpy optional for KDE plot

[ https://issues.apache.org/jira/browse/SPARK-50171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50171: -- Summary: Make numpy optional for KDE plot (was: Remove Numpy dependency from KDE plot) > Mak

[jira] [Updated] (SPARK-50167) Improve PySpark plotting error messages

[ https://issues.apache.org/jira/browse/SPARK-50167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-50167: - Summary: Improve PySpark plotting error messages (was: Improve plotting error messages) > Impr

[jira] [Created] (SPARK-50169) Improve performance of RegExpReplace

BingKun Pan created SPARK-50169: --- Summary: Improve performance of RegExpReplace Key: SPARK-50169 URL: https://issues.apache.org/jira/browse/SPARK-50169 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-50167) Improve PySpark plotting error messages and imports

[ https://issues.apache.org/jira/browse/SPARK-50167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-50167: - Summary: Improve PySpark plotting error messages and imports (was: Improve PySpark plotting err

[jira] [Resolved] (SPARK-50117) Should using maven/sbt plugin to generate StateMessage.java

[ https://issues.apache.org/jira/browse/SPARK-50117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-50117. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48654 [https://github.com

[jira] [Updated] (SPARK-50169) Improve performance of RegExpReplace

[ https://issues.apache.org/jira/browse/SPARK-50169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50169: --- Labels: pull-request-available (was: ) > Improve performance of RegExpReplace > ---

[jira] [Updated] (SPARK-50170) Move `_invoke_internal_function_over_columns` to `pyspark.sql.utils`

[ https://issues.apache.org/jira/browse/SPARK-50170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50170: -- Parent: SPARK-49530 Issue Type: Sub-task (was: Improvement) > Move `_invoke_internal_

[jira] [Created] (SPARK-50171) Remove Numpy dependency from KDE plot

Ruifeng Zheng created SPARK-50171: - Summary: Remove Numpy dependency from KDE plot Key: SPARK-50171 URL: https://issues.apache.org/jira/browse/SPARK-50171 Project: Spark Issue Type: Sub-task