[jira] [Updated] (SPARK-51114) Refactor PullOutNondeterministic rule

[ https://issues.apache.org/jira/browse/SPARK-51114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-51114: Description: I propos PullOutNondeterministic refactoring so it can be reused in the singl

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Description: I used Spark 3.5+iceberg 1.6.1 to run TPCDS test. When doing performance analysis, I found

[jira] [Updated] (SPARK-51146) Publish a new Spark distribution with Spark Connect enabled

[ https://issues.apache.org/jira/browse/SPARK-51146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51146: --- Labels: pull-request-available (was: ) > Publish a new Spark distribution with Spark Connec

[jira] [Created] (SPARK-51146) Publish a new Spark distribution with Spark Connect enabled

Wenchen Fan created SPARK-51146: --- Summary: Publish a new Spark distribution with Spark Connect enabled Key: SPARK-51146 URL: https://issues.apache.org/jira/browse/SPARK-51146 Project: Spark Is

[jira] [Commented] (SPARK-44240) Setting the topKSortFallbackThreshold value may lead to inaccurate results

[ https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17925552#comment-17925552 ] Terry Wang commented on SPARK-44240: We also has encountered same problem :(. To fix

[jira] [Updated] (SPARK-51067) Revert session level collation for DML queries and apply object level collation for DDL queries

[ https://issues.apache.org/jira/browse/SPARK-51067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dejan Krakovic updated SPARK-51067: --- Summary: Revert session level collation for DML queries and apply object level collation for

[jira] [Comment Edited] (SPARK-44240) Setting the topKSortFallbackThreshold value may lead to inaccurate results

[ https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17925552#comment-17925552 ] Terry Wang edited comment on SPARK-44240 at 2/10/25 11:46 AM:

[jira] [Created] (SPARK-51145) Upgrade `mysql-connector-j`, `MySQL` docker image version to 9.2.0 and `MariaDB` docker image version to 11.4.5

Wei Guo created SPARK-51145: --- Summary: Upgrade `mysql-connector-j`, `MySQL` docker image version to 9.2.0 and `MariaDB` docker image version to 11.4.5 Key: SPARK-51145 URL: https://issues.apache.org/jira/browse/SPARK-51

[jira] [Updated] (SPARK-51145) Upgrade `mysql-connector-j`, `MySQL` docker image version to 9.2.0 and `MariaDB` docker image version to 11.4.5

[ https://issues.apache.org/jira/browse/SPARK-51145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51145: --- Labels: pull-request-available (was: ) > Upgrade `mysql-connector-j`, `MySQL` docker image

[jira] [Resolved] (SPARK-50953) Allow variant_get with non-literal paths

[ https://issues.apache.org/jira/browse/SPARK-50953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50953. - Fix Version/s: 4.0.0 Assignee: Harsh Motwani Resolution: Fixed > Allow variant_g

[jira] [Updated] (SPARK-51150) Explicitly pass the session to avoid recreating it

[ https://issues.apache.org/jira/browse/SPARK-51150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51150: --- Labels: pull-request-available (was: ) > Explicitly pass the session to avoid recreating it

[jira] [Updated] (SPARK-51150) Explicitly pass the session in meta algorithm writers

[ https://issues.apache.org/jira/browse/SPARK-51150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-51150: -- Summary: Explicitly pass the session in meta algorithm writers (was: Explicitly pass the sess

[jira] [Created] (SPARK-51151) Fix internal and public API naming for TimeMode.None() for TransformWithState

Jing Zhan created SPARK-51151: - Summary: Fix internal and public API naming for TimeMode.None() for TransformWithState Key: SPARK-51151 URL: https://issues.apache.org/jira/browse/SPARK-51151 Project: Spar

[jira] [Updated] (SPARK-51151) Fix internal and public API naming for TimeMode.None() for TransformWithState

[ https://issues.apache.org/jira/browse/SPARK-51151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51151: --- Labels: pull-request-available (was: ) > Fix internal and public API naming for TimeMode.No

[jira] [Updated] (SPARK-51106) Use try-with-resources to ensure resources are closed after testing.

[ https://issues.apache.org/jira/browse/SPARK-51106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51106: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Use try-with-resources to ensur

[jira] [Assigned] (SPARK-51106) Use try-with-resources to ensure resources are closed after testing.

[ https://issues.apache.org/jira/browse/SPARK-51106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51106: - Assignee: Yang Jie > Use try-with-resources to ensure resources are closed after testin

[jira] [Updated] (SPARK-51106) Use try-with-resources to ensure resources are closed after testing.

[ https://issues.apache.org/jira/browse/SPARK-51106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51106: -- Affects Version/s: 4.0.0 (was: 4.1.0) > Use try-with-resources to e

[jira] [Resolved] (SPARK-51106) Use try-with-resources to ensure resources are closed after testing.

[ https://issues.apache.org/jira/browse/SPARK-51106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51106. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49825 [https://

[jira] [Created] (SPARK-51149) Log class path along with the failed to load class on ClassNotFoundException in SparkSubmit

Vlad Rozov created SPARK-51149: -- Summary: Log class path along with the failed to load class on ClassNotFoundException in SparkSubmit Key: SPARK-51149 URL: https://issues.apache.org/jira/browse/SPARK-51149

[jira] [Updated] (SPARK-51148) Upgrade `zstd-jni` to 1.5.6-10

[ https://issues.apache.org/jira/browse/SPARK-51148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51148: --- Labels: pull-request-available (was: ) > Upgrade `zstd-jni` to 1.5.6-10 > -

[jira] [Resolved] (SPARK-48516) Turn on Arrow optimization for Python UDFs by default

[ https://issues.apache.org/jira/browse/SPARK-48516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48516. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49482 [https://

[jira] [Assigned] (SPARK-48516) Turn on Arrow optimization for Python UDFs by default

[ https://issues.apache.org/jira/browse/SPARK-48516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48516: - Assignee: Xinrong Meng > Turn on Arrow optimization for Python UDFs by default > --

[jira] [Updated] (SPARK-51023) log remote address on RPC exception

[ https://issues.apache.org/jira/browse/SPARK-51023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51023: -- Affects Version/s: 4.1.0 (was: 3.5.4) > log remote address on RPC e

[jira] [Assigned] (SPARK-51023) log remote address on RPC exception

[ https://issues.apache.org/jira/browse/SPARK-51023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51023: - Assignee: Oleksiy Dyagilev > log remote address on RPC exception >

[jira] [Resolved] (SPARK-51023) log remote address on RPC exception

[ https://issues.apache.org/jira/browse/SPARK-51023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51023. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49718 [https://

[jira] [Resolved] (SPARK-51142) ML protobufs clean up

[ https://issues.apache.org/jira/browse/SPARK-51142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51142. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49862 [https://

[jira] [Resolved] (SPARK-51073) Remove `Unstable` from `SparkSessionExtensionsProvider`

[ https://issues.apache.org/jira/browse/SPARK-51073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51073. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49780 [https://

[jira] [Resolved] (SPARK-51132) Upgrade `JPMML` to 1.7.1

[ https://issues.apache.org/jira/browse/SPARK-51132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51132. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49854 [https://github.com

[jira] [Assigned] (SPARK-51073) Remove `Unstable` from `SparkSessionExtensionsProvider`

[ https://issues.apache.org/jira/browse/SPARK-51073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51073: - Assignee: Dongjoon Hyun > Remove `Unstable` from `SparkSessionExtensionsProvider` > ---

[jira] [Resolved] (SPARK-50917) Make SparkPi Scala example spark-connect compatible

[ https://issues.apache.org/jira/browse/SPARK-50917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50917. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49617 [https://

[jira] [Assigned] (SPARK-51119) Readers on executors resolving EXISTS_DEFAULT should not call catalogs

[ https://issues.apache.org/jira/browse/SPARK-51119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51119: - Assignee: Szehon Ho > Readers on executors resolving EXISTS_DEFAULT should not call cat

[jira] [Resolved] (SPARK-51119) Readers on executors resolving EXISTS_DEFAULT should not call catalogs

[ https://issues.apache.org/jira/browse/SPARK-51119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51119. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49840 [https://

[jira] [Updated] (SPARK-51140) Sort the params before saving

[ https://issues.apache.org/jira/browse/SPARK-51140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51140: -- Affects Version/s: 4.1.0 (was: 4.0.0) > Sort the params before savi

[jira] [Updated] (SPARK-51140) Sort the params before saving

[ https://issues.apache.org/jira/browse/SPARK-51140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51140: -- Fix Version/s: 4.1.0 (was: 4.0.0) > Sort the params before saving > ---

[jira] [Updated] (SPARK-51149) Log class path along with the failed to load class on ClassNotFoundException in SparkSubmit

[ https://issues.apache.org/jira/browse/SPARK-51149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51149: --- Labels: pull-request-available (was: ) > Log class path along with the failed to load class

[jira] [Resolved] (SPARK-51148) Upgrade `zstd-jni` to 1.5.6-10

[ https://issues.apache.org/jira/browse/SPARK-51148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51148. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49868 [https://

[jira] [Created] (SPARK-51150) Explicitly pass the session to avoid recreating it

Ruifeng Zheng created SPARK-51150: - Summary: Explicitly pass the session to avoid recreating it Key: SPARK-51150 URL: https://issues.apache.org/jira/browse/SPARK-51150 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-51145) Upgrade `mysql-connector-j`, `MySQL` docker image version to 9.2.0 and `MariaDB` docker image version to 11.4.5

[ https://issues.apache.org/jira/browse/SPARK-51145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51145: - Assignee: Wei Guo > Upgrade `mysql-connector-j`, `MySQL` docker image version to 9.2.0

[jira] [Resolved] (SPARK-51145) Upgrade `mysql-connector-j`, `MySQL` docker image version to 9.2.0 and `MariaDB` docker image version to 11.4.5

[ https://issues.apache.org/jira/browse/SPARK-51145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51145. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49864 [https://

[jira] [Resolved] (SPARK-51140) Sort the params before saving

[ https://issues.apache.org/jira/browse/SPARK-51140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51140. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49861 [https://

[jira] [Resolved] (SPARK-51143) Pin plotly==5.24.1

[ https://issues.apache.org/jira/browse/SPARK-51143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51143. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49863 [https://gi

[jira] [Assigned] (SPARK-51143) Pin plotly==5.24.1

[ https://issues.apache.org/jira/browse/SPARK-51143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51143: Assignee: Ruifeng Zheng > Pin plotly==5.24.1 > -- > > Key

[jira] [Resolved] (SPARK-51112) [Connect] Seg fault when converting empty dataframe with nested array columns to pandas

[ https://issues.apache.org/jira/browse/SPARK-51112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49834 [https://gi

[jira] [Assigned] (SPARK-51112) [Connect] Seg fault when converting empty dataframe with nested array columns to pandas

[ https://issues.apache.org/jira/browse/SPARK-51112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51112: Assignee: Venkata Sai Akhil Gudesa > [Connect] Seg fault when converting empty dataframe

[jira] [Updated] (SPARK-51153) Remove unused `javax.activation:activation` dependence

[ https://issues.apache.org/jira/browse/SPARK-51153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51153: --- Labels: pull-request-available (was: ) > Remove unused `javax.activation:activation` depend

[jira] [Updated] (SPARK-51153) Remove unused `javax.activation:activation` dependence

[ https://issues.apache.org/jira/browse/SPARK-51153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-51153: Summary: Remove unused `javax.activation:activation` dependence (was: Remove `javax.activation:activation

[jira] [Updated] (SPARK-51152) Add an example for get_json_object when the JSON object is of JSON array type

[ https://issues.apache.org/jira/browse/SPARK-51152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51152: --- Labels: pull-request-available (was: ) > Add an example for get_json_object when the JSON o

[jira] [Resolved] (SPARK-51153) Remove unused `javax.activation:activation` dependence

[ https://issues.apache.org/jira/browse/SPARK-51153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51153. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49876 [https://

[jira] [Updated] (SPARK-47858) Refactoring the structure for DataFrame error context

[ https://issues.apache.org/jira/browse/SPARK-47858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-47858: Parent: SPARK-47274 Issue Type: Sub-task (was: Bug) > Refactoring the structure for DataF

[jira] [Updated] (SPARK-48650) Display correct call site from IPython Notebook

[ https://issues.apache.org/jira/browse/SPARK-48650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-48650: Parent: SPARK-47274 Issue Type: Sub-task (was: Bug) > Display correct call site from IPyt

[jira] [Updated] (SPARK-48764) Filtering out IPython frame from user stack

[ https://issues.apache.org/jira/browse/SPARK-48764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-48764: Parent: SPARK-47274 Issue Type: Sub-task (was: Bug) > Filtering out IPython frame from us

[jira] [Created] (SPARK-51152) Add an example for get_json_object when the JSON object is of JSON array type

Fu Sheng created SPARK-51152: Summary: Add an example for get_json_object when the JSON object is of JSON array type Key: SPARK-51152 URL: https://issues.apache.org/jira/browse/SPARK-51152 Project: Spark

[jira] [Updated] (SPARK-51154) Remove unused jopt dependency.

[ https://issues.apache.org/jira/browse/SPARK-51154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51154: --- Labels: pull-request-available (was: ) > Remove unused jopt dependency. > -

[jira] [Updated] (SPARK-51154) Remove unused jopt dependency

[ https://issues.apache.org/jira/browse/SPARK-51154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated SPARK-51154: -- Summary: Remove unused jopt dependency (was: Remove unused jopt dependency.) > Remove unused

[jira] [Created] (SPARK-51154) Remove unused jopt dependency.

Chris Nauroth created SPARK-51154: - Summary: Remove unused jopt dependency. Key: SPARK-51154 URL: https://issues.apache.org/jira/browse/SPARK-51154 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-51147) Refactor some streaming related classes to a dedicated streaming directory

[ https://issues.apache.org/jira/browse/SPARK-51147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51147. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49867 [https://gi

[jira] [Resolved] (SPARK-51150) Explicitly pass the session in meta algorithm writers

[ https://issues.apache.org/jira/browse/SPARK-51150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51150. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49871 [https://

[jira] [Assigned] (SPARK-51150) Explicitly pass the session in meta algorithm writers

[ https://issues.apache.org/jira/browse/SPARK-51150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51150: - Assignee: Ruifeng Zheng > Explicitly pass the session in meta algorithm writers > -

[jira] [Created] (SPARK-51155) Make SparkContext show total runtime after stopping

Dongjoon Hyun created SPARK-51155: - Summary: Make SparkContext show total runtime after stopping Key: SPARK-51155 URL: https://issues.apache.org/jira/browse/SPARK-51155 Project: Spark Issue T

[jira] [Updated] (SPARK-51155) Make SparkContext show total runtime after stopping

[ https://issues.apache.org/jira/browse/SPARK-51155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51155: --- Labels: pull-request-available (was: ) > Make SparkContext show total runtime after stoppin

[jira] [Resolved] (SPARK-51154) Remove unused jopt dependency

[ https://issues.apache.org/jira/browse/SPARK-51154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51154. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49877 [https://

[jira] [Updated] (SPARK-51153) Remove unused `javax.activation:activation` dependence

[ https://issues.apache.org/jira/browse/SPARK-51153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51153: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove unused `javax.ac

[jira] [Assigned] (SPARK-51153) Remove unused `javax.activation:activation` dependence

[ https://issues.apache.org/jira/browse/SPARK-51153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51153: - Assignee: Wei Guo > Remove unused `javax.activation:activation` dependence > --

[jira] [Assigned] (SPARK-51154) Remove unused jopt dependency

[ https://issues.apache.org/jira/browse/SPARK-51154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51154: - Assignee: Chris Nauroth > Remove unused jopt dependency > -

[jira] [Created] (SPARK-51157) Add missing @varargs Scala annotation for scala functon APIs

Kent Yao created SPARK-51157: Summary: Add missing @varargs Scala annotation for scala functon APIs Key: SPARK-51157 URL: https://issues.apache.org/jira/browse/SPARK-51157 Project: Spark Issue T

[jira] [Resolved] (SPARK-51155) Make SparkContext show total runtime after stopping

[ https://issues.apache.org/jira/browse/SPARK-51155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51155. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49878 [https://

[jira] [Commented] (SPARK-51118) Use Arrow python UDF for ml internal code

[ https://issues.apache.org/jira/browse/SPARK-51118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17925872#comment-17925872 ] Ruifeng Zheng commented on SPARK-51118: --- The ml side just uses the public APIs of

[jira] [Updated] (SPARK-51153) Remove unused `javax.activation:activation` dependency

[ https://issues.apache.org/jira/browse/SPARK-51153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51153: -- Summary: Remove unused `javax.activation:activation` dependency (was: Remove unused `javax.ac

[jira] [Assigned] (SPARK-51155) Make SparkContext show total runtime after stopping

[ https://issues.apache.org/jira/browse/SPARK-51155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51155: - Assignee: Dongjoon Hyun > Make SparkContext show total runtime after stopping > ---

[jira] [Updated] (SPARK-51156) Provide a basic authentication token when running Spark Connect server locally

[ https://issues.apache.org/jira/browse/SPARK-51156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51156: --- Labels: pull-request-available (was: ) > Provide a basic authentication token when running

[jira] [Updated] (SPARK-51157) Add missing @varargs Scala annotation for scala functon APIs

[ https://issues.apache.org/jira/browse/SPARK-51157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51157: --- Labels: pull-request-available (was: ) > Add missing @varargs Scala annotation for scala fu

[jira] [Updated] (SPARK-51154) Remove unused jopt dependency

[ https://issues.apache.org/jira/browse/SPARK-51154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51154: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove unused jopt depe

[jira] [Created] (SPARK-51153) Remove `javax.activation:activation` dependence

Wei Guo created SPARK-51153: --- Summary: Remove `javax.activation:activation` dependence Key: SPARK-51153 URL: https://issues.apache.org/jira/browse/SPARK-51153 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-51156) Provide a basic authentication token when running Spark Connect server locally

Hyukjin Kwon created SPARK-51156: Summary: Provide a basic authentication token when running Spark Connect server locally Key: SPARK-51156 URL: https://issues.apache.org/jira/browse/SPARK-51156 Proje

[jira] [Updated] (SPARK-51156) Provide a basic authentication token when running Spark Connect server locally

[ https://issues.apache.org/jira/browse/SPARK-51156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51156: - Component/s: (was: PySpark) > Provide a basic authentication token when running Spark Connec

[jira] [Updated] (SPARK-51093) Fix minor endianness issues in tests

[ https://issues.apache.org/jira/browse/SPARK-51093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51093: -- Fix Version/s: 3.5.5 > Fix minor endianness issues in tests >

[jira] [Commented] (SPARK-51093) Fix minor endianness issues in tests

[ https://issues.apache.org/jira/browse/SPARK-51093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17925704#comment-17925704 ] Dongjoon Hyun commented on SPARK-51093: --- This is backported to branch-3.5 via http

[jira] [Assigned] (SPARK-50753) Add pyspark plotting to API documentation

[ https://issues.apache.org/jira/browse/SPARK-50753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50753: - Assignee: Xinrong Meng > Add pyspark plotting to API documentation > --

[jira] [Resolved] (SPARK-50753) Add pyspark plotting to API documentation

[ https://issues.apache.org/jira/browse/SPARK-50753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50753. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49841 [https://

[jira] [Updated] (SPARK-51147) Refactor some streaming related classes to a dedicated streaming directory

[ https://issues.apache.org/jira/browse/SPARK-51147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51147: --- Labels: pull-request-available (was: ) > Refactor some streaming related classes to a dedic

[jira] [Created] (SPARK-51147) Refactor some streaming related classes to a dedicated streaming directory

Bo Gao created SPARK-51147: -- Summary: Refactor some streaming related classes to a dedicated streaming directory Key: SPARK-51147 URL: https://issues.apache.org/jira/browse/SPARK-51147 Project: Spark

[jira] [Resolved] (SPARK-46457) Refactor Python Test Suites

[ https://issues.apache.org/jira/browse/SPARK-46457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46457. --- Resolution: Fixed > Refactor Python Test Suites > --- > >

[jira] [Assigned] (SPARK-46457) Refactor Python Test Suites

[ https://issues.apache.org/jira/browse/SPARK-46457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46457: - Assignee: Ruifeng Zheng > Refactor Python Test Suites > --- > >