[jira] [Updated] (SPARK-51162) SPIP: Add the TIME data type

[ https://issues.apache.org/jira/browse/SPARK-51162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51162: - Description: *Q1. What are you trying to do? Articulate your objectives using absolutely no jargon.* A

[jira] [Updated] (SPARK-51179) Refactor SupportsOrderingWithinGroup so that centralized check

[ https://issues.apache.org/jira/browse/SPARK-51179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-51179: --- Summary: Refactor SupportsOrderingWithinGroup so that centralized check (was: Refactor SupportsOrde

[jira] [Updated] (SPARK-51179) Refactor SupportsOrderingWithinGroup so that centralized check

[ https://issues.apache.org/jira/browse/SPARK-51179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-51179: --- Description: Currently, the check in analysis for ListAgg scattered in multiple locations. We should

[jira] [Updated] (SPARK-51179) Refactor SupportsOrderingWithinGroup so that centralized check

[ https://issues.apache.org/jira/browse/SPARK-51179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-51179: --- Description: Currently, the check in analysis for ListAgg scattered in multiple locations. We should

[jira] [Created] (SPARK-51179) Refactor SupportsOrderingWithinGroup so that advances the check

Jiaan Geng created SPARK-51179: -- Summary: Refactor SupportsOrderingWithinGroup so that advances the check Key: SPARK-51179 URL: https://issues.apache.org/jira/browse/SPARK-51179 Project: Spark

[jira] [Updated] (SPARK-51179) Refactor SupportsOrderingWithinGroup so that centralized check

[ https://issues.apache.org/jira/browse/SPARK-51179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51179: --- Labels: pull-request-available (was: ) > Refactor SupportsOrderingWithinGroup so that centr

[jira] [Updated] (SPARK-51180) Upgrade `Arrow` to 19.0.0

[ https://issues.apache.org/jira/browse/SPARK-51180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51180: --- Labels: pull-request-available (was: ) > Upgrade `Arrow` to 19.0.0 > --

[jira] [Resolved] (SPARK-51160) Refactor literal function resolution

[ https://issues.apache.org/jira/browse/SPARK-51160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51160. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49887 [https://gith

[jira] [Assigned] (SPARK-51160) Refactor literal function resolution

[ https://issues.apache.org/jira/browse/SPARK-51160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51160: --- Assignee: Mihailo Timotic > Refactor literal function resolution >

[jira] [Created] (SPARK-51180) Upgrade `Arrow` to 19.0.0

Aimilios Tsouvelekakis created SPARK-51180: -- Summary: Upgrade `Arrow` to 19.0.0 Key: SPARK-51180 URL: https://issues.apache.org/jira/browse/SPARK-51180 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-50812) Support pyspark.ml on Connect

[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50812: -- Affects Version/s: (was: 4.1.0) > Support pyspark.ml on Connect >

[jira] [Assigned] (SPARK-51163) Exclude duplicated jars from connect-repl

[ https://issues.apache.org/jira/browse/SPARK-51163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51163: - Assignee: Cheng Pan > Exclude duplicated jars from connect-repl > -

[jira] [Resolved] (SPARK-51163) Exclude duplicated jars from connect-repl

[ https://issues.apache.org/jira/browse/SPARK-51163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51163. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49892 [https://

[jira] [Updated] (SPARK-51157) Add missing @varargs Scala annotation for scala functon APIs

[ https://issues.apache.org/jira/browse/SPARK-51157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51157: -- Fix Version/s: 3.5.5 > Add missing @varargs Scala annotation for scala functon APIs >

[jira] [Created] (SPARK-51181) Enforce determinism when pulling out non deterministic expressions from logical plan

Mihailo Aleksic created SPARK-51181: --- Summary: Enforce determinism when pulling out non deterministic expressions from logical plan Key: SPARK-51181 URL: https://issues.apache.org/jira/browse/SPARK-51181

[jira] [Updated] (SPARK-51163) Exclude duplicated jars from connect-repl

[ https://issues.apache.org/jira/browse/SPARK-51163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51163: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Exclude duplicated jars

[jira] [Resolved] (SPARK-51008) Implement Result Stage for AQE

[ https://issues.apache.org/jira/browse/SPARK-51008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51008. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49715 [https://gith

[jira] [Assigned] (SPARK-51008) Implement Result Stage for AQE

[ https://issues.apache.org/jira/browse/SPARK-51008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51008: --- Assignee: Ziqi Liu > Implement Result Stage for AQE > -- > >

[jira] [Updated] (SPARK-51113) Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE

[ https://issues.apache.org/jira/browse/SPARK-51113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51113: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Correctness issue with UNION/EX

[jira] [Updated] (SPARK-50889) Fix Flaky Test: `SparkSessionE2ESuite.interrupt operation` (Hang)

[ https://issues.apache.org/jira/browse/SPARK-50889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50889: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Fix Flaky Test: `SparkSessionE2ESuite.interrup

[jira] [Updated] (SPARK-48139) Re-enable `SparkSessionE2ESuite.interrupt tag`

[ https://issues.apache.org/jira/browse/SPARK-48139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48139: -- Priority: Critical (was: Blocker) > Re-enable `SparkSessionE2ESuite.interrupt tag` >

[jira] [Updated] (SPARK-48139) Re-enable `SparkSessionE2ESuite.interrupt tag`

[ https://issues.apache.org/jira/browse/SPARK-48139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48139: -- Target Version/s: (was: 4.0.0) > Re-enable `SparkSessionE2ESuite.interrupt tag` > --

[jira] [Commented] (SPARK-50205) Re-enable `SparkSessionJobTaggingAndCancellationSuite.Cancellation APIs in SparkSession are isolated`

[ https://issues.apache.org/jira/browse/SPARK-50205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926431#comment-17926431 ] Dongjoon Hyun commented on SPARK-50205: --- I moved this to 4.1.0. > Re-enable `Spar

[jira] [Updated] (SPARK-48139) Re-enable `SparkSessionE2ESuite.interrupt tag`

[ https://issues.apache.org/jira/browse/SPARK-48139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48139: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Re-enable `SparkSessionE2ESuite.interrupt tag`

[jira] [Updated] (SPARK-50771) Fix a flaky test: BlockInfoManagerSuite.SPARK-38675 - concurrent unlock and releaseAllLocksForTask calls should not fail

[ https://issues.apache.org/jira/browse/SPARK-50771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50771: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Fix a flaky test: BlockInfoManagerSuite.SPARK-

[jira] [Updated] (SPARK-50205) Re-enable `SparkSessionJobTaggingAndCancellationSuite.Cancellation APIs in SparkSession are isolated`

[ https://issues.apache.org/jira/browse/SPARK-50205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50205: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Re-enable `SparkSessionJobTaggingAndCancellati

[jira] [Updated] (SPARK-51019) Fix Flaky Test: `SPARK-47148: AQE should avoid to submit shuffle job on cancellation`

[ https://issues.apache.org/jira/browse/SPARK-51019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51019: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Fix Flaky Test: `SPARK-47148: AQE should avoid

[jira] [Updated] (SPARK-51113) Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE

[ https://issues.apache.org/jira/browse/SPARK-51113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51113: -- Priority: Blocker (was: Critical) > Correctness issue with UNION/EXCEPT/INTERSECT inside a vi

[jira] [Updated] (SPARK-51113) Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE

[ https://issues.apache.org/jira/browse/SPARK-51113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51113: -- Target Version/s: 4.0.0 > Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECU

[jira] [Updated] (SPARK-51046) `SubExprEliminationBenchmark` fails at `CodeGenerator`

[ https://issues.apache.org/jira/browse/SPARK-51046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51046: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > `SubExprEliminationBenchmark` fails at `CodeGe

[jira] [Updated] (SPARK-50205) Re-enable `SparkSessionJobTaggingAndCancellationSuite.Cancellation APIs in SparkSession are isolated`

[ https://issues.apache.org/jira/browse/SPARK-50205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50205: -- Target Version/s: (was: 4.0.0) > Re-enable `SparkSessionJobTaggingAndCancellationSuite.Cance

[jira] [Updated] (SPARK-49586) Add addArtifact API to PySpark

[ https://issues.apache.org/jira/browse/SPARK-49586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49586: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Add addArtifact API to PySpark > -

[jira] [Updated] (SPARK-50888) Fix Flaky Test: `SparkConnectServiceSuite.SPARK-44776: LocalTableScanExe`

[ https://issues.apache.org/jira/browse/SPARK-50888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50888: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Fix Flaky Test: `SparkConnectServiceSuite.SPAR

[jira] [Updated] (SPARK-50748) Fix a flaky test: `SparkSessionE2ESuite.interrupt all - background queries, foreground interrupt`

[ https://issues.apache.org/jira/browse/SPARK-50748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50748: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Fix a flaky test: `SparkSessionE2ESuite.interr

[jira] [Updated] (SPARK-51180) Upgrade `Arrow` to 19.0.0

[ https://issues.apache.org/jira/browse/SPARK-51180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aimilios Tsouvelekakis updated SPARK-51180: --- Affects Version/s: 4.1.0 (was: 4.0.0) > Upgrade `

[jira] [Assigned] (SPARK-51113) Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE

[ https://issues.apache.org/jira/browse/SPARK-51113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51113: --- Assignee: Vladimir Golubev > Correctness issue with UNION/EXCEPT/INTERSECT inside a view or

[jira] [Resolved] (SPARK-51113) Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE

[ https://issues.apache.org/jira/browse/SPARK-51113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51113. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49835 [https://gith

[jira] [Created] (SPARK-51187) Implement the graceful deprecation of incorrect config introduced in SPARK-49699

Jungtaek Lim created SPARK-51187: Summary: Implement the graceful deprecation of incorrect config introduced in SPARK-49699 Key: SPARK-51187 URL: https://issues.apache.org/jira/browse/SPARK-51187 Proj

[jira] [Created] (SPARK-51191) Validate default values handling in DELETE, UPDATE, MERGE

Anton Okolnychyi created SPARK-51191: Summary: Validate default values handling in DELETE, UPDATE, MERGE Key: SPARK-51191 URL: https://issues.apache.org/jira/browse/SPARK-51191 Project: Spark

[jira] [Created] (SPARK-51190) Fix TreeEnsembleModel.treeWeights

Ruifeng Zheng created SPARK-51190: - Summary: Fix TreeEnsembleModel.treeWeights Key: SPARK-51190 URL: https://issues.apache.org/jira/browse/SPARK-51190 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-51190) Fix TreeEnsembleModel.treeWeights

[ https://issues.apache.org/jira/browse/SPARK-51190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51190: - Assignee: Ruifeng Zheng > Fix TreeEnsembleModel.treeWeights > -

[jira] [Commented] (SPARK-50812) Support pyspark.ml on Connect

[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926653#comment-17926653 ] Dongjoon Hyun commented on SPARK-50812: --- I added the label, `releasenotes`, not to

[jira] [Updated] (SPARK-50812) Support pyspark.ml on Connect

[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50812: -- Labels: releasenotes (was: pull-request-available) > Support pyspark.ml on Connect >

[jira] [Updated] (SPARK-51176) Meet consistency for unexpected errors PySpark Connect <> Classic

[ https://issues.apache.org/jira/browse/SPARK-51176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51176: --- Labels: pull-request-available (was: ) > Meet consistency for unexpected errors PySpark Con

[jira] [Created] (SPARK-51197) unit test clean up

Ruifeng Zheng created SPARK-51197: - Summary: unit test clean up Key: SPARK-51197 URL: https://issues.apache.org/jira/browse/SPARK-51197 Project: Spark Issue Type: Sub-task Component

[jira] [Resolved] (SPARK-51197) unit test clean up

[ https://issues.apache.org/jira/browse/SPARK-51197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51197. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49927 [https://

[jira] [Assigned] (SPARK-51197) unit test clean up

[ https://issues.apache.org/jira/browse/SPARK-51197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51197: - Assignee: Ruifeng Zheng > unit test clean up > -- > > K

[jira] [Commented] (SPARK-51182) DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified

[ https://issues.apache.org/jira/browse/SPARK-51182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926679#comment-17926679 ] Vlad Rozov commented on SPARK-51182: This issue is a follow up on [https://github.co

[jira] [Updated] (SPARK-51189) Promote JobFailed to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-51189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51189: --- Labels: pull-request-available (was: ) > Promote JobFailed to DeveloperApi > --

[jira] [Resolved] (SPARK-51059) Document how ALLOWED_ATTRIBUTES works

[ https://issues.apache.org/jira/browse/SPARK-51059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51059. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49918 [https://

[jira] [Resolved] (SPARK-50812) Support pyspark.ml on Connect

[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50812. --- Resolution: Resolved > Support pyspark.ml on Connect > - > >

[jira] [Assigned] (SPARK-51189) Promote JobFailed to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-51189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51189: - Assignee: Cheng Pan > Promote JobFailed to DeveloperApi > -

[jira] [Resolved] (SPARK-51189) Promote JobFailed to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-51189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51189. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49920 [https://

[jira] [Resolved] (SPARK-51193) Upgrade Netty to 4.1.118.Final and netty-tcnative to 2.0.70.Final

[ https://issues.apache.org/jira/browse/SPARK-51193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51193. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49923 [https://

[jira] [Updated] (SPARK-51197) unit test clean up

[ https://issues.apache.org/jira/browse/SPARK-51197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51197: --- Labels: pull-request-available (was: ) > unit test clean up > -- > >

[jira] [Commented] (SPARK-51182) DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified

[ https://issues.apache.org/jira/browse/SPARK-51182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926681#comment-17926681 ] Wei Guo commented on SPARK-51182: - Okay, just follow up and I will close my PR [~vrozov]

[jira] [Updated] (SPARK-51198) Revise `defaultMinPartitions` function description

[ https://issues.apache.org/jira/browse/SPARK-51198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51198: --- Labels: pull-request-available (was: ) > Revise `defaultMinPartitions` function description

[jira] [Created] (SPARK-51198) Revise `defaultMinPartitions` function description

Dongjoon Hyun created SPARK-51198: - Summary: Revise `defaultMinPartitions` function description Key: SPARK-51198 URL: https://issues.apache.org/jira/browse/SPARK-51198 Project: Spark Issue Ty

[jira] [Created] (SPARK-51199) Valid CSV records considered malformed

Andreas Franz created SPARK-51199: - Summary: Valid CSV records considered malformed Key: SPARK-51199 URL: https://issues.apache.org/jira/browse/SPARK-51199 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-51188) Upgrade Arrow to 18.2.0

[ https://issues.apache.org/jira/browse/SPARK-51188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51188: --- Labels: pull-request-available (was: ) > Upgrade Arrow to 18.2.0 > ---

[jira] [Created] (SPARK-51188) Upgrade Arrow to 18.2.0

Yang Jie created SPARK-51188: Summary: Upgrade Arrow to 18.2.0 Key: SPARK-51188 URL: https://issues.apache.org/jira/browse/SPARK-51188 Project: Spark Issue Type: Improvement Components:

[jira] [Updated] (SPARK-51059) Document how ALLOWED_ATTRIBUTES works

[ https://issues.apache.org/jira/browse/SPARK-51059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51059: --- Labels: pull-request-available (was: ) > Document how ALLOWED_ATTRIBUTES works > --

[jira] [Created] (SPARK-51189) Promote JobFailed to DeveloperApi

Cheng Pan created SPARK-51189: - Summary: Promote JobFailed to DeveloperApi Key: SPARK-51189 URL: https://issues.apache.org/jira/browse/SPARK-51189 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51189) Promote JobFailed to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-51189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51189: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Promote JobFailed to De

[jira] [Resolved] (SPARK-51195) Upgrade `kubernetes-client` to 7.1.0

[ https://issues.apache.org/jira/browse/SPARK-51195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51195. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49925 [https://

[jira] [Created] (SPARK-51201) Make Partitioning Hints support byte and short values

Kent Yao created SPARK-51201: Summary: Make Partitioning Hints support byte and short values Key: SPARK-51201 URL: https://issues.apache.org/jira/browse/SPARK-51201 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-51133) Upgrade `commons-pool2` to 2.12.1

[ https://issues.apache.org/jira/browse/SPARK-51133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51133: -- Summary: Upgrade `commons-pool2` to 2.12.1 (was: Upgrade Apache `commons-pool2` to 2.12.1) >

[jira] [Resolved] (SPARK-51194) Upgrade `scalafmt` to 3.8.6

[ https://issues.apache.org/jira/browse/SPARK-51194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51194. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49924 [https://

[jira] [Assigned] (SPARK-51200) Add SparkR deprecation info to `README.md` and `make-distribution.sh` help

[ https://issues.apache.org/jira/browse/SPARK-51200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51200: - Assignee: Dongjoon Hyun > Add SparkR deprecation info to `README.md` and `make-distribu

[jira] [Created] (SPARK-51193) Upgrade Netty to 4.1.118.Final

Dongjoon Hyun created SPARK-51193: - Summary: Upgrade Netty to 4.1.118.Final Key: SPARK-51193 URL: https://issues.apache.org/jira/browse/SPARK-51193 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51193) Upgrade Netty to 4.1.118.Final

[ https://issues.apache.org/jira/browse/SPARK-51193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51193: --- Labels: pull-request-available (was: ) > Upgrade Netty to 4.1.118.Final > -

[jira] [Updated] (SPARK-51193) Upgrade Netty to 4.1.118.Final and netty-tcnative to 2.0.70.Final

[ https://issues.apache.org/jira/browse/SPARK-51193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51193: -- Summary: Upgrade Netty to 4.1.118.Final and netty-tcnative to 2.0.70.Final (was: Upgrade Nett

[jira] [Created] (SPARK-51192) Expose a ResponseObserver-free version of `process` in SparkConnectPlanner

Venkata Sai Akhil Gudesa created SPARK-51192: Summary: Expose a ResponseObserver-free version of `process` in SparkConnectPlanner Key: SPARK-51192 URL: https://issues.apache.org/jira/browse/SPARK-51192

[jira] [Resolved] (SPARK-51190) Fix TreeEnsembleModel.treeWeights

[ https://issues.apache.org/jira/browse/SPARK-51190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51190. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49919 [https://

[jira] [Updated] (SPARK-51192) Expose a ResponseObserver-free version of `process` in SparkConnectPlanner

[ https://issues.apache.org/jira/browse/SPARK-51192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51192: --- Labels: pull-request-available (was: ) > Expose a ResponseObserver-free version of `process

[jira] [Updated] (SPARK-51182) DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified

[ https://issues.apache.org/jira/browse/SPARK-51182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51182: --- Labels: pull-request-available (was: ) > DataFrameWriter should throw dataPathNotSpecifiedE

[jira] [Commented] (SPARK-51182) DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified

[ https://issues.apache.org/jira/browse/SPARK-51182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926655#comment-17926655 ] Wei Guo commented on SPARK-51182: - I made a PR for this. > DataFrameWriter should throw

[jira] [Assigned] (SPARK-51059) Document how ALLOWED_ATTRIBUTES works

[ https://issues.apache.org/jira/browse/SPARK-51059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51059: - Assignee: Ruifeng Zheng > Document how ALLOWED_ATTRIBUTES works > -

[jira] [Assigned] (SPARK-51198) Revise `defaultMinPartitions` function description

[ https://issues.apache.org/jira/browse/SPARK-51198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51198: - Assignee: Dongjoon Hyun > Revise `defaultMinPartitions` function description >

[jira] [Updated] (SPARK-51200) Add SparkR deprecation info to `README.md` and `make-distribution.sh` help

[ https://issues.apache.org/jira/browse/SPARK-51200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51200: --- Labels: pull-request-available (was: ) > Add SparkR deprecation info to `README.md` and `ma

[jira] [Created] (SPARK-51200) Add SparkR deprecation info to `README.md` and `make-distribution.sh` help

Dongjoon Hyun created SPARK-51200: - Summary: Add SparkR deprecation info to `README.md` and `make-distribution.sh` help Key: SPARK-51200 URL: https://issues.apache.org/jira/browse/SPARK-51200 Project:

[jira] [Updated] (SPARK-51190) Fix TreeEnsembleModel.treeWeights

[ https://issues.apache.org/jira/browse/SPARK-51190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51190: --- Labels: pull-request-available (was: ) > Fix TreeEnsembleModel.treeWeights > --

[jira] [Resolved] (SPARK-51188) Upgrade Arrow to 18.2.0

[ https://issues.apache.org/jira/browse/SPARK-51188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51188. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49904 [https://

[jira] [Assigned] (SPARK-51188) Upgrade Arrow to 18.2.0

[ https://issues.apache.org/jira/browse/SPARK-51188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51188: - Assignee: Yang Jie > Upgrade Arrow to 18.2.0 > --- > >

[jira] [Updated] (SPARK-51188) Upgrade Arrow to 18.2.0

[ https://issues.apache.org/jira/browse/SPARK-51188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51188: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Upgrade Arrow to 18.2.0

[jira] [Commented] (SPARK-50812) Support pyspark.ml on Connect

[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926662#comment-17926662 ] Ruifeng Zheng commented on SPARK-50812: --- Thank you [~dongjoon] ! > Support pyspar

[jira] [Updated] (SPARK-51195) Upgrade `kubernetes-client` to 7.1.0

[ https://issues.apache.org/jira/browse/SPARK-51195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51195: --- Labels: pull-request-available (was: ) > Upgrade `kubernetes-client` to 7.1.0 > ---

[jira] [Created] (SPARK-51195) Upgrade `kubernetes-client` to 7.1.0

Wei Guo created SPARK-51195: --- Summary: Upgrade `kubernetes-client` to 7.1.0 Key: SPARK-51195 URL: https://issues.apache.org/jira/browse/SPARK-51195 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51195) Upgrade `kubernetes-client` to 7.1.0

[ https://issues.apache.org/jira/browse/SPARK-51195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51195: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Upgrade `kubernetes-cli

[jira] [Created] (SPARK-51196) Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2047` and `_LEGACY_ERROR_TEMP_2050`

Wei Guo created SPARK-51196: --- Summary: Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2047` and `_LEGACY_ERROR_TEMP_2050` Key: SPARK-51196 URL: https://issues.apache.org/jira/browse/SPARK-51196

[jira] [Updated] (SPARK-48163) Fix Flaky Test: `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48163: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Fix Flaky Test: `SparkConnectServiceSuite.SPAR

[jira] [Created] (SPARK-51183) Update spec to point to Parquet

David Cashman created SPARK-51183: - Summary: Update spec to point to Parquet Key: SPARK-51183 URL: https://issues.apache.org/jira/browse/SPARK-51183 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-51184) Remove `TaskState.LOST` logic from `TaskSchedulerImpl`

Dongjoon Hyun created SPARK-51184: - Summary: Remove `TaskState.LOST` logic from `TaskSchedulerImpl` Key: SPARK-51184 URL: https://issues.apache.org/jira/browse/SPARK-51184 Project: Spark Issu

[jira] [Updated] (SPARK-51184) Remove `TaskState.LOST` logic from `TaskSchedulerImpl`

[ https://issues.apache.org/jira/browse/SPARK-51184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51184: --- Labels: pull-request-available (was: ) > Remove `TaskState.LOST` logic from `TaskSchedulerI

[jira] [Assigned] (SPARK-51184) Remove `TaskState.LOST` logic from `TaskSchedulerImpl`

[ https://issues.apache.org/jira/browse/SPARK-51184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51184: - Assignee: Dongjoon Hyun > Remove `TaskState.LOST` logic from `TaskSchedulerImpl` >

[jira] [Updated] (SPARK-51180) Upgrade `Arrow` to 19.0.0

[ https://issues.apache.org/jira/browse/SPARK-51180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51180: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Upgrade `Arrow` to 19.0

[jira] [Created] (SPARK-51182) DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified

Vlad Rozov created SPARK-51182: -- Summary: DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified Key: SPARK-51182 URL: https://issues.apache.org/jira/browse/SPARK-51182 Project

[jira] [Updated] (SPARK-51183) Update spec to point to Parquet

[ https://issues.apache.org/jira/browse/SPARK-51183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51183: --- Labels: pull-request-available (was: ) > Update spec to point to Parquet >

[jira] [Updated] (SPARK-51008) Implement Result Stage for AQE

[ https://issues.apache.org/jira/browse/SPARK-51008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51008: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Implement Result Stage

[jira] [Updated] (SPARK-51042) Read and write CalendarIntervals using one call to get/putLong consistently

[ https://issues.apache.org/jira/browse/SPARK-51042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51042: -- Fix Version/s: 3.5.5 > Read and write CalendarIntervals using one call to get/putLong consiste

  1   2   >