[jira] [Commented] (SPARK-46349) Prevent SortOrder from Accepting Nested SortOrder Instances

2023-12-09 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795022#comment-17795022 ] Snoot.io commented on SPARK-46349: -- User 'hhdri' has created a pull request for this is

[jira] [Updated] (SPARK-46349) Prevent SortOrder from Accepting Nested SortOrder Instances

2023-12-09 Thread Majid Hajiheidari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Majid Hajiheidari updated SPARK-46349: -- Description: Hello everyone, This is my first contribution to the project. I welcome

[jira] [Created] (SPARK-46349) Prevent SortOrder from Accepting Nested SortOrder Instances

2023-12-09 Thread Majid Hajiheidari (Jira)
Majid Hajiheidari created SPARK-46349: - Summary: Prevent SortOrder from Accepting Nested SortOrder Instances Key: SPARK-46349 URL: https://issues.apache.org/jira/browse/SPARK-46349 Project: Spark

[jira] [Updated] (SPARK-46348) Support `spark.deploy.recoveryTimeout`

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46348: --- Labels: pull-request-available (was: ) > Support `spark.deploy.recoveryTimeout` > -

[jira] [Created] (SPARK-46348) Support `spark.deploy.recoveryTimeout`

2023-12-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46348: - Summary: Support `spark.deploy.recoveryTimeout` Key: SPARK-46348 URL: https://issues.apache.org/jira/browse/SPARK-46348 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46347) Reorganize `RollingTests `

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46347: --- Labels: pull-request-available (was: ) > Reorganize `RollingTests ` > -

[jira] [Created] (SPARK-46347) Reorganize `RollingTests `

2023-12-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46347: - Summary: Reorganize `RollingTests ` Key: SPARK-46347 URL: https://issues.apache.org/jira/browse/SPARK-46347 Project: Spark Issue Type: Test Compo

[jira] [Assigned] (SPARK-46341) Move `SeriesInterpolateTests` to `pyspark.pandas.tests.series.*`

2023-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46341: - Assignee: Ruifeng Zheng > Move `SeriesInterpolateTests` to `pyspark.pandas.tests.series

[jira] [Resolved] (SPARK-46341) Move `SeriesInterpolateTests` to `pyspark.pandas.tests.series.*`

2023-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46341. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44274 [https://

[jira] [Updated] (SPARK-46346) Fix Master to update worker from UNKNOWN to ALIVE on RegisterWorker message

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46346: --- Labels: pull-request-available (was: ) > Fix Master to update worker from UNKNOWN to ALIVE

[jira] [Updated] (SPARK-46345) Reorganize `DiffFramesParityCovCorrWithTests `

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46345: --- Labels: pull-request-available (was: ) > Reorganize `DiffFramesParityCovCorrWithTests ` > -

[jira] [Created] (SPARK-46346) Fix Master to update worker from UNKNOWN to ALIVE on RegisterWorker message

2023-12-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46346: - Summary: Fix Master to update worker from UNKNOWN to ALIVE on RegisterWorker message Key: SPARK-46346 URL: https://issues.apache.org/jira/browse/SPARK-46346 Project

[jira] [Created] (SPARK-46345) Reorganize `DiffFramesParityCovCorrWithTests `

2023-12-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46345: - Summary: Reorganize `DiffFramesParityCovCorrWithTests ` Key: SPARK-46345 URL: https://issues.apache.org/jira/browse/SPARK-46345 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-46340) Reorganize EWMTests

2023-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46340: - Assignee: Ruifeng Zheng > Reorganize EWMTests > --- > >

[jira] [Resolved] (SPARK-46340) Reorganize EWMTests

2023-12-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46340. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44273 [https://

[jira] [Updated] (SPARK-44632) DiskBlockManager should check and be able to handle stale directories

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44632: --- Labels: pull-request-available (was: ) > DiskBlockManager should check and be able to handl

[jira] [Resolved] (SPARK-46344) Warn properly when a driver exists successfully but master is disconnected

2023-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46344. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44278 [https://

[jira] [Resolved] (SPARK-46339) Directory with number name should not be treated as metadata log

2023-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46339. --- Fix Version/s: 4.0.0 3.5.1 3.4.3 Resolution: Fix

[jira] [Assigned] (SPARK-46344) Warn properly when a driver exists successfully but master is disconnected

2023-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46344: - Assignee: Dongjoon Hyun > Warn properly when a driver exists successfully but master is

[jira] [Updated] (SPARK-46344) Warn properly when a driver exists successfully but master is disconnected

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46344: --- Labels: pull-request-available (was: ) > Warn properly when a driver exists successfully bu

[jira] [Created] (SPARK-46344) Warn properly when a driver exists successfully but master is disconnected

2023-12-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46344: - Summary: Warn properly when a driver exists successfully but master is disconnected Key: SPARK-46344 URL: https://issues.apache.org/jira/browse/SPARK-46344 Project:

[jira] [Resolved] (SPARK-46322) Replace external link with internal link for error documentation

2023-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46322. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44251 [https://

[jira] [Assigned] (SPARK-46322) Replace external link with internal link for error documentation

2023-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46322: - Assignee: Haejoon Lee > Replace external link with internal link for error documentatio

[jira] [Assigned] (SPARK-46338) Re-enable the get_item test for BasicIndexingTests

2023-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46338: - Assignee: Haejoon Lee > Re-enable the get_item test for BasicIndexingTests > --

[jira] [Resolved] (SPARK-46338) Re-enable the get_item test for BasicIndexingTests

2023-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46338. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44271 [https://

[jira] [Updated] (SPARK-46343) Spark cannot support Docker bridge network in YARN

2023-12-09 Thread Jingwei (Sophie) Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingwei (Sophie) Zhang updated SPARK-46343: --- Description: Hello Spark team, I recently found a possible bug in Spark Yar

[jira] [Updated] (SPARK-46343) Spark cannot support Docker bridge network in YARN

2023-12-09 Thread Jingwei (Sophie) Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingwei (Sophie) Zhang updated SPARK-46343: --- Attachment: spark-yarn-failure-rca.png > Spark cannot support Docker bridge

[jira] [Updated] (SPARK-46343) Spark cannot support Docker bridge network in YARN

2023-12-09 Thread Jingwei (Sophie) Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingwei (Sophie) Zhang updated SPARK-46343: --- Attachment: (was: Screenshot 2023-05-16 221916.png) > Spark cannot suppo

[jira] [Updated] (SPARK-46343) Spark cannot support Docker bridge network in YARN

2023-12-09 Thread Jingwei (Sophie) Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingwei (Sophie) Zhang updated SPARK-46343: --- Description: Hello Spark team, I recently found a possible bug in Spark Yar

[jira] [Updated] (SPARK-46343) Spark cannot support Docker bridge network in YARN

2023-12-09 Thread Jingwei (Sophie) Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingwei (Sophie) Zhang updated SPARK-46343: --- Attachment: Screenshot 2023-05-16 221916.png > Spark cannot support Docker b

[jira] [Created] (SPARK-46343) Spark cannot support Docker bridge network in YARN

2023-12-09 Thread Jingwei (Sophie) Zhang (Jira)
Jingwei (Sophie) Zhang created SPARK-46343: -- Summary: Spark cannot support Docker bridge network in YARN Key: SPARK-46343 URL: https://issues.apache.org/jira/browse/SPARK-46343 Project: Spark

[jira] [Updated] (SPARK-46342) Replace IllegalStateException by SparkException.internalError in sql/core

2023-12-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-46342: - Description: Replace IllegalStateException by SparkException.internalError in sql/core as a part of mig

[jira] [Created] (SPARK-46342) Replace IllegalStateException by SparkException.internalError in sql/core

2023-12-09 Thread Max Gekk (Jira)
Max Gekk created SPARK-46342: Summary: Replace IllegalStateException by SparkException.internalError in sql/core Key: SPARK-46342 URL: https://issues.apache.org/jira/browse/SPARK-46342 Project: Spark

[jira] [Updated] (SPARK-46341) Move `SeriesInterpolateTests` to `pyspark.pandas.tests.series.*`

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46341: --- Labels: pull-request-available (was: ) > Move `SeriesInterpolateTests` to `pyspark.pandas.t

[jira] [Created] (SPARK-46341) Move `SeriesInterpolateTests` to `pyspark.pandas.tests.series.*`

2023-12-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46341: - Summary: Move `SeriesInterpolateTests` to `pyspark.pandas.tests.series.*` Key: SPARK-46341 URL: https://issues.apache.org/jira/browse/SPARK-46341 Project: Spark

[jira] [Updated] (SPARK-46340) Reorganize EWMTests

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46340: --- Labels: pull-request-available (was: ) > Reorganize EWMTests > --- > >

[jira] [Created] (SPARK-46340) Reorganize EWMTests

2023-12-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46340: - Summary: Reorganize EWMTests Key: SPARK-46340 URL: https://issues.apache.org/jira/browse/SPARK-46340 Project: Spark Issue Type: Test Components:

[jira] [Resolved] (SPARK-46333) Replace IllegalStateException by SparkException.internalError in catalyst

2023-12-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46333. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44263 [https://github.com

[jira] [Updated] (SPARK-46333) Replace IllegalStateException by SparkException.internalError in catalyst

2023-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46333: --- Labels: pull-request-available (was: ) > Replace IllegalStateException by SparkException.in