[jira] [Created] (SPARK-40662) Serialization of MapStatuses is somtimes much larger on scala 2.13

2022-10-04 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-40662: -- Summary: Serialization of MapStatuses is somtimes much larger on scala 2.13 Key: SPARK-40662 URL: https://issues.apache.org/jira/browse/SPARK-40662 Project: Spark

[jira] [Assigned] (SPARK-40660) Switch to XORShiftRandom to distribute elements

2022-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40660: --- Assignee: Yuming Wang > Switch to XORShiftRandom to distribute elements > -

[jira] [Resolved] (SPARK-40660) Switch to XORShiftRandom to distribute elements

2022-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40660. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38106 [https://gith

[jira] [Assigned] (SPARK-40587) SELECT * shouldn't be empty project list in proto.

2022-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40587: --- Assignee: Rui Wang > SELECT * shouldn't be empty project list in proto. > -

[jira] [Resolved] (SPARK-40587) SELECT * shouldn't be empty project list in proto.

2022-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40587. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38023 [https://gith

[jira] [Commented] (SPARK-40659) Schema evolution for protobuf (and Avro too?)

2022-10-04 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612849#comment-17612849 ] Raghu Angadi commented on SPARK-40659: -- For 1): No schema evolution is necessary. W

[jira] [Commented] (SPARK-40651) Drop Hadoop2 binary distribtuion from release process

2022-10-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612845#comment-17612845 ] Yang Jie commented on SPARK-40651: -- Is there an overall removal plan? What can I do to

[jira] [Assigned] (SPARK-40661) Upgrade `jetty-http` from 9.4.48.v20220622 to 9.4.49.v20220914

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40661: Assignee: (was: Apache Spark) > Upgrade `jetty-http` from 9.4.48.v20220622 to 9.4.49.

[jira] [Assigned] (SPARK-40661) Upgrade `jetty-http` from 9.4.48.v20220622 to 9.4.49.v20220914

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40661: Assignee: Apache Spark > Upgrade `jetty-http` from 9.4.48.v20220622 to 9.4.49.v20220914 >

[jira] [Commented] (SPARK-40661) Upgrade `jetty-http` from 9.4.48.v20220622 to 9.4.49.v20220914

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612840#comment-17612840 ] Apache Spark commented on SPARK-40661: -- User 'panbingkun' has created a pull reques

[jira] [Created] (SPARK-40661) Upgrade `jetty-http` from 9.4.48.v20220622 to 9.4.49.v20220914

2022-10-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-40661: --- Summary: Upgrade `jetty-http` from 9.4.48.v20220622 to 9.4.49.v20220914 Key: SPARK-40661 URL: https://issues.apache.org/jira/browse/SPARK-40661 Project: Spark

[jira] [Commented] (SPARK-40660) Switch to XORShiftRandom to distribute elements

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612839#comment-17612839 ] Apache Spark commented on SPARK-40660: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-40660) Switch to XORShiftRandom to distribute elements

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40660: Assignee: (was: Apache Spark) > Switch to XORShiftRandom to distribute elements > ---

[jira] [Commented] (SPARK-40660) Switch to XORShiftRandom to distribute elements

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612838#comment-17612838 ] Apache Spark commented on SPARK-40660: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-40660) Switch to XORShiftRandom to distribute elements

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40660: Assignee: Apache Spark > Switch to XORShiftRandom to distribute elements > --

[jira] [Assigned] (SPARK-40645) Throw exception for Collect() and recommend to use toPandas()

2022-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40645: Assignee: Rui Wang > Throw exception for Collect() and recommend to use toPandas() >

[jira] [Resolved] (SPARK-40645) Throw exception for Collect() and recommend to use toPandas()

2022-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40645. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38089 [https://gi

[jira] [Updated] (SPARK-40660) Switch to XORShiftRandom to distribute elements

2022-10-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40660: Summary: Switch to XORShiftRandom to distribute elements (was: Switch XORShiftRandom to distribut

[jira] [Created] (SPARK-40660) Switch XORShiftRandom to distribute elements

2022-10-04 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40660: --- Summary: Switch XORShiftRandom to distribute elements Key: SPARK-40660 URL: https://issues.apache.org/jira/browse/SPARK-40660 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39725: -- Fix Version/s: 3.3.2 > Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622 >

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612831#comment-17612831 ] Dongjoon Hyun commented on SPARK-39725: --- This landed to branch-3.3 via [https://gi

[jira] [Updated] (SPARK-40281) Memory Profiler on Executors

2022-10-04 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40281: - Description: Profiling is critical to performance engineering. Memory consumption is a key indi

[jira] [Resolved] (SPARK-40428) Add a shutdownhook to CoarseGrained scheduler to avoid dangling resources during abnormal shutdown

2022-10-04 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-40428. -- Fix Version/s: 3.4.0 Assignee: Holden Karau Resolution: Fixed > Add a shutdown

[jira] [Commented] (SPARK-40540) Migrate compilation errors onto error classes

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612829#comment-17612829 ] Apache Spark commented on SPARK-40540: -- User 'itholic' has created a pull request f

[jira] [Resolved] (SPARK-40585) Support double-quoted identifiers

2022-10-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40585. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38022 [https:

[jira] [Assigned] (SPARK-40585) Support double-quoted identifiers

2022-10-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40585: -- Assignee: Serge Rielau > Support double-quoted identifiers >

[jira] [Updated] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-10-04 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-40617: --- Fix Version/s: 3.2.0 > Assertion failed in ExecutorMetricsPoller "task count shouldn

[jira] [Commented] (SPARK-40659) Schema evolution for protobuf (and Avro too?)

2022-10-04 Thread Mohan Parthasarathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612811#comment-17612811 ] Mohan Parthasarathy commented on SPARK-40659: - [~rangadi]  A few clarificati

[jira] [Created] (SPARK-40659) Schema evolution for protobuf (and Avro too?)

2022-10-04 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-40659: Summary: Schema evolution for protobuf (and Avro too?) Key: SPARK-40659 URL: https://issues.apache.org/jira/browse/SPARK-40659 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-40658) Protobuf v2 & v3 support

2022-10-04 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-40658: Summary: Protobuf v2 & v3 support Key: SPARK-40658 URL: https://issues.apache.org/jira/browse/SPARK-40658 Project: Spark Issue Type: Improvement Co

[jira] [Created] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-04 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-40657: Summary: Add support for compiled classes (Java classes) Key: SPARK-40657 URL: https://issues.apache.org/jira/browse/SPARK-40657 Project: Spark Issue Type: I

[jira] [Assigned] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40654: Assignee: Apache Spark > Protobuf support MVP with descriptor files > ---

[jira] [Assigned] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40654: Assignee: (was: Apache Spark) > Protobuf support MVP with descriptor files >

[jira] [Commented] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612802#comment-17612802 ] Apache Spark commented on SPARK-40654: -- User 'SandishKumarHN' has created a pull re

[jira] [Assigned] (SPARK-40655) Protobuf functions in Python

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40655: Assignee: (was: Apache Spark) > Protobuf functions in Python > -

[jira] [Assigned] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40648: - Assignee: Yang Jie (was: Apache Spark) > Add `@ExtendedLevelDBTest` to the leveldb r

[jira] [Created] (SPARK-40656) Schema-registry support for Protobuf format

2022-10-04 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-40656: Summary: Schema-registry support for Protobuf format Key: SPARK-40656 URL: https://issues.apache.org/jira/browse/SPARK-40656 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40648: -- Fix Version/s: 3.3.2 > Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn

[jira] [Commented] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612799#comment-17612799 ] Dongjoon Hyun commented on SPARK-40648: --- This landed to branch-3.3 via [https://gi

[jira] [Commented] (SPARK-40655) Protobuf functions in Python

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612800#comment-17612800 ] Apache Spark commented on SPARK-40655: -- User 'SandishKumarHN' has created a pull re

[jira] [Assigned] (SPARK-40655) Protobuf functions in Python

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40655: Assignee: Apache Spark > Protobuf functions in Python > - >

[jira] [Created] (SPARK-40655) Protobuf functions in Python

2022-10-04 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-40655: Summary: Protobuf functions in Python Key: SPARK-40655 URL: https://issues.apache.org/jira/browse/SPARK-40655 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-04 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-40654: Summary: Protobuf support MVP with descriptor files Key: SPARK-40654 URL: https://issues.apache.org/jira/browse/SPARK-40654 Project: Spark Issue Type: Improv

[jira] [Resolved] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40648. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38095 [https://

[jira] [Commented] (SPARK-40652) Add MASK_PHONE and TRY_MASK_PHONE functions

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612796#comment-17612796 ] Apache Spark commented on SPARK-40652: -- User 'dtenedor' has created a pull request

[jira] [Assigned] (SPARK-40652) Add MASK_PHONE and TRY_MASK_PHONE functions

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40652: Assignee: (was: Apache Spark) > Add MASK_PHONE and TRY_MASK_PHONE functions > ---

[jira] [Assigned] (SPARK-40636) Fix wrong remained shuffles log in BlockManagerDecommissioner

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40636: - Assignee: Zhongwei Zhu > Fix wrong remained shuffles log in BlockManagerDecommissioner

[jira] [Assigned] (SPARK-40652) Add MASK_PHONE and TRY_MASK_PHONE functions

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40652: Assignee: Apache Spark > Add MASK_PHONE and TRY_MASK_PHONE functions > --

[jira] [Commented] (SPARK-40652) Add MASK_PHONE and TRY_MASK_PHONE functions

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612795#comment-17612795 ] Apache Spark commented on SPARK-40652: -- User 'dtenedor' has created a pull request

[jira] [Resolved] (SPARK-40636) Fix wrong remained shuffles log in BlockManagerDecommissioner

2022-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40636. --- Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution: Fix

[jira] [Commented] (SPARK-40653) Protobuf Support in Structured Streaming

2022-10-04 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612793#comment-17612793 ] Raghu Angadi commented on SPARK-40653: -- cc: [~sanysand...@gmail.com] , [~mparthas] 

[jira] [Created] (SPARK-40653) Protobuf Support in Structured Streaming

2022-10-04 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-40653: Summary: Protobuf Support in Structured Streaming Key: SPARK-40653 URL: https://issues.apache.org/jira/browse/SPARK-40653 Project: Spark Issue Type: Epic

[jira] [Created] (SPARK-40652) Add MASK_PHONE and TRY_MASK_PHONE functions

2022-10-04 Thread Daniel (Jira)
Daniel created SPARK-40652: -- Summary: Add MASK_PHONE and TRY_MASK_PHONE functions Key: SPARK-40652 URL: https://issues.apache.org/jira/browse/SPARK-40652 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-40651) Drop Hadoop2 binary distribtuion from release process

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612764#comment-17612764 ] Apache Spark commented on SPARK-40651: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-40651) Drop Hadoop2 binary distribtuion from release process

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612762#comment-17612762 ] Apache Spark commented on SPARK-40651: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-40651) Drop Hadoop2 binary distribtuion from release process

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40651: Assignee: Apache Spark > Drop Hadoop2 binary distribtuion from release process >

[jira] [Assigned] (SPARK-40651) Drop Hadoop2 binary distribtuion from release process

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40651: Assignee: (was: Apache Spark) > Drop Hadoop2 binary distribtuion from release process

[jira] [Created] (SPARK-40651) Drop Hadoop2 binary distribtuion from release process

2022-10-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-40651: - Summary: Drop Hadoop2 binary distribtuion from release process Key: SPARK-40651 URL: https://issues.apache.org/jira/browse/SPARK-40651 Project: Spark Issue

[jira] [Created] (SPARK-40650) Infer date type for Json schema inference

2022-10-04 Thread Xiaonan Yang (Jira)
Xiaonan Yang created SPARK-40650: Summary: Infer date type for Json schema inference Key: SPARK-40650 URL: https://issues.apache.org/jira/browse/SPARK-40650 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-40649) Infer date type for Json schema inference

2022-10-04 Thread Xiaonan Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaonan Yang updated SPARK-40649: - Fix Version/s: (was: 3.4.0) > Infer date type for Json schema inference > --

[jira] [Resolved] (SPARK-40649) Infer date type for Json schema inference

2022-10-04 Thread Xiaonan Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaonan Yang resolved SPARK-40649. -- Resolution: Duplicate > Infer date type for Json schema inference > --

[jira] [Created] (SPARK-40649) Infer date type for Json schema inference

2022-10-04 Thread Xiaonan Yang (Jira)
Xiaonan Yang created SPARK-40649: Summary: Infer date type for Json schema inference Key: SPARK-40649 URL: https://issues.apache.org/jira/browse/SPARK-40649 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612727#comment-17612727 ] Apache Spark commented on SPARK-39725: -- User 'bjornjorgensen' has created a pull re

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612711#comment-17612711 ] Bjørn Jørgensen commented on SPARK-39725: - I created a branch from 3.3 but it st

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612707#comment-17612707 ] Sean R. Owen commented on SPARK-39725: -- [~bjornjorgensen] well, it would need to be

[jira] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725 ] Bjørn Jørgensen deleted comment on SPARK-39725: - was (Author: bjornjorgensen): [~srowen] LIke [this|https://github.com/bjornjorgensen/spark/tree/3.3-etty_48.v20220622] one? > Upgrade

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612704#comment-17612704 ] Bjørn Jørgensen commented on SPARK-39725: - [~srowen] LIke [this|https://github.

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612689#comment-17612689 ] Sean R. Owen commented on SPARK-39725: -- I don't know if this affects Spark, but I t

[jira] [Commented] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612680#comment-17612680 ] Apache Spark commented on SPARK-40648: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-04 Thread phoebe chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612681#comment-17612681 ] phoebe chen commented on SPARK-39725: - Thanks(y) > Upgrade jetty-http from 9.4.46.v

[jira] [Commented] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612679#comment-17612679 ] Apache Spark commented on SPARK-40648: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612676#comment-17612676 ] Apache Spark commented on SPARK-40648: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612674#comment-17612674 ] Apache Spark commented on SPARK-40648: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40648: Assignee: Apache Spark > Add `@ExtendedLevelDBTest` to the leveldb relevant tests in t

[jira] [Commented] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612653#comment-17612653 ] Apache Spark commented on SPARK-40648: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40648: Assignee: Apache Spark > Add `@ExtendedLevelDBTest` to the leveldb relevant tests in t

[jira] [Assigned] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40648: Assignee: (was: Apache Spark) > Add `@ExtendedLevelDBTest` to the leveldb relevant

[jira] [Updated] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40648: - Summary: Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module (was: Add `@E

[jira] [Updated] (SPARK-40648) Add `@ExtendedLevelDBTest` to the testing leveldb in the yarn module

2022-10-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40648: - Summary: Add `@ExtendedLevelDBTest` to the testing leveldb in the yarn module (was: Add `@ExtendedL

[jira] [Created] (SPARK-40648) Add `@ExtendedLevelDBTest` for the case of testing leveldb in the yarn module

2022-10-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-40648: Summary: Add `@ExtendedLevelDBTest` for the case of testing leveldb in the yarn module Key: SPARK-40648 URL: https://issues.apache.org/jira/browse/SPARK-40648 Project: Spar

[jira] [Commented] (SPARK-40618) Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612517#comment-17612517 ] Apache Spark commented on SPARK-40618: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-40647) DAGScheduler should fail job until all related running tasks have been killed

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40647: Assignee: (was: Apache Spark) > DAGScheduler should fail job until all related runnin

[jira] [Commented] (SPARK-40647) DAGScheduler should fail job until all related running tasks have been killed

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612503#comment-17612503 ] Apache Spark commented on SPARK-40647: -- User 'wecharyu' has created a pull request

[jira] [Assigned] (SPARK-40647) DAGScheduler should fail job until all related running tasks have been killed

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40647: Assignee: Apache Spark > DAGScheduler should fail job until all related running tasks hav

[jira] [Commented] (SPARK-40647) DAGScheduler should fail job until all related running tasks have been killed

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612504#comment-17612504 ] Apache Spark commented on SPARK-40647: -- User 'wecharyu' has created a pull request

[jira] [Commented] (SPARK-40096) Finalize shuffle merge slow due to connection creation fails

2022-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612497#comment-17612497 ] Apache Spark commented on SPARK-40096: -- User 'wankunde' has created a pull request