[jira] [Commented] (SPARK-35419) Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345893#comment-17345893 ] Apache Spark commented on SPARK-35419: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-35419) Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345892#comment-17345892 ] Apache Spark commented on SPARK-35419: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-35419) Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35419: Assignee: (was: Apache Spark) > Enable spark.sql.execution.pyspark.udf.simplifiedTrac

[jira] [Assigned] (SPARK-35419) Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35419: Assignee: Apache Spark > Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabl

[jira] [Comment Edited] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345821#comment-17345821 ] Rafal Wojdyla edited comment on SPARK-35386 at 5/17/21, 5:53 AM: -

[jira] [Comment Edited] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345821#comment-17345821 ] Rafal Wojdyla edited comment on SPARK-35386 at 5/17/21, 5:52 AM: -

[jira] [Comment Edited] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345821#comment-17345821 ] Rafal Wojdyla edited comment on SPARK-35386 at 5/17/21, 5:51 AM: -

[jira] [Commented] (SPARK-34661) Replaces `OriginalType` with `LogicalTypeAnnotation` in VectorizedColumnReader

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345881#comment-17345881 ] Apache Spark commented on SPARK-34661: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345880#comment-17345880 ] Apache Spark commented on SPARK-32792: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-34661) Replaces `OriginalType` with `LogicalTypeAnnotation` in VectorizedColumnReader

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345879#comment-17345879 ] Apache Spark commented on SPARK-34661: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345878#comment-17345878 ] Apache Spark commented on SPARK-32792: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35420: Assignee: Apache Spark (was: Kousuke Saruta) > Replace the usage of toStringHelper with

[jira] [Assigned] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35420: Assignee: Kousuke Saruta (was: Apache Spark) > Replace the usage of toStringHelper with

[jira] [Commented] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345872#comment-17345872 ] Apache Spark commented on SPARK-35420: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35420: -- Summary: Replace the usage of toStringHelper with ToStringBuilder Key: SPARK-35420 URL: https://issues.apache.org/jira/browse/SPARK-35420 Project: Spark

[jira] [Created] (SPARK-35419) Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default

2021-05-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-35419: Summary: Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default Key: SPARK-35419 URL: https://issues.apache.org/jira/browse/SPARK-35419 Project

[jira] [Assigned] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2021-05-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32792: - Assignee: Yuming Wang > Improve in filter pushdown for ParquetFilters > ---

[jira] [Resolved] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2021-05-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32792. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 29642 [https://

[jira] [Commented] (SPARK-35418) Add sentences function to functions.{scala,py}

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345856#comment-17345856 ] Apache Spark commented on SPARK-35418: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35418) Add sentences function to functions.{scala,py}

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35418: Assignee: Apache Spark (was: Kousuke Saruta) > Add sentences function to functions.{scal

[jira] [Assigned] (SPARK-35418) Add sentences function to functions.{scala,py}

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35418: Assignee: Kousuke Saruta (was: Apache Spark) > Add sentences function to functions.{scal

[jira] [Created] (SPARK-35418) Add sentences function to functions.scala

2021-05-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35418: -- Summary: Add sentences function to functions.scala Key: SPARK-35418 URL: https://issues.apache.org/jira/browse/SPARK-35418 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-35418) Add sentences function to functions.{scala,py}

2021-05-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35418: --- Summary: Add sentences function to functions.{scala,py} (was: Add sentences function to fun

[jira] [Updated] (SPARK-35370) IllegalArgumentException when loading a PipelineModel with Spark 3

2021-05-16 Thread Avenash Kabeera (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avenash Kabeera updated SPARK-35370: Description: Hi,  This is a followup of the this issue https://issues.apache.org/jira/br

[jira] [Resolved] (SPARK-35417) Upgrade SBT to 1.5.2

2021-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35417. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32565 [https://gi

[jira] [Assigned] (SPARK-35417) Upgrade SBT to 1.5.2

2021-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35417: Assignee: Dongjoon Hyun > Upgrade SBT to 1.5.2 > > >

[jira] [Comment Edited] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345821#comment-17345821 ] Rafal Wojdyla edited comment on SPARK-35386 at 5/17/21, 2:00 AM: -

[jira] [Commented] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345821#comment-17345821 ] Rafal Wojdyla commented on SPARK-35386: --- {quote} IIRC, it's not documented. We mig

[jira] [Commented] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345813#comment-17345813 ] Hyukjin Kwon commented on SPARK-35386: -- For the schema being nullable, there are mu

[jira] [Commented] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345811#comment-17345811 ] Rafal Wojdyla commented on SPARK-35386: --- {quote} I think the logic is that, when u

[jira] [Commented] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345809#comment-17345809 ] Hyukjin Kwon commented on SPARK-35386: -- I think the logic is that, when users speci

[jira] [Resolved] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

2021-05-16 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35413. -- Fix Version/s: 3.2.0 3.1.2 3.0.3 Assigne

[jira] [Assigned] (SPARK-35417) Upgrade SBT to 1.5.2

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35417: Assignee: (was: Apache Spark) > Upgrade SBT to 1.5.2 > > >

[jira] [Commented] (SPARK-35417) Upgrade SBT to 1.5.2

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345801#comment-17345801 ] Apache Spark commented on SPARK-35417: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-35417) Upgrade SBT to 1.5.2

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35417: Assignee: Apache Spark > Upgrade SBT to 1.5.2 > > >

[jira] [Created] (SPARK-35417) Upgrade SBT to 1.5.2

2021-05-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-35417: - Summary: Upgrade SBT to 1.5.2 Key: SPARK-35417 URL: https://issues.apache.org/jira/browse/SPARK-35417 Project: Spark Issue Type: Improvement Comp

[jira] [Commented] (SPARK-35320) from_json cannot parse maps with timestamp as key

2021-05-16 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345782#comment-17345782 ] Pablo Langa Blanco commented on SPARK-35320: I'm taking a look at this > fr

[jira] [Resolved] (SPARK-35412) Fix a bug in groupBy of year-month/day-time intervals

2021-05-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35412. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32560 [https://

[jira] [Assigned] (SPARK-35412) Fix a bug in groupBy of year-month/day-time intervals

2021-05-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35412: - Assignee: Takeshi Yamamuro > Fix a bug in groupBy of year-month/day-time intervals > --

[jira] [Assigned] (SPARK-35416) Support PersistentVolumeClaim Reuse

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35416: Assignee: Apache Spark > Support PersistentVolumeClaim Reuse > --

[jira] [Assigned] (SPARK-35416) Support PersistentVolumeClaim Reuse

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35416: Assignee: (was: Apache Spark) > Support PersistentVolumeClaim Reuse > ---

[jira] [Commented] (SPARK-35416) Support PersistentVolumeClaim Reuse

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345766#comment-17345766 ] Apache Spark commented on SPARK-35416: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-35416) Support PersistentVolumeClaim Reuse

2021-05-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-35416: - Summary: Support PersistentVolumeClaim Reuse Key: SPARK-35416 URL: https://issues.apache.org/jira/browse/SPARK-35416 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35415) Change information to map type for SHOW TABLE EXTENDED command

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345739#comment-17345739 ] Apache Spark commented on SPARK-35415: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-35415) Change information to map type for SHOW TABLE EXTENDED command

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345737#comment-17345737 ] Apache Spark commented on SPARK-35415: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-35415) Change information to map type for SHOW TABLE EXTENDED command

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35415: Assignee: Apache Spark > Change information to map type for SHOW TABLE EXTENDED command >

[jira] [Assigned] (SPARK-35415) Change information to map type for SHOW TABLE EXTENDED command

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35415: Assignee: (was: Apache Spark) > Change information to map type for SHOW TABLE EXTENDE

[jira] [Assigned] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35414: Assignee: Apache Spark (was: Yu Zhong) > Completely fix the broadcast timeout issue in A

[jira] [Commented] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345736#comment-17345736 ] Apache Spark commented on SPARK-35414: -- User 'zhongyu09' has created a pull request

[jira] [Assigned] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35414: Assignee: Yu Zhong (was: Apache Spark) > Completely fix the broadcast timeout issue in A

[jira] [Created] (SPARK-35415) Change information to map type for SHOW TABLE EXTENDED command

2021-05-16 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-35415: --- Summary: Change information to map type for SHOW TABLE EXTENDED command Key: SPARK-35415 URL: https://issues.apache.org/jira/browse/SPARK-35415 Project: Spark

[jira] [Comment Edited] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

2021-05-16 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345731#comment-17345731 ] Arghya Saha edited comment on SPARK-34645 at 5/16/21, 3:08 PM: ---

[jira] [Commented] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

2021-05-16 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345731#comment-17345731 ] Arghya Saha commented on SPARK-34645: - I am facing the same issue Spark 3.1.1 + JDK

[jira] [Commented] (SPARK-30130) Hardcoded numeric values in common table expressions which utilize GROUP BY are interpreted as ordinal positions

2021-05-16 Thread Adrian Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345730#comment-17345730 ] Adrian Wang commented on SPARK-30130: - I also met this on 2.4.7, and this has been f

[jira] [Updated] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-05-16 Thread Yu Zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Zhong updated SPARK-35414: - Fix Version/s: (was: 3.2.0) > Completely fix the broadcast timeout issue in AQE > --

[jira] [Updated] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-05-16 Thread Yu Zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Zhong updated SPARK-35414: - Description: SPARK-33933 report a issue that in AQE, when the resources is limited, broadcast timeout c

[jira] [Created] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-05-16 Thread Yu Zhong (Jira)
Yu Zhong created SPARK-35414: Summary: Completely fix the broadcast timeout issue in AQE Key: SPARK-35414 URL: https://issues.apache.org/jira/browse/SPARK-35414 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-35399) State is still needed in the event of executor failure

2021-05-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-35399: - Priority: Trivial (was: Minor) > State is still needed in the event of executor failure > -

[jira] [Resolved] (SPARK-34661) Replaces `OriginalType` with `LogicalTypeAnnotation` in VectorizedColumnReader

2021-05-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34661. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31776 [https://gi

[jira] [Assigned] (SPARK-34661) Replaces `OriginalType` with `LogicalTypeAnnotation` in VectorizedColumnReader

2021-05-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34661: Assignee: Yang Jie > Replaces `OriginalType` with `LogicalTypeAnnotation` in VectorizedCo

[jira] [Commented] (SPARK-34953) inferSchema for type date

2021-05-16 Thread Tomas Hudik (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345680#comment-17345680 ] Tomas Hudik commented on SPARK-34953: - Hi [~saurabhc100] , thanks for PR. "when the

[jira] [Resolved] (SPARK-35286) Replace SessionState.start with SessionState.setCurrentSessionState

2021-05-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-35286. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32410 [https://gith

[jira] [Assigned] (SPARK-35286) Replace SessionState.start with SessionState.setCurrentSessionState

2021-05-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-35286: --- Assignee: Yuming Wang > Replace SessionState.start with SessionState.setCurrentSessionState

[jira] [Comment Edited] (SPARK-35406) TaskCompletionListenerException: Premature end of Content-Length delimited message body

2021-05-16 Thread Avik Aggarwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345671#comment-17345671 ] Avik Aggarwal edited comment on SPARK-35406 at 5/16/21, 10:31 AM:

[jira] [Commented] (SPARK-35406) TaskCompletionListenerException: Premature end of Content-Length delimited message body

2021-05-16 Thread Avik Aggarwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345671#comment-17345671 ] Avik Aggarwal commented on SPARK-35406: --- [~hyukjin.kwon] thanks for reply. I just

[jira] [Commented] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345670#comment-17345670 ] Apache Spark commented on SPARK-35413: -- User 'maropu' has created a pull request fo

[jira] [Assigned] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35413: Assignee: Apache Spark > Use the SHA of the latest commit when checking out databricks/tp

[jira] [Assigned] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35413: Assignee: (was: Apache Spark) > Use the SHA of the latest commit when checking out da

[jira] [Commented] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345669#comment-17345669 ] Apache Spark commented on SPARK-35413: -- User 'maropu' has created a pull request fo

[jira] [Created] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

2021-05-16 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-35413: Summary: Use the SHA of the latest commit when checking out databricks/tpcds-kit Key: SPARK-35413 URL: https://issues.apache.org/jira/browse/SPARK-35413 Proje

[jira] [Assigned] (SPARK-35412) Fix a bug in groupBy of year-month/day-time intervals

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35412: Assignee: Apache Spark > Fix a bug in groupBy of year-month/day-time intervals >

[jira] [Assigned] (SPARK-35412) Fix a bug in groupBy of year-month/day-time intervals

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35412: Assignee: (was: Apache Spark) > Fix a bug in groupBy of year-month/day-time intervals

[jira] [Commented] (SPARK-35412) Fix a bug in groupBy of year-month/day-time intervals

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345665#comment-17345665 ] Apache Spark commented on SPARK-35412: -- User 'maropu' has created a pull request fo

[jira] [Created] (SPARK-35412) Fix a bug in groupBy of year-month/day-time intervals

2021-05-16 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-35412: Summary: Fix a bug in groupBy of year-month/day-time intervals Key: SPARK-35412 URL: https://issues.apache.org/jira/browse/SPARK-35412 Project: Spark

[jira] [Commented] (SPARK-35386) parquet read with schema should fail on non-existing columns

2021-05-16 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345645#comment-17345645 ] Rafal Wojdyla commented on SPARK-35386: --- [~hyukjin.kwon] Thanks for the prompt r

[jira] [Commented] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

2021-05-16 Thread Hector (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345641#comment-17345641 ] Hector commented on SPARK-34204: It seems that the bug has already been fixed in Spark 3

[jira] [Commented] (SPARK-35410) Unused subexpressions leftover in WholeStageCodegen subexpression elimination

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345633#comment-17345633 ] Apache Spark commented on SPARK-35410: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-35410) Unused subexpressions leftover in WholeStageCodegen subexpression elimination

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35410: Assignee: Apache Spark > Unused subexpressions leftover in WholeStageCodegen subexpressio

[jira] [Commented] (SPARK-35410) Unused subexpressions leftover in WholeStageCodegen subexpression elimination

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345634#comment-17345634 ] Apache Spark commented on SPARK-35410: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-35410) Unused subexpressions leftover in WholeStageCodegen subexpression elimination

2021-05-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35410: Assignee: (was: Apache Spark) > Unused subexpressions leftover in WholeStageCodegen s