[jira] [Commented] (SPARK-35204) CatalystTypeConverters of date/timestamp should accept both the old and new Java time classes

2021-04-23 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331117#comment-17331117 ] Kadir Selçuk commented on SPARK-35204: -- Sorunları çö

[jira] [Created] (SPARK-35209) CLONE - CatalystTypeConverters of date/timestamp should accept both the old and new Java time classes

2021-04-23 Thread Jira
Kadir Selçuk created SPARK-35209: Summary: CLONE - CatalystTypeConverters of date/timestamp should accept both the old and new Java time classes Key: SPARK-35209 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Commented] (SPARK-35237) In k8s, during running spark job, IllegalArgumentException(too large frame) is raised on spark driver. It seems to related to prometheus

2021-05-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340723#comment-17340723 ] Kilyén Attila Örs commented on SPARK-35237: --- Hi we saw this issue when

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2021-05-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346060#comment-17346060 ] Ismaël Mejía commented on SPARK-25075: -- Don't want to be a party pooper

[jira] [Updated] (SPARK-31168) Upgrade Scala to 2.12.14

2021-05-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-31168: - Summary: Upgrade Scala to 2.12.14 (was: Upgrade Scala to 2.12.13) > Upgrade Scala to 2.12

[jira] [Commented] (SPARK-31168) Upgrade Scala to 2.12.14

2021-05-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17353358#comment-17353358 ] Ismaël Mejía commented on SPARK-31168: -- For info Scala 2.12.14 is out now h

[jira] [Created] (SPARK-35557) Adapt uses of JDK Internal APIs (Unsafe, etc)

2021-05-28 Thread Jira
Ismaël Mejía created SPARK-35557: Summary: Adapt uses of JDK Internal APIs (Unsafe, etc) Key: SPARK-35557 URL: https://issues.apache.org/jira/browse/SPARK-35557 Project: Spark Issue Type

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Description: I tried to run a Spark pipeline using the most recent 3.2.0-SNAPSHOT with Spark

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Summary: Adapt uses of JDK 17 Internal APIs (Unsafe, etc) (was: Adapt uses of JDK Internal

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs (Unsafe, etc)

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Description: I tried to run a Spark pipeline using the most recent 3.2.0-SNAPSHOT with Spark

[jira] [Updated] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

2021-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-35557: - Summary: Adapt uses of JDK 17 Internal APIs (was: Adapt uses of JDK 17 Internal APIs (Unsafe

[jira] [Created] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

2021-05-31 Thread Jira
楚中天 created SPARK-35590: --- Summary: pyspark v3.1.1removed pyspark.streaming.kafka? Key: SPARK-35590 URL: https://issues.apache.org/jira/browse/SPARK-35590 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-35597) CTE With clause not working when using JDBC connection

2021-06-01 Thread Jira
Randall Suárez created SPARK-35597: -- Summary: CTE With clause not working when using JDBC connection Key: SPARK-35597 URL: https://issues.apache.org/jira/browse/SPARK-35597 Project: Spark

[jira] [Commented] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

2021-06-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355182#comment-17355182 ] Ismaël Mejía commented on SPARK-35557: -- Spark probably won't support int

[jira] [Updated] (SPARK-35590) pyspark v3.1.1removed pyspark.streaming.kafka?

2021-06-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 楚中天 updated SPARK-35590: Description: I could not import the module that name kafka from pyspark.streaming,and I did not found it in the

[jira] [Commented] (SPARK-20082) Incremental update of LDA model, by adding initialModel as start point

2021-06-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-20082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359164#comment-17359164 ] Cristina Flores Fernández commented on SPARK-20082: --- Hi, is

[jira] [Assigned] (SPARK-35701) Contention on SQLConf.sqlConfEntries and SQLConf.staticConfKeys

2021-06-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-35701: - Assignee: Haiyang Sun > Contention on SQLConf.sqlConfEntries

[jira] [Created] (SPARK-35709) Remove links to Nomad integration in the Documentation

2021-06-10 Thread Jira
Paweł Ptaszyński created SPARK-35709: Summary: Remove links to Nomad integration in the Documentation Key: SPARK-35709 URL: https://issues.apache.org/jira/browse/SPARK-35709 Project: Spark

[jira] [Updated] (SPARK-35709) Remove links to Nomad integration in the Documentation

2021-06-10 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paweł Ptaszyński updated SPARK-35709: - Priority: Trivial (was: Major) > Remove links to Nomad integration in

[jira] [Created] (SPARK-37706) Deserializing problem in java 17

2021-12-21 Thread Jira
Krzysztof Strzała created SPARK-37706: - Summary: Deserializing problem in java 17 Key: SPARK-37706 URL: https://issues.apache.org/jira/browse/SPARK-37706 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

2021-12-23 Thread Jira
Michał Słapek created SPARK-37730: - Summary: plot.hist throws AttributeError on pandas=1.3.5 Key: SPARK-37730 URL: https://issues.apache.org/jira/browse/SPARK-37730 Project: Spark Issue Type

[jira] [Updated] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5

2021-12-23 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Słapek updated SPARK-37730: -- Description: plot.hist from PySpark throws AttributeError exception when pyspark.pandas is

[jira] [Created] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2022-01-06 Thread Jira
Clément de Groc created SPARK-37829: --- Summary: An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values Key: SPARK-37829 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Created] (SPARK-37830) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2022-01-06 Thread Jira
Clément de Groc created SPARK-37830: --- Summary: An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values Key: SPARK-37830 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Resolved] (SPARK-37830) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2022-01-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Clément de Groc resolved SPARK-37830. - Resolution: Duplicate > An outer-join using joinWith on DataFrames returns Rows w

[jira] [Updated] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2022-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Clément de Groc updated SPARK-37829: Description: Doing an outer-join using {{joinWith}} on {{{}DataFrame{}}}s used to return

[jira] [Updated] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2022-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Clément de Groc updated SPARK-37829: Description: Doing an outer-join using {{joinWith}} on {{{}DataFrame{}}}s used to return

[jira] [Commented] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2022-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470866#comment-17470866 ] Clément de Groc commented on SPARK-37829: - CC [~cloud_fan]. Tagging yo

[jira] [Commented] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2022-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470867#comment-17470867 ] Clément de Groc commented on SPARK-37829: - Opened two equivalent PRs: one

[jira] [Created] (SPARK-37898) Error reading old dates when AQE is enabled in Spark 3.1. Works when AQE is disabled

2022-01-13 Thread Jira
Gaspar Muñoz created SPARK-37898: - Summary: Error reading old dates when AQE is enabled in Spark 3.1. Works when AQE is disabled Key: SPARK-37898 URL: https://issues.apache.org/jira/browse/SPARK-37898

[jira] [Updated] (SPARK-37898) Error reading old dates when AQE is enabled in Spark 3.1. Works when AQE is disabled

2022-01-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaspar Muñoz updated SPARK-37898: -- Description: Hi guys,    I was testing an spark job that fail when I encountered something

[jira] [Updated] (SPARK-37898) Error reading old dates when AQE is enabled in Spark 3.1. Works when AQE is disabled

2022-01-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaspar Muñoz updated SPARK-37898: -- Description: Hi guys,    I was testing an spark job that fail when I encountered something

[jira] [Created] (SPARK-37981) Deletes columns with all Null as default.

2022-01-21 Thread Jira
Bjørn Jørgensen created SPARK-37981: --- Summary: Deletes columns with all Null as default. Key: SPARK-37981 URL: https://issues.apache.org/jira/browse/SPARK-37981 Project: Spark Issue Type

[jira] [Updated] (SPARK-37981) Deletes columns with all Null as default.

2022-01-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37981: Attachment: json_null.json > Deletes columns with all Null as defa

[jira] [Commented] (SPARK-37981) Deletes columns with all Null as default.

2022-01-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480293#comment-17480293 ] Bjørn Jørgensen commented on SPARK-37981: - [^json_null.json] {code:

[jira] [Commented] (SPARK-37981) Deletes columns with all Null as default.

2022-01-23 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480737#comment-17480737 ] Bjørn Jørgensen commented on SPARK-37981: - Please note that the PR that I

[jira] [Commented] (SPARK-37981) Deletes columns with all Null as default.

2022-01-24 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481037#comment-17481037 ] Bjørn Jørgensen commented on SPARK-37981: - {code:java} df_

[jira] [Created] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

2022-01-27 Thread Jira
Johan Nyström-Persson created SPARK-38042: - Summary: Encoder cannot be found when a tuple component is a type alias for an Array Key: SPARK-38042 URL: https://issues.apache.org/jira/browse/SPARK-38042

[jira] [Updated] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

2022-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Nyström-Persson updated SPARK-38042: -- Description: ScalaReflection.dataTypeFor fails when Array[T] has been aliased

[jira] [Commented] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

2022-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482963#comment-17482963 ] Johan Nyström-Persson commented on SPARK-38042: --- A similar issue

[jira] [Updated] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

2022-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Nyström-Persson updated SPARK-38042: -- Description: ScalaReflection.dataTypeFor fails when Array[T] has been aliased

[jira] [Created] (SPARK-38067) Pandas on spark deletes columns with all None as default.

2022-01-29 Thread Jira
Bjørn Jørgensen created SPARK-38067: --- Summary: Pandas on spark deletes columns with all None as default. Key: SPARK-38067 URL: https://issues.apache.org/jira/browse/SPARK-38067 Project: Spark

[jira] [Created] (SPARK-38088) Kryo DataWritingSparkTaskResult registration error

2022-02-02 Thread Jira
Michał Wieleba created SPARK-38088: -- Summary: Kryo DataWritingSparkTaskResult registration error Key: SPARK-38088 URL: https://issues.apache.org/jira/browse/SPARK-38088 Project: Spark Issue

[jira] [Updated] (SPARK-38088) Kryo DataWritingSparkTaskResult registration error

2022-02-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Wieleba updated SPARK-38088: --- Description: Spark 3.1.2, Scala 2.12 I'm registering classes

[jira] [Updated] (SPARK-38088) Kryo DataWritingSparkTaskResult registration error

2022-02-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Wieleba updated SPARK-38088: --- Attachment: image-2022-02-02-10-08-51-144.png > Kryo DataWritingSparkTaskRes

[jira] [Updated] (SPARK-38088) Kryo DataWritingSparkTaskResult registration error

2022-02-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Wieleba updated SPARK-38088: --- Attachment: image-2022-02-02-10-09-14-858.png > Kryo DataWritingSparkTaskRes

[jira] [Updated] (SPARK-38088) Kryo DataWritingSparkTaskResult registration error

2022-02-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Wieleba updated SPARK-38088: --- Description: Spark 3.1.2, Scala 2.12 I'm registering classes

[jira] [Updated] (SPARK-38088) Kryo DataWritingSparkTaskResult registration error

2022-02-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Wieleba updated SPARK-38088: --- Attachment: (was: image-2022-02-02-10-08-51-144.png) > Kryo DataWritingSparkTaskRes

[jira] [Created] (SPARK-38137) Repartition+Shuffle+ non deterministic function leads to bad results

2022-02-08 Thread Jira
Jakub Leś created SPARK-38137: - Summary: Repartition+Shuffle+ non deterministic function leads to bad results Key: SPARK-38137 URL: https://issues.apache.org/jira/browse/SPARK-38137 Project: Spark

[jira] [Updated] (SPARK-38137) Repartition+Shuffle+ non deterministic function leads to bad results

2022-02-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakub Leś updated SPARK-38137: -- Component/s: Shuffle > Repartition+Shuffle+ non deterministic function leads to bad resu

[jira] [Updated] (SPARK-38137) Repartition+Shuffle+ non deterministic function leads to bad results

2022-02-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakub Leś updated SPARK-38137: -- Description: Hi, The results when using a non deterministic function in repartition (like rand

[jira] [Updated] (SPARK-38137) Repartition+Shuffle+ non deterministic function leads to bad results

2022-02-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakub Leś updated SPARK-38137: -- Description: Hi, The results when using a non deterministic function in repartition (like rand

[jira] [Commented] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

2022-02-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489167#comment-17489167 ] Johan Nyström-Persson commented on SPARK-38042: --- My initial idea a

[jira] [Comment Edited] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

2022-02-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489167#comment-17489167 ] Johan Nyström-Persson edited comment on SPARK-38042 at 2/8/22, 11:4

[jira] [Comment Edited] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

2022-02-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489167#comment-17489167 ] Johan Nyström-Persson edited comment on SPARK-38042 at 2/8/22, 11:5

[jira] [Commented] (SPARK-25271) Creating parquet table with all the column null throws exception

2022-02-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-25271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494333#comment-17494333 ] Mr.黄 commented on SPARK-25271: -- [~viirya] [~apachespark] Hello, I did not have

[jira] [Commented] (SPARK-31345) Spark fails to write hive parquet table with empty array

2022-02-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-31345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494336#comment-17494336 ] Mr.黄 commented on SPARK-31345: -- Hello, I did not have this problem in Spark2.4.0-CDH6

[jira] [Created] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Jira
Bjørn Jørgensen created SPARK-38262: --- Summary: Upgrade Google guava to version 30.0-jre Key: SPARK-38262 URL: https://issues.apache.org/jira/browse/SPARK-38262 Project: Spark Issue Type

[jira] [Updated] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38262: Description: Apache Spark are using com.google.guava:guava version 14.0.1 which has two

[jira] [Updated] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38262: Description: Apache Spark is using com.google.guava:guava version 14.0.1 which has two

[jira] [Updated] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38262: Description: This is duplicated many times like in [SPARK-32502|https

[jira] [Updated] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38262: Description: This is duplicated many times like in [SPARK-32502|https

[jira] [Created] (SPARK-38287) Upgrade h2 from 2.0.204 to 2.1.210 in /sql/core

2022-02-22 Thread Jira
Bjørn Jørgensen created SPARK-38287: --- Summary: Upgrade h2 from 2.0.204 to 2.1.210 in /sql/core Key: SPARK-38287 URL: https://issues.apache.org/jira/browse/SPARK-38287 Project: Spark Issue

[jira] [Created] (SPARK-38291) Upgrade postgresql from 42.3.0 to 42.3.3

2022-02-22 Thread Jira
Bjørn Jørgensen created SPARK-38291: --- Summary: Upgrade postgresql from 42.3.0 to 42.3.3 Key: SPARK-38291 URL: https://issues.apache.org/jira/browse/SPARK-38291 Project: Spark Issue Type

[jira] [Updated] (SPARK-38291) Upgrade postgresql from 42.3.0 to 42.3.3

2022-02-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38291: Description: postgresql 42.3.0 have two security issues. [CVE-2022-21724|https

[jira] [Updated] (SPARK-38291) Upgrade postgresql from 42.3.0 to 42.3.3

2022-02-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38291: Description: postgresql 42.3.0 has two security issues. [CVE-2022-21724|https

[jira] [Updated] (SPARK-38291) CVE-2022-21724 and GHSA-673j-qm5f-xpv8

2022-02-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38291: Summary: CVE-2022-21724 and GHSA-673j-qm5f-xpv8 (was: Upgrade postgresql from 42.3.0 to

[jira] [Updated] (SPARK-38291) Upgrade postgresql from 42.3.0 to 42.3.3

2022-02-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38291: Summary: Upgrade postgresql from 42.3.0 to 42.3.3 (was: CVE-2022-21724 and GHSA-673j

[jira] [Created] (SPARK-38303) Upgrade ansi-regex from 5.0.0 to 5.0.1 in /dev

2022-02-23 Thread Jira
Bjørn Jørgensen created SPARK-38303: --- Summary: Upgrade ansi-regex from 5.0.0 to 5.0.1 in /dev Key: SPARK-38303 URL: https://issues.apache.org/jira/browse/SPARK-38303 Project: Spark Issue

[jira] [Created] (SPARK-38327) JDBC Source with MariaDB connection returns column names as values

2022-02-25 Thread Jira
Marvin Rösch created SPARK-38327: Summary: JDBC Source with MariaDB connection returns column names as values Key: SPARK-38327 URL: https://issues.apache.org/jira/browse/SPARK-38327 Project: Spark

[jira] [Updated] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-02-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-38330: - Description: Trying to run any job after bumping our Spark version from 3.1.2 to 3.2.1, lead us to the

[jira] [Created] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-02-25 Thread Jira
André F. created SPARK-38330: Summary: Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com] Key: SPARK-38330 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-02-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-38330: - Description: Trying to run any job after bumping our Spark version from 3.1.2 to 3.2.1, lead us to the

[jira] [Updated] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-02-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-38330: - Description: Trying to run any job after bumping our Spark version from 3.1.2 to 3.2.1, lead us to the

[jira] [Updated] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-02-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-38330: - Description: Trying to run any job after bumping our Spark version from 3.1.2 to 3.2.1, lead us to the

[jira] [Updated] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-02-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-38330: - Description: Trying to run any job after bumping our Spark version from 3.1.2 to 3.2.1, lead us to the

[jira] [Created] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1

2022-02-27 Thread Jira
Bjørn Jørgensen created SPARK-38340: --- Summary: Upgrade protobuf-java from 2.5.0 to 3.16.1 Key: SPARK-38340 URL: https://issues.apache.org/jira/browse/SPARK-38340 Project: Spark Issue Type

[jira] [Updated] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1

2022-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38340: Description: [CVE-2021-22569|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021

[jira] [Commented] (SPARK-38288) Aggregate push down doesnt work using Spark SQL jdbc datasource with postgresql

2022-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17498669#comment-17498669 ] Daniel Fernández commented on SPARK-38288: -- [~andrewfmurphy] however in [3

[jira] [Created] (SPARK-38355) Change mktemp() to mkstemp()

2022-02-28 Thread Jira
Bjørn Jørgensen created SPARK-38355: --- Summary: Change mktemp() to mkstemp() Key: SPARK-38355 URL: https://issues.apache.org/jira/browse/SPARK-38355 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38355) Change mktemp() to mkstemp()

2022-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38355: Description: In the file pandasutils.py on line 262 yield tempfile.mktemp(dir=tmp) The

[jira] [Updated] (SPARK-38355) Change mktemp() to mkstemp()

2022-03-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38355: Description: In the file pandasutils.py on line 262 yield tempfile.mktemp(dir=tmp) The

[jira] [Commented] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1

2022-03-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500130#comment-17500130 ] Bjørn Jørgensen commented on SPARK-38340: - ok, well all the test in github

[jira] [Comment Edited] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1

2022-03-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500130#comment-17500130 ] Bjørn Jørgensen edited comment on SPARK-38340 at 3/2/22, 1:0

[jira] [Created] (SPARK-38416) Duplicate functions

2022-03-04 Thread Jira
Bjørn Jørgensen created SPARK-38416: --- Summary: Duplicate functions Key: SPARK-38416 URL: https://issues.apache.org/jira/browse/SPARK-38416 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-38420) Upgrade bcprov-jdk15on from 1.60 to 1.67

2022-03-05 Thread Jira
Bjørn Jørgensen created SPARK-38420: --- Summary: Upgrade bcprov-jdk15on from 1.60 to 1.67 Key: SPARK-38420 URL: https://issues.apache.org/jira/browse/SPARK-38420 Project: Spark Issue Type

[jira] [Created] (SPARK-38421) Cipher Block Chaining IVs should be unpredictable

2022-03-05 Thread Jira
Bjørn Jørgensen created SPARK-38421: --- Summary: Cipher Block Chaining IVs should be unpredictable Key: SPARK-38421 URL: https://issues.apache.org/jira/browse/SPARK-38421 Project: Spark

[jira] [Created] (SPARK-38422) Encryption algorithms should be used with secure mode and padding scheme

2022-03-05 Thread Jira
Bjørn Jørgensen created SPARK-38422: --- Summary: Encryption algorithms should be used with secure mode and padding scheme Key: SPARK-38422 URL: https://issues.apache.org/jira/browse/SPARK-38422

[jira] [Commented] (SPARK-38355) Change mktemp() to mkstemp()

2022-03-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501958#comment-17501958 ] Bjørn Jørgensen commented on SPARK-38355: - Well I did guess that this one

[jira] [Created] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Jira
Bjørn Jørgensen created SPARK-38436: --- Summary: Duplicate test_floor functions Key: SPARK-38436 URL: https://issues.apache.org/jira/browse/SPARK-38436 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507490#comment-17507490 ] André F. commented on SPARK-38330: -- Created ticket on https://issues.apache.org/

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507490#comment-17507490 ] André F. edited comment on SPARK-38330 at 3/16/22, 10:5

[jira] [Updated] (SPARK-20712) [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive table when column type has length greater than 4000 bytes

2017-10-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-20712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-20712: --- Affects Version/s: 2.2.0 > [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive ta

[jira] [Commented] (SPARK-20712) [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive table when column type has length greater than 4000 bytes

2017-10-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-20712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202016#comment-16202016 ] Maciej Bryński commented on SPARK-20712: After ALTER I needed to recreate

[jira] [Commented] (SPARK-21492) Memory leak in SortMergeJoin

2017-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212522#comment-16212522 ] Bartosz Mścichowski commented on SPARK-21492: - Here's a script tha

[jira] [Commented] (SPARK-21439) Cannot use Spark with Python ABCmeta (exception from cloudpickle)

2017-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16214830#comment-16214830 ] Maciej Bryński commented on SPARK-21439: Resolved in https://issues.apache

[jira] [Resolved] (SPARK-21439) Cannot use Spark with Python ABCmeta (exception from cloudpickle)

2017-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński resolved SPARK-21439. Resolution: Duplicate Fix Version/s: 2.3.0 > Cannot use Spark with Python ABCm

[jira] [Created] (SPARK-22339) Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors

2017-10-23 Thread JIRA
Juan Rodríguez Hortalá created SPARK-22339: -- Summary: Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors Key: SPARK-22339 URL: https://issues.apache.org/jira

[jira] [Updated] (SPARK-22339) Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors

2017-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Rodríguez Hortalá updated SPARK-22339: --- Attachment: push_epoch_update-WIP.diff > Push epoch updates to executors

[jira] [Commented] (SPARK-22118) Should prevent change epoch in success stage while there is some running stage

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216768#comment-16216768 ] Maciej Bryński commented on SPARK-22118: I think I have such a problem {

<    1   2   3   4   5   6   7   8   9   10   >