[jira] [Updated] (SPARK-34452) OneVsRest with GBTClassifier throws InternalCompilerException in 3.1.0

2021-02-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danijel Zečević updated SPARK-34452: Summary: OneVsRest with GBTClassifier throws InternalCompilerException in 3.1.0 (was

[jira] [Commented] (SPARK-34479) Add zstandard codec to spark.sql.avro.compression.codec

2021-02-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287639#comment-17287639 ] Ismaël Mejía commented on SPARK-34479: -- Argh a pity that we cannot overwrite

[jira] [Resolved] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-34906. --- Fix Version/s: 3.2.0 Assignee: Ali Afroozeh Resolution: Fixed

[jira] [Created] (SPARK-36826) CVEs in libraries used in bundled jars

2021-09-22 Thread Jira
Carlos Rodríguez Hernández created SPARK-36826: -- Summary: CVEs in libraries used in bundled jars Key: SPARK-36826 URL: https://issues.apache.org/jira/browse/SPARK-36826 Project: Spark

[jira] [Created] (SPARK-36934) Timestamp are written as array bytes.

2021-10-05 Thread Jira
Bjørn Jørgensen created SPARK-36934: --- Summary: Timestamp are written as array bytes. Key: SPARK-36934 URL: https://issues.apache.org/jira/browse/SPARK-36934 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-36934) Timestamp are written as array bytes.

2021-10-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17424860#comment-17424860 ] Bjørn Jørgensen commented on SPARK-36934: - .co

[jira] [Updated] (SPARK-36934) Timestamp are written as array bytes.

2021-10-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-36934: Component/s: Spark Core > Timestamp are written as array by

[jira] [Commented] (SPARK-36934) Timestamp are written as array bytes.

2021-10-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17424901#comment-17424901 ] Bjørn Jørgensen commented on SPARK-36934: - With .co

[jira] [Created] (SPARK-36950) Normalize semi-structured data into a flat table.

2021-10-07 Thread Jira
Bjørn Jørgensen created SPARK-36950: --- Summary: Normalize semi-structured data into a flat table. Key: SPARK-36950 URL: https://issues.apache.org/jira/browse/SPARK-36950 Project: Spark

[jira] [Created] (SPARK-36959) Renamed columns of parquet tables become NULL

2021-10-08 Thread Jira
Tóth Andor created SPARK-36959: -- Summary: Renamed columns of parquet tables become NULL Key: SPARK-36959 URL: https://issues.apache.org/jira/browse/SPARK-36959 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-36984) Misleading Spark Streaming source documentation

2021-10-12 Thread Jira
Lukáš created SPARK-36984: - Summary: Misleading Spark Streaming source documentation Key: SPARK-36984 URL: https://issues.apache.org/jira/browse/SPARK-36984 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-36984) Misleading Spark Streaming source documentation

2021-10-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukáš updated SPARK-36984: -- Description: The documentation at [https://spark.apache.org/docs/latest/streaming-programming-guide.html

[jira] [Updated] (SPARK-36984) Misleading Spark Streaming source documentation

2021-10-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukáš updated SPARK-36984: -- Attachment: docs_highlight.png > Misleading Spark Streaming source documentat

[jira] [Commented] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2021-10-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430425#comment-17430425 ] Michał Wieleba commented on SPARK-33564: Are there any plans to intro

[jira] [Created] (SPARK-37069) HiveClientImpl throws NoSuchMethodError: org.apache.hadoop.hive.ql.metadata.Hive.getWithoutRegisterFns

2021-10-20 Thread Jira
周一帆 created SPARK-37069: --- Summary: HiveClientImpl throws NoSuchMethodError: org.apache.hadoop.hive.ql.metadata.Hive.getWithoutRegisterFns Key: SPARK-37069 URL: https://issues.apache.org/jira/browse/SPARK-37069

[jira] [Updated] (SPARK-37069) HiveClientImpl throws NoSuchMethodError: org.apache.hadoop.hive.ql.metadata.Hive.getWithoutRegisterFns

2021-10-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 周一帆 updated SPARK-37069: Description: If we run Spark SQL with external Hive 2.3.x (before 2.3.9) jars, following error will be thrown

[jira] [Commented] (SPARK-37069) HiveClientImpl throws NoSuchMethodError: org.apache.hadoop.hive.ql.metadata.Hive.getWithoutRegisterFns

2021-10-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431063#comment-17431063 ] 周一帆 commented on SPARK-37069: - IsolatedClientLoader#hiveVersion resolves version st

[jira] [Created] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2021-10-31 Thread Jira
Bjørn Jørgensen created SPARK-37174: --- Summary: WARN WindowExec: No Partition Defined is being printed 4 times. Key: SPARK-37174 URL: https://issues.apache.org/jira/browse/SPARK-37174 Project

[jira] [Updated] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2021-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37174: Description: Hi I use this code  {code:java} // f01 = spark.read.json("/home/test_

[jira] [Updated] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2021-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37174: Description: Hi I use this code  {code:java} f01 = spark.read.json("/home/test_files

[jira] [Updated] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2021-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37174: Description: Hi I use this code  {code:java} f01 = spark.read.json("/home/test_files

[jira] [Updated] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2021-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37174: Description: Hi I use this code   {code:java} f01 = spark.read.json("/home/test_

[jira] [Commented] (SPARK-36934) Timestamp are written as array bytes.

2021-11-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17443343#comment-17443343 ] Bjørn Jørgensen commented on SPARK-36934: - This is now fixed in Apache D

[jira] [Created] (SPARK-37356) Add fine grained locking to BlockInfoManager

2021-11-17 Thread Jira
Herman van Hövell created SPARK-37356: - Summary: Add fine grained locking to BlockInfoManager Key: SPARK-37356 URL: https://issues.apache.org/jira/browse/SPARK-37356 Project: Spark Issue

[jira] [Resolved] (SPARK-37356) Add fine grained locking to BlockInfoManager

2021-11-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-37356. --- Fix Version/s: 3.3.0 Resolution: Fixed > Add fine grained locking

[jira] [Commented] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode

2021-11-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450295#comment-17450295 ] 王俊博 commented on SPARK-34248: - {{where is the issue links?I found some issue

[jira] [Comment Edited] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode

2021-11-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450295#comment-17450295 ] 王俊博 edited comment on SPARK-34248 at 11/29/21, 9:16 AM: {{w

[jira] [Commented] (SPARK-33354) New explicit cast syntax rules in ANSI mode

2021-11-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-33354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450301#comment-17450301 ] 王俊博 commented on SPARK-33354: - cast StringType=>NumericType, Is there some issue?

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2021-12-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458866#comment-17458866 ] Mr.黄 commented on SPARK-4105: - [~joshrosen] Hello, I still encountered this problem in

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2021-12-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458866#comment-17458866 ] Mr.黄 edited comment on SPARK-4105 at 12/14/21, 2:3

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2021-12-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458866#comment-17458866 ] Mr.黄 edited comment on SPARK-4105 at 12/14/21, 2:3

[jira] [Created] (SPARK-38649) Fix SECURITY.md

2022-03-24 Thread Jira
Bjørn Jørgensen created SPARK-38649: --- Summary: Fix SECURITY.md Key: SPARK-38649 URL: https://issues.apache.org/jira/browse/SPARK-38649 Project: Spark Issue Type: Bug Components

[jira] [Created] (SPARK-38675) Race condition in BlockInfoManager during unlock

2022-03-28 Thread Jira
Herman van Hövell created SPARK-38675: - Summary: Race condition in BlockInfoManager during unlock Key: SPARK-38675 URL: https://issues.apache.org/jira/browse/SPARK-38675 Project: Spark

[jira] [Created] (SPARK-38715) Would be nice to be able to configure a client ID pattern in Kafka integration

2022-03-31 Thread Jira
Cédric Chantepie created SPARK-38715: Summary: Would be nice to be able to configure a client ID pattern in Kafka integration Key: SPARK-38715 URL: https://issues.apache.org/jira/browse/SPARK-38715

[jira] [Created] (SPARK-38763) Pandas API on spark Can`t apply lamda to columns.

2022-04-01 Thread Jira
Bjørn Jørgensen created SPARK-38763: --- Summary: Pandas API on spark Can`t apply lamda to columns. Key: SPARK-38763 URL: https://issues.apache.org/jira/browse/SPARK-38763 Project: Spark

[jira] [Commented] (SPARK-38763) Pandas API on spark Can`t apply lamda to columns.

2022-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515991#comment-17515991 ] Bjørn Jørgensen commented on SPARK-38763: - [~XinrongM] > Pandas API o

[jira] (SPARK-38763) Pandas API on spark Can`t apply lamda to columns.

2022-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38763 ] Bjørn Jørgensen deleted comment on SPARK-38763: - was (Author: bjornjorgensen): [~XinrongM] > Pandas API on spark Can`t apply lamda to colu

[jira] [Commented] (SPARK-37903) Replace string_typehints with get_type_hints.

2022-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516012#comment-17516012 ] Bjørn Jørgensen commented on SPARK-37903: - I do have some problems now wh

[jira] [Commented] (SPARK-38763) Pandas API on spark Can`t apply lamda to columns.

2022-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516087#comment-17516087 ] Bjørn Jørgensen commented on SPARK-38763: - This error is https://github

[jira] [Commented] (SPARK-38763) Pandas API on spark Can`t apply lamda to columns.

2022-04-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516259#comment-17516259 ] Bjørn Jørgensen commented on SPARK-38763: - [~XinrongM] I did replace fram

[jira] [Commented] (SPARK-38514) Download link on spark 3.2.1 for hadoop 3.2 is wrong

2022-04-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517296#comment-17517296 ] Bengt Sjögren commented on SPARK-38514: --- Hi, The tarball name reference s

[jira] [Commented] (SPARK-38514) Download link on spark 3.2.1 for hadoop 3.2 is wrong

2022-04-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517307#comment-17517307 ] Bengt Sjögren commented on SPARK-38514: --- Okay cool! Thanks for informing me

[jira] [Created] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-06 Thread Jira
Bjørn Jørgensen created SPARK-38810: --- Summary: Upgrade Python black in /dev/reformat-python Key: SPARK-38810 URL: https://issues.apache.org/jira/browse/SPARK-38810 Project: Spark Issue

[jira] [Created] (SPARK-38915) Log executed SQL queries

2022-04-15 Thread Jira
Gérald Quintana created SPARK-38915: --- Summary: Log executed SQL queries Key: SPARK-38915 URL: https://issues.apache.org/jira/browse/SPARK-38915 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523425#comment-17523425 ] Bjørn Jørgensen commented on SPARK-38810: - [~srowen] Yes, I think so. Blac

[jira] [Comment Edited] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523425#comment-17523425 ] Bjørn Jørgensen edited comment on SPARK-38810 at 4/17/22 6:2

[jira] [Updated] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38810: Issue Type: Improvement (was: Bug) > Upgrade Python black in /dev/reformat-pyt

[jira] [Commented] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523427#comment-17523427 ] Bjørn Jørgensen commented on SPARK-38810: - You are right Sean it not a S

[jira] [Comment Edited] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523427#comment-17523427 ] Bjørn Jørgensen edited comment on SPARK-38810 at 4/17/22 6:2

[jira] [Comment Edited] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523427#comment-17523427 ] Bjørn Jørgensen edited comment on SPARK-38810 at 4/17/22 6:3

[jira] [Commented] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523847#comment-17523847 ] Bjørn Jørgensen commented on SPARK-38810: - [Black 22.3.0|h

[jira] [Resolved] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen resolved SPARK-38810. - Resolution: Workaround pip uninstall black and click then pip install black==21.12b0

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-04-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525046#comment-17525046 ] André F. commented on SPARK-38330: -- Strangely, even using the `openssl` option I s

[jira] [Updated] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37174: Attachment: info.txt > WARN WindowExec: No Partition Defined is being printed 4 ti

[jira] [Commented] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525911#comment-17525911 ] Bjørn Jørgensen commented on SPARK-37174: - I add a file now with the info m

[jira] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174 ] Bjørn Jørgensen deleted comment on SPARK-37174: - was (Author: bjornjorgensen): I add a file now with the info msg I get when I run df.info() Spark master build from last week. I will

[jira] [Created] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed to many times.

2022-04-21 Thread Jira
Bjørn Jørgensen created SPARK-38988: --- Summary: Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed to many times. Key: SPARK-38988 URL: https://issues.apache.org/jira/br

[jira] [Updated] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed to many times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38988: Attachment: info.txt > Pandas API - "PerformanceWarning: DataFrame is highly fr

[jira] [Updated] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed to many times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38988: Attachment: Untitled.html > Pandas API - "PerformanceWarning: DataFrame i

[jira] [Updated] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed to many times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38988: Description: I add a file now with the info msg I get when I run df.info() Spark master

[jira] [Updated] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed to many times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38988: Description: I add a file and a notebook with the info msg I get when I run df.info

[jira] [Updated] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed many times.

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38988: Summary: Pandas API - "PerformanceWarning: DataFrame is highly fragmented." g

[jira] [Updated] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed many times.

2022-04-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38988: Attachment: warning printed.txt > Pandas API - "PerformanceWarning: DataFrame i

[jira] [Commented] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed many times.

2022-04-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17527432#comment-17527432 ] Bjørn Jørgensen commented on SPARK-38988: - I add a new fil "warning pr

[jira] [Updated] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times.

2022-04-25 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-37174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37174: Attachment: (was: info.txt) > WARN WindowExec: No Partition Defined is being prin

[jira] [Created] (SPARK-39030) Remame sum

2022-04-26 Thread Jira
Bjørn Jørgensen created SPARK-39030: --- Summary: Remame sum Key: SPARK-39030 URL: https://issues.apache.org/jira/browse/SPARK-39030 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-39049) Remove unneeded pass

2022-04-27 Thread Jira
Bjørn Jørgensen created SPARK-39049: --- Summary: Remove unneeded pass Key: SPARK-39049 URL: https://issues.apache.org/jira/browse/SPARK-39049 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38659) PySpark ResourceWarning: unclosed socket

2022-05-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530554#comment-17530554 ] Gergely Kalmár commented on SPARK-38659: Yes, our test suite is failing bec

[jira] [Commented] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-05-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531723#comment-17531723 ] Bjørn Jørgensen commented on SPARK-38262: - [~pralabhkumar] have a look at

[jira] [Created] (SPARK-39113) rename self to cls in python/pyspark/mllib/clustering.py

2022-05-06 Thread Jira
Bjørn Jørgensen created SPARK-39113: --- Summary: rename self to cls in python/pyspark/mllib/clustering.py Key: SPARK-39113 URL: https://issues.apache.org/jira/browse/SPARK-39113 Project: Spark

[jira] [Updated] (SPARK-39111) Mark overriden methods with `@override` annotation

2022-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39111: Attachment: override.png > Mark overriden methods with `@override` annotat

[jira] [Commented] (SPARK-39111) Mark overriden methods with `@override` annotation

2022-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532697#comment-17532697 ] Bjørn Jørgensen commented on SPARK-39111: - What tool is it that you are u

[jira] [Created] (SPARK-39125) Upgrade netty to version 4.1.77.Final or higher.

2022-05-08 Thread Jira
Bjørn Jørgensen created SPARK-39125: --- Summary: Upgrade netty to version 4.1.77.Final or higher. Key: SPARK-39125 URL: https://issues.apache.org/jira/browse/SPARK-39125 Project: Spark Issue

[jira] [Commented] (SPARK-39125) Upgrade netty to version 4.1.77.Final or higher.

2022-05-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533509#comment-17533509 ] Bjørn Jørgensen commented on SPARK-39125: - [~LuciferYang] I have a [PR to

[jira] [Updated] (SPARK-39125) Upgrade netty to version 4.1.77.Final or higher.

2022-05-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39125: Priority: Trivial (was: Major) > Upgrade netty to version 4.1.77.Final or hig

[jira] [Updated] (SPARK-39125) Upgrade netty to version 4.1.77.Final or higher.

2022-05-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39125: Issue Type: Dependency upgrade (was: Bug) > Upgrade netty to version 4.1.77.Final

[jira] [Commented] (SPARK-39125) Upgrade netty to version 4.1.77.Final or higher.

2022-05-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533522#comment-17533522 ] Bjørn Jørgensen commented on SPARK-39125: - Form snyk "Note: To be v

[jira] [Updated] (SPARK-39125) Upgrade netty and netty-tcnative

2022-05-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39125: Summary: Upgrade netty and netty-tcnative (was: Upgrade netty to version 4.1.77.Final or

[jira] [Created] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

2022-05-13 Thread Jira
Bjørn Jørgensen created SPARK-39183: --- Summary: Upgrade Apache Xerces Java to 2.12.2 Key: SPARK-39183 URL: https://issues.apache.org/jira/browse/SPARK-39183 Project: Spark Issue Type

[jira] [Commented] (SPARK-32070) Spark 3.0 ERROR TThreadPoolServer

2022-05-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17537407#comment-17537407 ] 袁枫 commented on SPARK-32070: +1 > Spark 3.0 ERROR TThreadPoo

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

2022-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539527#comment-17539527 ] Victor Delépine commented on SPARK-19609: - Hey [~hyukjin.kwon], I can con

[jira] [Updated] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Attachment: csvfile.csv > ps.read_csv ignore commas in double quo

[jira] [Updated] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Attachment: Untitled (4).ipynb > ps.read_csv ignore commas in double quo

[jira] [Created] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
Bjørn Jørgensen created SPARK-39304: --- Summary: ps.read_csv ignore commas in double quotes. Key: SPARK-39304 URL: https://issues.apache.org/jira/browse/SPARK-39304 Project: Spark Issue Type

[jira] [Updated] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Description: This one is coming from u...@spark.org mail list tittle "Complexity wit

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

2022-05-27 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542881#comment-17542881 ] Victor Delépine commented on SPARK-19609: - [~yumwang] happy to help, but c

[jira] [Updated] (SPARK-39304) ps.read_csv ignore commas in double quotes.

2022-05-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Description: This one is coming from u...@spark.org mail list tittle "Complexity wit

[jira] [Updated] (SPARK-39304) ps.read_csv ignore double quotes.

2022-05-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39304: Summary: ps.read_csv ignore double quotes. (was: ps.read_csv ignore commas in double

[jira] [Commented] (SPARK-32570) Thriftserver LDAP failed

2022-05-31 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544203#comment-17544203 ] 郝卫亮 commented on SPARK-32570: - This is a bug,When the LDAP to be accessed DN is (cn=

[jira] [Created] (SPARK-39366) BlockInfoManager should not release write locks on task end

2022-06-02 Thread Jira
Herman van Hövell created SPARK-39366: - Summary: BlockInfoManager should not release write locks on task end Key: SPARK-39366 URL: https://issues.apache.org/jira/browse/SPARK-39366 Project: Spark

[jira] [Created] (SPARK-39391) Reuse Partitioner Classes

2022-06-06 Thread Jira
Herman van Hövell created SPARK-39391: - Summary: Reuse Partitioner Classes Key: SPARK-39391 URL: https://issues.apache.org/jira/browse/SPARK-39391 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-39391) Reuse Partitioner Classes

2022-06-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-39391. --- Fix Version/s: 3.4.0 Resolution: Fixed > Reuse Partitioner Clas

[jira] [Created] (SPARK-39540) Upgrade mysql-connector-java to 8.0.28

2022-06-21 Thread Jira
Bjørn Jørgensen created SPARK-39540: --- Summary: Upgrade mysql-connector-java to 8.0.28 Key: SPARK-39540 URL: https://issues.apache.org/jira/browse/SPARK-39540 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34502) Remove unused parameters in join methods

2021-04-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316056#comment-17316056 ] Kadir Selçuk commented on SPARK-34502: -- Apache k with Jira problems >

[jira] [Resolved] (SPARK-34969) Followup for Refactor TreeNode's children handling methods into specialized traits (SPARK-34906)

2021-04-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-34969. --- Fix Version/s: 3.2.0 Assignee: Ali Afroozeh Resolution: Fixed

[jira] [Resolved] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-34989. --- Fix Version/s: 3.2.0 Assignee: Ali Afroozeh Resolution: Fixed

[jira] [Commented] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17319700#comment-17319700 ] Herman van Hövell commented on SPARK-34989: --- We are seeing some pr

[jira] [Assigned] (SPARK-35103) Improve type coercion rule performance

2021-04-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-35103: - Assignee: Herman van Hövell > Improve type coercion rule performa

[jira] [Assigned] (SPARK-35103) Improve type coercion rule performance

2021-04-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-35103: - Assignee: Yingyi Bu (was: Herman van Hövell) > Improve type coercion r

[jira] [Resolved] (SPARK-35103) Improve type coercion rule performance

2021-04-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-35103. --- Fix Version/s: 3.2.0 Resolution: Fixed > Improve type coercion r

<    1   2   3   4   5   6   7   8   9   10   >