[jira] [Comment Edited] (SPARK-5484) Pregel should checkpoint periodically to avoid StackOverflowError

2016-07-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380653#comment-15380653 ] Michał Wesołowski edited comment on SPARK-5484 at 7/16/16 9:3

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381747#comment-15381747 ] Maciej Bryński commented on SPARK-16321: I did some more investigation

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381755#comment-15381755 ] Maciej Bryński commented on SPARK-16321: Yep. I'll try. >

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381914#comment-15381914 ] Maciej Bryński commented on SPARK-16321: 3 workers. 15 cores and 30G RAM

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381973#comment-15381973 ] Maciej Bryński commented on SPARK-16321: spark.executor.extraJavaOpt

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński commented on SPARK-16321: OK. I did tests with VisualVM

[jira] [Updated] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Attachment: visualvm_spark16.png visualvm_spark2.png VisuaVM profiles

[jira] [Issue Comment Deleted] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Comment: was deleted (was: VisuaVM profiles) > Pyspark 2.0 performance drop vs pyspark

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 11:4

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 11:4

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 11:4

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382139#comment-15382139 ] Maciej Bryński commented on SPARK-16321: [~srowen] Could you tell me is t

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 12:2

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 12:2

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 12:2

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382296#comment-15382296 ] Maciej Bryński commented on SPARK-16321: And I added VisualVM profile for S

[jira] [Updated] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Attachment: visualvm_spark2_G1GC.png > Pyspark 2.0 performance drop vs pyspark

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382113#comment-15382113 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 2:1

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński commented on SPARK-16321: OK. I think that I found difference

[jira] [Updated] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Attachment: spark16._trace.png spark2_trace.png > Pyspark 2.0 performa

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 3:1

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 3:1

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 3:1

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 3:1

[jira] [Updated] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Attachment: Spark16.nps Spark2.nps > Pyspark 2.0 performance drop vs pysp

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 3:4

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 3:4

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382429#comment-15382429 ] Maciej Bryński edited comment on SPARK-16321 at 7/18/16 3:5

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383747#comment-15383747 ] Maciej Bryński commented on SPARK-16321: I tried. It's much slower. 4

[jira] [Updated] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Attachment: spark2_nofilterpushdown.nps > Pyspark 2.0 performance drop vs pyspark

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383747#comment-15383747 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:0

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383747#comment-15383747 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:0

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:2

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński commented on SPARK-16321: Bingo. I think I found the answer

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:2

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:2

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:3

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:4

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 8:4

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 9:0

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 9:3

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383866#comment-15383866 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 9:4

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383866#comment-15383866 ] Maciej Bryński commented on SPARK-16321: I did the query with "gr

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383866#comment-15383866 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 9:4

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383866#comment-15383866 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 9:4

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383889#comment-15383889 ] Maciej Bryński commented on SPARK-16321: Thanks. It works for PushedFi

[jira] [Commented] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383904#comment-15383904 ] Maciej Bryński commented on SPARK-16321: Added profiles just for query execu

[jira] [Updated] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Attachment: spark16_query.nps spark2_query.nps > Pyspark 2.0 performa

[jira] [Created] (SPARK-16624) cd /home/product/bi_etl/dump_data/dp_edw/

2016-07-19 Thread JIRA
吴志龙 created SPARK-16624: --- Summary: cd /home/product/bi_etl/dump_data/dp_edw/ Key: SPARK-16624 URL: https://issues.apache.org/jira/browse/SPARK-16624 Project: Spark Issue Type: Bug Components

[jira] [Updated] (SPARK-16624) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 吴志龙 updated SPARK-16624: Summary: Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames (was: cd /home

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383889#comment-15383889 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 12:2

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383889#comment-15383889 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 12:2

[jira] [Comment Edited] (SPARK-16321) Pyspark 2.0 performance drop vs pyspark 1.6

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383889#comment-15383889 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 1:1

[jira] [Commented] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384465#comment-15384465 ] Maciej Bryński commented on SPARK-16320: OK. I think we have general pro

[jira] [Updated] (SPARK-16321) Spark 2.0 performance drop vs Spark 1.6 when reading parquet file

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Summary: Spark 2.0 performance drop vs Spark 1.6 when reading parquet file (was: Pyspark

[jira] [Updated] (SPARK-16321) Spark 2.0 performance drop vs Spark 1.6 when reading parquet file

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Description: *UPDATE* Please start with this comment https://issues.apache.org/jira/browse

[jira] [Updated] (SPARK-16321) Spark 2.0 performance drop vs Spark 1.6 when reading parquet file

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Description: *UPDATE* Please start with this comment https://issues.apache.org/jira/browse

[jira] [Updated] (SPARK-16321) Spark 2.0 performance drop vs Spark 1.6 when reading parquet file

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16321: --- Priority: Critical (was: Major) > Spark 2.0 performance drop vs Spark 1.6 when read

[jira] [Comment Edited] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384465#comment-15384465 ] Maciej Bryński edited comment on SPARK-16320 at 7/19/16 4:3

[jira] [Comment Edited] (SPARK-16321) Spark 2.0 performance drop vs Spark 1.6 when reading parquet file

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383747#comment-15383747 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 4:3

[jira] [Comment Edited] (SPARK-16321) Spark 2.0 performance drop vs Spark 1.6 when reading parquet file

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383785#comment-15383785 ] Maciej Bryński edited comment on SPARK-16321 at 7/19/16 4:3

[jira] [Commented] (SPARK-13594) remove typed operations (map, flatMap, mapPartitions) from Python DataFrame

2016-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384475#comment-15384475 ] Maciej Bryński commented on SPARK-13594: As we're not planning to

[jira] [Commented] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

2016-07-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386552#comment-15386552 ] Maciej Bryński commented on SPARK-16320: [~michael] Could you check SPARK-1

[jira] [Updated] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

2016-07-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16320: --- Description: I did some test on parquet file with many nested columns (about 30G in 400

[jira] [Updated] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

2016-07-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16320: --- Description: I did some test on parquet file with many nested columns (about 30G in 400

[jira] [Updated] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

2016-07-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16320: --- Description: I did some test on parquet file with many nested columns (about 30G in 400

[jira] [Created] (SPARK-16667) Spark driver executor dont release unused memory

2016-07-21 Thread JIRA
Luis Angel Hernández Acosta created SPARK-16667: --- Summary: Spark driver executor dont release unused memory Key: SPARK-16667 URL: https://issues.apache.org/jira/browse/SPARK-16667

[jira] [Updated] (SPARK-16667) Spark driver executor dont release unused memory

2016-07-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Angel Hernández Acosta updated SPARK-16667: Component/s: GraphX > Spark driver executor dont release unu

[jira] [Updated] (SPARK-16667) Spark driver executor dont release unused memory

2016-07-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Angel Hernández Acosta updated SPARK-16667: Description: I'm running spark app in standalone cluster. M

[jira] [Updated] (SPARK-16667) Spark driver executor dont release unused memory

2016-07-21 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Angel Hernández Acosta updated SPARK-16667: Description: I'm running spark app in standalone cluster. M

[jira] [Created] (SPARK-16683) Group by does not work after multiple joins of the same dataframe

2016-07-22 Thread JIRA
Witold Jędrzejewski created SPARK-16683: --- Summary: Group by does not work after multiple joins of the same dataframe Key: SPARK-16683 URL: https://issues.apache.org/jira/browse/SPARK-16683

[jira] [Updated] (SPARK-16683) Group by does not work after multiple joins of the same dataframe

2016-07-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Witold Jędrzejewski updated SPARK-16683: Attachment: Duplicates Problem Presentation.json > Group by does not work af

[jira] [Commented] (SPARK-16416) Logging in shutdown hook does not work properly with Log4j 2.x

2016-07-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15389802#comment-15389802 ] Mikael Ståldal commented on SPARK-16416: https://github.com/apache/spark/

[jira] [Closed] (SPARK-16416) Logging in shutdown hook does not work properly with Log4j 2.x

2016-07-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikael Ståldal closed SPARK-16416. -- Latest master works fine. > Logging in shutdown hook does not work properly with Log4j

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-07-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15393562#comment-15393562 ] Mikael Ståldal commented on SPARK-6305: --- Hi, I am member of Apache Logging pro

[jira] [Commented] (SPARK-15541) SparkContext.stop throws error

2016-07-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395815#comment-15395815 ] Maciej Bryński commented on SPARK-15541: [~srowen] I have patch that res

[jira] [Commented] (SPARK-15541) SparkContext.stop throws error

2016-07-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397179#comment-15397179 ] Maciej Bryński commented on SPARK-15541: Casting ConcurrentHashMa

[jira] [Comment Edited] (SPARK-15541) SparkContext.stop throws error

2016-07-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397179#comment-15397179 ] Maciej Bryński edited comment on SPARK-15541 at 7/28/16 7:5

[jira] [Reopened] (SPARK-15541) SparkContext.stop throws error

2016-07-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński reopened SPARK-15541: > SparkContext.stop throws error > -- > >

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-07-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399449#comment-15399449 ] Mikael Ståldal commented on SPARK-6305: --- What kind of help do you need? &

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786619#comment-16786619 ] Piotr Kołaczkowski commented on SPARK-27018: The file does not exis

[jira] [Created] (SPARK-27385) use mapPartitionsWIthIndex in Dataframe

2019-04-03 Thread JIRA
范晓亮 created SPARK-27385: --- Summary: use mapPartitionsWIthIndex in Dataframe Key: SPARK-27385 URL: https://issues.apache.org/jira/browse/SPARK-27385 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-27385) use mapPartitionsWIthIndex in Dataframe

2019-04-03 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 范晓亮 updated SPARK-27385: Component/s: (was: Spark Core) SQL > use mapPartitionsWIthIndex in Datafr

[jira] [Created] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-04-11 Thread JIRA
Jan Vršovský created SPARK-27442: Summary: ParquetFileFormat fails to read column named with invalid characters Key: SPARK-27442 URL: https://issues.apache.org/jira/browse/SPARK-27442 Project: Spark

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-04-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821901#comment-16821901 ] Jan Vršovský commented on SPARK-27442: -- [~hyukjin.kwon] Sorry, I forgot about

[jira] [Updated] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-04-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Vršovský updated SPARK-27442: - Priority: Minor (was: Major) > ParquetFileFormat fails to read column named with inva

[jira] [Commented] (SPARK-21827) Task fail due to executor exception when enable Sasl Encryption

2019-04-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829089#comment-16829089 ] Sébastien BARNOUD commented on SPARK-21827: --- Hi,   I was investiga

[jira] [Comment Edited] (SPARK-21827) Task fail due to executor exception when enable Sasl Encryption

2019-04-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829089#comment-16829089 ] Sébastien BARNOUD edited comment on SPARK-21827 at 4/29/19 10:0

[jira] [Comment Edited] (SPARK-21827) Task fail due to executor exception when enable Sasl Encryption

2019-04-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829089#comment-16829089 ] Sébastien BARNOUD edited comment on SPARK-21827 at 4/29/19 10:0

[jira] [Comment Edited] (SPARK-21827) Task fail due to executor exception when enable Sasl Encryption

2019-04-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829089#comment-16829089 ] Sébastien BARNOUD edited comment on SPARK-21827 at 4/29/19 12:1

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2019-05-10 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837260#comment-16837260 ] Guillaume Massé commented on SPARK-25075: - Supporting both Scala 2.12 and S

[jira] [Updated] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

2016-10-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-18022: --- Description: Hi, I have found following issue. When there is an exception while saving

[jira] [Updated] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

2016-10-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-18022: --- Description: Hi, I have found following issue. When there is an exception while saving

[jira] [Commented] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

2016-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593846#comment-15593846 ] Maciej Bryński commented on SPARK-18022: Only improvement in error hand

[jira] [Comment Edited] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

2016-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593846#comment-15593846 ] Maciej Bryński edited comment on SPARK-18022 at 10/21/16 3:3

[jira] [Comment Edited] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

2016-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593846#comment-15593846 ] Maciej Bryński edited comment on SPARK-18022 at 10/21/16 3:5

[jira] [Commented] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

2016-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593935#comment-15593935 ] Maciej Bryński commented on SPARK-18022: I think the problem is in thi

[jira] [Comment Edited] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

2016-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593935#comment-15593935 ] Maciej Bryński edited comment on SPARK-18022 at 10/21/16 4:2

[jira] [Commented] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599856#comment-15599856 ] Cédric Hernalsteens commented on SPARK-15487: - I'm glad to see th

[jira] [Comment Edited] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

2016-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599856#comment-15599856 ] Cédric Hernalsteens edited comment on SPARK-15487 at 10/23/16 3:4

<    1   2   3   4   5   6   7   8   9   10   >