[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2017-07-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099686#comment-16099686 ] Paul Magnus Sørensen-Clark commented on SPARK-12261: I have a similar

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2017-03-16 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928179#comment-15928179 ] Shea Parkes commented on SPARK-12261: - I simply added the following to the end: for

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2017-03-16 Thread Tomas Pranckevicius (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927746#comment-15927746 ] Tomas Pranckevicius commented on SPARK-12261: - I am looking as well to the so

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-11-02 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629182#comment-15629182 ] Shea Parkes commented on SPARK-12261: - I'm still maintaining the two-line bandaid to

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-11-02 Thread Oleh Koval (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629165#comment-15629165 ] Oleh Koval commented on SPARK-12261: Hey guys, Having the same issue with Spark 1.6.1

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-08-15 Thread Guangyang Nie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15420702#comment-15420702 ] Guangyang Nie commented on SPARK-12261: --- This way exactly solve my problem. Thank y

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-07-26 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394508#comment-15394508 ] Shea Parkes commented on SPARK-12261: - I still can't get this bug to reproduce reliab

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-07-25 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391731#comment-15391731 ] Shea Parkes commented on SPARK-12261: - Also, I added extensive logging to {{worker.py

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-07-25 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391728#comment-15391728 ] Shea Parkes commented on SPARK-12261: - Alright, I've been spending time off and on fo

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-07-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381167#comment-15381167 ] Sean Owen commented on SPARK-12261: --- We need logs showing the actual error. If this is

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-07-16 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380846#comment-15380846 ] Shea Parkes commented on SPARK-12261: - I believe I'm hitting the same bug. I'm also

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Niall McCarroll (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145077#comment-15145077 ] Niall McCarroll commented on SPARK-12261: - In various windows environments I've t

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144901#comment-15144901 ] Christopher Bourez commented on SPARK-12261: Sean, how can I get the executor

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144880#comment-15144880 ] Sean Owen commented on SPARK-12261: --- This is still just the driver log. > pyspark cras

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144873#comment-15144873 ] Christopher Bourez commented on SPARK-12261: Here is what i see when i activa

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144857#comment-15144857 ] Sean Owen commented on SPARK-12261: --- The change above is definitely not correct in gene

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144844#comment-15144844 ] Christopher Bourez commented on SPARK-12261: Sean Owen, do you reconsider the

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144793#comment-15144793 ] Christopher Bourez commented on SPARK-12261: Dear Niall Your solution works v

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-12 Thread Niall McCarroll (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144734#comment-15144734 ] Niall McCarroll commented on SPARK-12261: - As a workaround you might try the foll

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136515#comment-15136515 ] Josh Rosen commented on SPARK-12261: [~srowen], I reopened this after it was updated

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-07 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136229#comment-15136229 ] Christopher Bourez commented on SPARK-12261: I'm still here if you need any m

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-01-28 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121182#comment-15121182 ] Christopher Bourez commented on SPARK-12261: There is a strange "remove broad

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-01-28 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121114#comment-15121114 ] Christopher Bourez commented on SPARK-12261: I recompiled Spark on Windows bu

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-01-26 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15117345#comment-15117345 ] Christopher Bourez commented on SPARK-12261: The solution "Increase driver me

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-01-26 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116907#comment-15116907 ] Christopher Bourez commented on SPARK-12261: To reproduce you can follow the

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-01-25 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115433#comment-15115433 ] Christopher Bourez commented on SPARK-12261: I think the issue is not resolve