I took a look at the pull request for memory management and I actually
agree with the existing assessment that the patch is too big and risky to
port into an existing maintenance branch. Things that are backported are
low-risk patches that won't break existing applications on 1.6.x. This
patch is l
Also, can you include MaxPermSize fix to spark-1.6.3?
https://issues.apache.org/jira/browse/SPARK-15067
Literally, just 1 word should be replaced
https://github.com/apache/spark/pull/12985/files
On Fri, Oct 14, 2016 at 1:57 PM, Alexander Pivovarov
wrote:
> Hi Reynold
>
> Spark 1.6.x has seriou
Hi Reynold
Spark 1.6.x has serious bug related to shuffle functionality
https://issues.apache.org/jira/browse/SPARK-14560
https://issues.apache.org/jira/browse/SPARK-4452
Shuffle throws OOM on serious load. I've seen this error several times on
my heavy jobs
java.lang.OutOfMemoryError: Unable to
It's been a while and we have fixed a few bugs in branch-1.6. I plan to cut
rc1 for 1.6.3 next week (just in time for Spark Summit Europe). Let me know
if there are specific issues that should be addressed before that. Thanks.
