Hi,
I think there is an issue in `ExternalAppendOnlyMap.forceSpill` which is
called to release memory when there is another memory consumer tried to ask
more memory than current available.
I created a Jira and submit a PR for it. Please check out
https://issues.apache.org/jira/browse/SPARK-18986
section.
Please find the stacktrace below:-
java.lang.AssertionError: assertion failed at
scala.Predef$.assert(Predef.scala:156) at
org.apache.spark.util.collection.ExternalAppendOnlyMap.forceSpill(ExternalAppendOnlyMap.scala:195)
at org.apache.spark.util.collection.Spillable.spill
