I've filed https://issues.apache.org/jira/browse/SPARK-8498 to fix this
error-handling code.
On Fri, Jun 19, 2015 at 11:51 AM, Josh Rosen wrote:
> Hey Peter,
>
> I think that this is actually due to an error-handling issue: if you look
> at the stack trace that you posted, the NPE is being throw
Hey Peter,
I think that this is actually due to an error-handling issue: if you look
at the stack trace that you posted, the NPE is being thrown from an
error-handling branch of a `finally` block:
@Override public void write(scala.collection.Iterator>
records) throws IOException { boolean success
Hi want to try new tungsten-sort shuffle manager, but on 1 stage
executors start to die with NPE:
15/06/19 17:53:35 WARN TaskSetManager: Lost task 38.0 in stage 41.0 (TID
3176, ip-10-50-225-214.ec2.internal): java.lang.NullPointerException
at
org.apache.spark.shuffle.unsafe.UnsafeShuff
