Re: Strange problem with saveAsTextFile after upgrade Spark 0.9.0->1.0.0

[Denes]

I have the same problem (Spark 0.9.1-> 1.0.0 and throws error) and I do call
saveAsTextFile. Recompiled for 1.0.0. 

org.apache.spark.SparkException: Job aborted due to stage failure: Task
0.0:10 failed 4 times, most recent failure: Exception failure in TID 1616 on
host r3s1n03.bigdata.emea.nsn-net.net: java.lang.ClassNotFoundException:
org.apache.spark.rdd.RDD$$anonfun$saveAsTextFile$1
        java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        java.security.AccessController.doPrivileged(Native Method)
        java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        java.lang.ClassLoader.loadClass(ClassLoader.java:423)
        java.lang.ClassLoader.loadClass(ClassLoader.java:356)
        java.lang.Class.forName0(Native Method)
        java.lang.Class.forName(Class.java:264)
       
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:60)
       
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1593)
        java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514)
       
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750)
        java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347)
       
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964)
       
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888)
       
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771)
        java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347)
        java.io.ObjectInputStream.readObject(ObjectInputStream.java:369)
       
org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:63)
       
org.apache.spark.scheduler.ResultTask$.deserializeInfo(ResultTask.scala:61)
       
org.apache.spark.scheduler.ResultTask.readExternal(ResultTask.scala:141)
       
java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:1810)
       
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1769)
        java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347)
        java.io.ObjectInputStream.readObject(ObjectInputStream.java:369)
       
org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:63)
       
org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:85)
       
org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:169)
       
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
       
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        java.lang.Thread.run(Thread.java:722)




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Strange-problem-with-saveAsTextFile-after-upgrade-Spark-0-9-0-1-0-0-tp6832p7121.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.