Classes are serialized and sent to all the workers as akka msgs.... singletons and case classes I am not sure if they are javaserialized or kryoserialized by default....
But definitely your own classes if serialized by kryo will be much efficient.....there is an comparison that Matei did for all the serialization options and kryo was fastest at that time.... Hi, I am sorry if this has been asked before. I found that if I wrapped up some methods in a class with parameters, spark will throw "Task Nonserializable" exception; however if wrapped up in an object or case class without parameters, it will work fine. Is it true that all classes involving RDD operation should be registered so that SparkContext could recognize them? Thanks a lot! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Do-all-classes-involving-RDD-operation-need-to-be-registered-tp3439.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
