Re: Serialization Problem in Spark Program

2015-03-27 Thread Akhil Das
quot;;; > *Send time:* Thursday, Mar 26, 2015 3:23 PM > *To:* "donhoff_h"<165612...@qq.com>; > *Cc:* "user"; > *Subject: * Re: Serialization Problem in Spark Program > > Try registering your MyObject[] with Kryo. > On 25 Mar 2015 13:17, "donhoff

Re: Serialization Problem in Spark Program

2015-03-25 Thread Akhil Das
Try registering your MyObject[] with Kryo. On 25 Mar 2015 13:17, "donhoff_h" <165612...@qq.com> wrote: > Hi, experts > > I wrote a very simple spark program to test the KryoSerialization > function. The codes are as following: > > object TestKryoSerialization { > def main(args: Array[String]) {

Re: Serialization Problem in Spark Program

2015-03-25 Thread Imran Rashid
you also need to register *array*s of MyObject. so change: conf.registerKryoClasses(Array(classOf[MyObject])) to conf.registerKryoClasses(Array(classOf[MyObject], classOf[Array[MyObject]])) On Wed, Mar 25, 2015 at 2:44 AM, donhoff_h <165612...@qq.com> wrote: > Hi, experts > > I wrote a very