Re: Big-Endian (IBM Power7) Spark Serialization issue

2014-06-13 Thread Yanjie Gao
Hi All Yesterday,we rewrite the class Serializable's UID as static .Then find that the Executor could resolve the class .But it also thow the Exception imcompitable UID.We also debug the program in remote mode found jvm use bigendian in master and slave. Once we try ./run-example HDFSWordCount on

Big-Endian (IBM Power7) Spark Serialization issue

2014-06-12 Thread Yanjie Gao
ame version UID:Compile scala lib and akka lib in P7 platform 4.2 Let the two loader load the same Jar. Use some method like extend class loader or OSGI .We force the jvm to load the same class file.(The difficult thing is that classes is in jar and class num is too large .) But I want to know