Is it possible to port WrappedArraySerializer.scala to your app ?
Pardon me for not knowing how to integrate Chill with Spark.
Cheers
On Mon, Feb 16, 2015 at 12:31 AM, Tao Xiao wrote:
> Thanks Ted
>
> After searching for a whole day, I still don't know how to let spark use
> twitter chill seri
Thanks Ted
After searching for a whole day, I still don't know how to let spark use
twitter chill serialization - there are very few documents about how to
integrate twitter chill into Spark for serialization. I tried the
following, but an exception of "java.lang.ClassCastException:
com.twitter.ch
I was looking at https://github.com/twitter/chill
It seems this would achieve what you want:
chill-scala/src/main/scala/com/twitter/chill/WrappedArraySerializer.scala
Cheers
On Sat, Feb 14, 2015 at 6:36 PM, Tao Xiao wrote:
> I'm using Spark 1.1.0 and find that *ImmutableBytesWritable* can be
>
I'm using Spark 1.1.0 and find that *ImmutableBytesWritable* can be
serialized by Kryo but *Array[ImmutableBytesWritable] *can't be serialized
even when I registered both of them in Kryo.
The code is as follows:
val conf = new SparkConf()
.setAppName("Hello Spark")
