Re: Custom KryoSerializer

2014-04-23 Thread Eugen Cepoi
I had a similar need the solution I used is: - Define a base implementation of KryoRegistrator (that will register all common classes/custom ser/deser) - make registerClasses method final, so subclasses don't override it - Define another method that would be overriden by subclasses that need to

Custom KryoSerializer

2014-04-22 Thread Soren Macbeth
Does spark support extending and registering a KryoSerializer class in an application jar? An example of why you might want to do this would be to always register some set of common classes within an organization while still allowing the particular application jar to use a kryo registrator to regi

custom kryoserializer class under mesos

2014-04-21 Thread Soren Macbeth
Hello, Is it possible to use a custom class as my spark's KryoSerializer running under Mesos? I've tried adding my jar containing the class to my spark context (via SparkConf.addJars), but I always get: java.lang.ClassNotFoundException: flambo.kryo.FlamboKryoSerializer at java.net.URLCla