I had a similar need the solution I used is:
- Define a base implementation of KryoRegistrator (that will register all
common classes/custom ser/deser)
- make registerClasses method final, so subclasses don't override it
- Define another method that would be overriden by subclasses that need to
Does spark support extending and registering a KryoSerializer class in an
application jar?
An example of why you might want to do this would be to always register
some set of common classes within an organization while still allowing the
particular application jar to use a kryo registrator to regi
Hello,
Is it possible to use a custom class as my spark's KryoSerializer running
under Mesos?
I've tried adding my jar containing the class to my spark context (via
SparkConf.addJars), but I always get:
java.lang.ClassNotFoundException: flambo.kryo.FlamboKryoSerializer
at java.net.URLCla