You can have a try the following code.

ObjectArraySerializer serializer = new ObjectArraySerializer(kryo, 
Double[].class);
kryo.register(Double[].class, serializer);


-----------

Hi, all.
I enable kyro in spark with spark-defaults.conf:
     spark.serializer                 org.apache.spark.serializer.KryoSerializer
     spark.kryo.registrationRequired  true

A KryoException is raised when a logistic regression algorithm is running:
     Note: To register this class use: kryo.register(double[].class);
     Serialization trace:
     currL1 (org.apache.spark.mllib.stat.MultivariateOnlineSummarizer)
            at 
com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.write(FieldSerializer.java:585)
            at 
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:213)
            at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:568)
            at 
com.twitter.chill.Tuple2Serializer.write(TupleSerializers.scala:36)
            at 
com.twitter.chill.Tuple2Serializer.write(TupleSerializers.scala:33)
           at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:568)
 
My question is:
Doesn't double[].class be supported by default?

Thanks.
 


Reply via email to