Re: Regarding KryoSerialization in Spark

Thanks for the info. On Fri, May 1, 2015 at 12:10 AM, Sandy Ryza wrote: > Hi Twinkle, > > Registering the class makes it so that writeClass only writes out a couple > bytes, instead of a full String of the class name. > > -Sandy > > On Thu, Apr 30, 2015 at 4

Regarding KryoSerialization in Spark

Hi, As per the code, KryoSerialization used writeClassAndObject method, which internally calls writeClass method, which will write the class of the object while serilization. As per the documentation in tuning page of spark, it says that registering the class will avoid that. Am I missing someth

Re: Addition of new Metrics for killed executors.

ing executors. > > Thanks, > Archit Thakur. > > On Mon, Apr 20, 2015 at 1:31 PM, twinkle sachdeva < > twinkle.sachd...@gmail.com> wrote: > >> Hi Archit, >> >> What is your use case and what kind of metrics are you planning to add? >> >> Thanks, &

Re: Addition of new Metrics for killed executors.

Hi Archit, What is your use case and what kind of metrics are you planning to add? Thanks, Twinkle On Fri, Apr 17, 2015 at 4:07 PM, Archit Thakur wrote: > Hi, > > We are planning to add new Metrics in Spark for the executors that got > killed during the execution. Was just curious, why this in

Please subscribe me

Please subscribe me.