But does the “notSer” object have to be serialized?
The object is immutable by the definition of A, so the only thing that needs to
be serialized is the (immutable) Int value? And Ints are serializable?
Just thinking out loud
Simon Scott
Research Developer @ viavisolutions.com
From: Hao Ren
, the driver dies
without any logged message.
Any advice much appreciated
Thanks
Simon Scott
Viavi Solutions
Hi,
I am developing a streaming application using checkpointing on Spark 1.5.1
I have just run into a NotSerializableException because some of the state that
my streaming functions need cannot be serialized. This state is only used in
the driver process, it is the checkpointing that requires th
solution closer to the code that
causes the problem.
Cheers
Simon
From: Evan Sparks [mailto:evan.spa...@gmail.com]
Sent: 24 June 2016 16:12
To: Simon Scott
Cc: dev@spark.apache.org
Subject: Re: Associating user objects with SparkContext/SparkStreamingContext
I would actually think about this the