my goal is to run streaming 24x 7
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/NullPointerException-on-reading-checkpoint-files-tp7306p18168.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---
Hi TD,
I am trying to use getorCreate but i am getting java.io not serialised
please help i have posted it in a different thread.
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-getOrCreate-tc18060.html
--
View this message in context:
http://apache-spark-user-list.100156
This is actually a very tricky as their two pretty big challenges that need
to be solved.
(i) Checkpointing for broadcast variables: Unlike RDDs, broadcasts variable
dont have checkpointing support (that is you cannot write the content of a
broadcast variable to HDFS and recover it automatically w
Hi TD,
This is actually an important requirement (recovery of shared variables) for
us as we need to spread some referential data across the Spark nodes on
application startup. I just bumped into this issue on Spark version 1.0.1. I
assume the latest one also doesn't include this capability. Are t
Are you using broadcast variables in the streaming program? That might be
the cuase of this. As far as I can see, broadcast variables are probably
not supported through restarts and checkpoints.
TD
On Thu, Jun 12, 2014 at 12:16 PM, Kiran wrote:
> I am also seeing similar problem when trying t
I am also seeing similar problem when trying to continue job using saved
checkpoint. Can somebody help in solving this problem?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/NullPointerException-on-reading-checkpoint-files-tp7306p7507.html
Sent from the Ap
