gt; Subject: Spark streaming not remembering previous state
>
> Hi All,
>
> I wrote spark streaming program with stateful transformation.
> It seems like my spark streaming application is doing computation
> correctly with check pointing.
> But i terminate my program and i start it
Your context is not being created using checkpoints, use get or create,
From: Vinti Maheshwari mailto:vinti.u...@gmail.com>>
Date: Saturday, February 27, 2016 at 3:28 PM
To: user mailto:user@spark.apache.org>>
Subject: Spark streaming not remembering previous state
Hi All,
I
Here:
https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala
On Sat, 27 Feb 2016, 20:42 Sebastian Piu, wrote:
> You need to create the streaming context using an existing checkpoint for
> it to work
>
> See sample
You need to create the streaming context using an existing checkpoint for
it to work
See sample here
On Sat, 27 Feb 2016, 20:28 Vinti Maheshwari, wrote:
> Hi All,
>
> I wrote spark streaming program with stateful transformation.
> It seems like my spark streaming application is doing computatio
Hi All,
I wrote spark streaming program with stateful transformation.
It seems like my spark streaming application is doing computation correctly
with check pointing.
But i terminate my program and i start it again, it's not reading the
previous checkpointing data and staring from the beginning. I
