Re: "bootstrapping" DStream state

2016-03-10 Thread Zalzberg, Idan (Agoda)
Ha! So easy, how could I miss it?! Thanks! Sent with AquaMail for Android http://www.aqua-mail.com On March 10, 2016 9:32:38 PM Todd Nist wrote: The updateStateByKey can be supplied an initialRDD to populate it with. Per code (https://github.com/apache/spark/blob/v1.4.0/streaming/src/main/sc

Re: "bootstrapping" DStream state

2016-03-10 Thread Todd Nist
The updateStateByKey can be supplied an initialRDD to populate it with. Per code ( https://github.com/apache/spark/blob/v1.4.0/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala#L435-L445 ). Provided here for your convenience. /** * Return a new "state" D