Re: mapWithState and context start when checkpoint exists

2016-01-25 Thread Andrey Yegorov
mock will be faster. ------ Andrey Yegorov On Mon, Jan 25, 2016 at 1:26 PM, Shixiong(Ryan) Zhu wrote: > Hey Andrey, > > `ConstantInputDStream` doesn't support checkpoint as it contains an RDD > field. It cannot resume from checkpoints. > > On Mon, Jan 25, 2016 at

mapWithState and context start when checkpoint exists

2016-01-25 Thread Andrey Yegorov
nt action cannot be performed inside of the rdd1.map transformation. For more information, see SPARK-5063. ssc2.start() ssc2.awaitTerminationOrTimeout(7000) ssc2.stop() } } -- Andrey Yegorov