Re: watermark in fault tolerance

2016-03-27 Thread Aljoscha Krettek
Hi, the current watermark position is not persisted. The sources will start emitting based on the elements that they are seeing. So if the source is reset to some previous reading position (say with Kafka). Then it will emit the watermarks based on those earlier elements again. Cheers, Aljoscha O

watermark in fault tolerance

2016-03-26 Thread lonely Feb
I wonder if stream source task which extract timestamps and watermark from source element fail and restart with fault tolerance, what kind of watermark it would emit?