Re: Queries regarding Historical Reprocessing

2017-05-04 Thread Aljoscha Krettek
Hi, Sorry for the longer wait, it’s a longer answer and I had to sort my thoughts. I’ll try and answer each question separately, though the solution for some of the issues are the same. 1. I think the problem here is that Flink will not perform any checkpoints if some operators have finished. T

Re: Queries regarding Historical Reprocessing

2017-05-03 Thread Vinay Patil
Hi Guys, Can someone please help me in understanding this ? Regards, Vinay Patil On Thu, Apr 27, 2017 at 12:36 PM, Vinay Patil wrote: > Hi Guys, > > For historical reprocessing , I am reading the avro data from S3 and > passing these records to the same pipeline for processing. > > I have the