Re: Queries regarding Historical Reprocessing

2017-05-04 Thread Aljoscha Krettek
Hi, Sorry for the longer wait, it’s a longer answer and I had to sort my thoughts. I’ll try and answer each question separately, though the solution for some of the issues are the same. 1. I think the problem here is that Flink will not perform any checkpoints if some operators have finished. T

Re: Queries regarding Historical Reprocessing

2017-05-03 Thread Vinay Patil
Hi Guys, Can someone please help me in understanding this ? Regards, Vinay Patil On Thu, Apr 27, 2017 at 12:36 PM, Vinay Patil wrote: > Hi Guys, > > For historical reprocessing , I am reading the avro data from S3 and > passing these records to the same pipeline for processing. > > I have the

Queries regarding Historical Reprocessing

2017-04-27 Thread Vinay Patil
Hi Guys, For historical reprocessing , I am reading the avro data from S3 and passing these records to the same pipeline for processing. I have the following queries: 1. I am running this pipeline as a stream application with checkpointing enabled, the records are successfully written to S3, how

Queries regarding Historical Reprocessing

2017-04-26 Thread vinay patil
-flink-user-mailing-list-archive.2336050.n4.nabble.com/Queries-regarding-Historical-Reprocessing-tp12833.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.