Re: Understanding checkpoint behavior

2018-11-06 Thread PranjalChauhan
Thank you for your response Piotr. I plan to upgrade to Flink 1.5.x early next year. Two follow-up questions for now. 1. " When operator snapshots are taken, there are two parts: the synchronous and the asynchronous parts. " I understand that when the operator snapshot is being taken, the proce

Understanding checkpoint behavior

2018-11-05 Thread PranjalChauhan
Hi, I am new Fink user and currently, using Flink 1.2.1 version. I am trying to understand how checkpoints actually work when Window operator is processing events. My pipeline has the following flow where each operator's parallelism is 1. source -> flatmap -> tumbling window -> sink In this pipel

Understanding checkpoint behavior

2018-11-05 Thread PranjalChauhan
Hi, I am new Fink user and currently, using Flink 1.2.1 version. I am trying to understand how checkpoints actually work when Window operator is processing events. My pipeline has the following flow where each operator's parallelism is 1. source -> flatmap -> tumbling window -> sink In this pipel