Re: Watermarks and parallelism

2020-05-19 Thread Arvid Heise
asset 5 data not be dropped >considering it as a late date? > > > > Regards, > > Gnana > > > > *From: *Arvid Heise > *Date: *Monday, 18 May 2020 at 4:59 PM > *To: *Gnanasoundari Soundarajan > *Cc: *Alexander Fedulov , "user@flink.apache.org" >

Re: Watermarks and parallelism

2020-05-19 Thread Gnanasoundari Soundarajan
, 18 May 2020 at 4:59 PM To: Gnanasoundari Soundarajan Cc: Alexander Fedulov , "user@flink.apache.org" Subject: Re: Watermarks and parallelism Hi Gnanasoundari, Your use case is very typical and pretty much the main motivation for event time and watermarks. It's supported ou

Re: Watermarks and parallelism

2020-05-18 Thread Arvid Heise
and hence data didn’t flow downstream. > > > > I am curious to know that whether will it be a feasible requirement to > achieve it in flink using event time? > > > > Regards, > > Gnana > > > > *From: *Alexander Fedulov > *Date: *Thursday, 14 May 2020 at

Re: Watermarks and parallelism

2020-05-15 Thread Gnanasoundari Soundarajan
ubject: Re: Watermarks and parallelism Hi Gnana, 1. No, watermarks are generated independently per subtask. I think this section of the docs might make things more clear - [1]<https://ci.apache.org/projects/flink/flink-docs-master/concepts/timely-stream-processing.html#watermarks-in-parallel-stream

Re: Watermarks and parallelism

2020-05-14 Thread Alexander Fedulov
Hi Gnana, 1. No, watermarks are generated independently per subtask. I think this section of the docs might make things more clear - [1] . 2. The same watermark from the

Watermarks and parallelism

2020-05-13 Thread Gnanasoundari Soundarajan
Hi all, I have below queries in flink. Could anyone help me to understand? Query: 1 Is watermark maintained globally at the operator level? 2 When we have a keyByOperator with parallelism >1, is there a single watermark maintained across all the parallel subtasks or for each of the parallel s