Re: global watermark across multiple kafka consumers

2015-12-17 Thread Stephan Ewen
Isn't > it enough that you have individual watermarks for each topic? > > Cheers, > Till > > On Tue, Dec 15, 2015 at 4:45 PM, Griess, Andrew > wrote: > >> Hi guys, >> >> I have a question related to utilizing watermarks with multiple >> FlinkKa

Re: global watermark across multiple kafka consumers

2015-12-16 Thread Till Rohrmann
PM, Griess, Andrew wrote: > Hi guys, > > I have a question related to utilizing watermarks with multiple > FlinkKakfkaConsumer082 instances. The aim is to have a global watermark > across multiple kafka consumers where any message from any kafka partition > would updat

global watermark across multiple kafka consumers

2015-12-15 Thread Griess, Andrew
Hi guys, I have a question related to utilizing watermarks with multiple FlinkKakfkaConsumer082 instances. The aim is to have a global watermark across multiple kafka consumers where any message from any kafka partition would update the same watermark. When testing a simple TimeStampExtractor