Re: Broadcast and watermark

2021-12-02 Thread David Morávek
One more thought, if you're "broadcasting" the output of the KafkaSource, it may as well be the case that some partition is empty? Best, D. On Thu, Dec 2, 2021 at 5:11 PM David Morávek wrote: > Hi Sweta, > > the output timestamp seems reasonable to me. I guess you're concerned > about watermark

Re: Broadcast and watermark

2021-12-02 Thread David Morávek
Hi Sweta, the output timestamp seems reasonable to me. I guess you're concerned about watermarks you're seeing, is that correct? final Instant min = Instant.ofEpochMilli(Long.MIN_VALUE); final Instant max = Instant.ofEpochMilli(Long.MAX_VALUE); System.out.printf("Min: %s, Max: %s%n", min, max);

Broadcast and watermark

2021-12-02 Thread Sweta Kalakuntla
Hi, I am using a broadcast pattern for publishing rules and aggregating the data(https://flink.apache.org/news/2020/01/15/demo-fraud-detection.html). My use case is similar and also the code. One thing I wanted to capture is to figure out any latevents if any and send them to a sink. But when ther