Re: Late outputs for Session Window

2020-01-08 Thread KristoffSC
Hi, thank you for your SO comment [1]. You are right. Sorry, I miss understand the "late message" concepts. In fact I was never sending "late events" that should match just ended window. Thank you for your comments and clarification. [1] https://stackoverflow.com/questions/59570445/late-outpu

Re: Late outputs for Session Window

2020-01-08 Thread Arvid Heise
Hi Kristoff, please check my SO comment and reply. https://stackoverflow.com/questions/59570445/late-outputs-missing-for-flinks-session-window/59642942#59642942 It's not entirely clear to me why it's not working but I also don't quite understand your use case yet (data examples missing). Best,

Re: Late outputs for Session Window

2020-01-03 Thread KristoffSC
After following suggestion from SO I added few changes, so now I'm using Event Time Water marks are progressing, I've checked them in Flink's metrics. The Window operator is triggered but still I don't see any late outputs for this. StreamExecutionEnvironment env = StreamExecutionEnvironment.get

Late outputs for Session Window

2020-01-02 Thread KristoffSC
Hi all, In my pipeline setup I cannot see side outputs for Session Window (Flink 1.9.1) What I have is: messageStream. .keyBy(tradeKeySelector) .window(ProcessingTimeSessionWindows.withDynamicGap(new TradeAggregationGapExtractor())) .sideOutputLateData(lateTradeMessages) .process