Hi, I've been evaluating Flink and wondering if it was possible to define a window that is based on characteristics of the data (data driven) but not contained in the data stream directly.
Consider 'nested events' where lower level events belong to a wider event where the wider event serves only to define a boundary (or window) over the lower level events. I was wondering if there was some way to communicate this super-structure in the stream somehow? I know that Flink users 'barriers' to define snapshot boundaries, but it might it be possible to communicate a 'window end' in a similar fashion? I guess I could attach an additional value to each event using a stateful map function and then define the window on that? e.g. A-Start, 1, 2, 3, A-End, B-Start, 1, 2, 3, B-End Regards, Paul