Hey there,
So I have a stream of data, let the stream be a_1, a_2, a_3, a_4, a_5.
Now I would like to have a sliding window which slides by 1 second and
takes the data of 1 second. But here comes the caveat:
- I only want to keep the data in the window that does not have matching
elements.
So the pipeline looks as following:
<SOURCE>
.keyBy()
.window(CustomSlidingWindow.of())
.process(new ComplexMatcher())
.addSink(new PersistMatches())
In `ComplexMatcher` I will check whether some of the elements match. All
the elements that match should not remain in the window even if their
timestamp would fit into the window.
So to sum it up:
- SlidingWindow
- Elements that have been matched should not remain in the window even
if their timestamp would fit
- Multiple elements can be one `Match`, so 2 or 3 or 10 elements can
form a single match.
Could anyone point me into the right direction? Is that even possible
with window & process or would I have to use a different approach?
Best regards,
Dario
