For the below standard stream/stream join, does flink store the results of
stream 1 and stream 2 into state store for the current hour and at the end
of the hour window it will fire the window by iterating through all stored
elements in the state store to find join matches?
My concern is during most of the time in the hour, the output (assuming the
output is going to another stream) will be idle and on each hour mark there
will be huge outputs of joined records emitted, any way to make it more
gradual?
dataStream.join(otherStream)
.where(0).equalTo(1)
.window(TumblingEventTimeWindows.of(Time.hours(1)))
.apply (new JoinFunction () {...});
