I have a topology that looks like this:
input -> 1hr window -> view
|
-> 5m window -> dofn(view)
IOW -- an input is windowed into both 1 hour windows, as well as 5 minute
windows. The 1 hour window data is collected into a view.
Meanwhile, the input is also windowed with 5 minute windows, there is some
processing, and then finally a DoFn that uses the view as a side input.
Both windows allow late data, and fire immediately on a late element. My
expectation would have been that any processing occurring in the DoFn after
the processing time of the late element would see the late element in the
view. However, that doesn't seem to be the case. Why?
Is there another approach I can use that doesn't suffer from this problem?
Regards,
Raman Gupta
