Re: Side windows and late inputs

2021-04-10 Thread Raman Gupta
I'm also having the opposite problem -- my unit test moves the watermark to just before a timestamped input. I was expecting the DoFn to execute for all windows up to that watermark, seeing nothing in the side input. However, that isn't the case -- the test shows that the DoFn side input *before*

Side windows and late inputs

2021-04-09 Thread Raman Gupta
I have a topology that looks like this: input -> 1hr window -> view | -> 5m window -> dofn(view) IOW -- an input is windowed into both 1 hour windows, as well as 5 minute windows. The 1 hour window data is collected into a view. Meanwhile, the input is also windowed with 5 minute win