Re: File processing triggered from external source

2021-05-25 Thread Vincent Marquez
On Tue, May 25, 2021 at 11:14 AM Sozonoff Serge wrote: > Hi, > > Thanks for the clarification. > > What is an issue with applying windowing/triggering strategy for your case? > > > The problem was actually not the trigger but the whole approach I took. > > > I guess fundamentally the whole issue

Re: File processing triggered from external source

2021-05-25 Thread Sozonoff Serge
Hi, Thanks for the clarification. What is an issue with applying windowing/triggering strategy for your case? The problem was actually not the trigger but the whole approach I took. I guess fundamentally the whole issue for me boils down to the fact the with bound pipelines we have quite a fe

Re: File processing triggered from external source

2021-05-25 Thread Alexey Romanenko
You don’t need to use windowing strategy or aggregation triggers for a pipeline with bounded source to perform GbK-like transforms, but since you started to use unbounded source then your pcollections became unbounded and you need to do that. Otherwise, it’s unknown at which point of time your G