Re: Making CollectSinkFunction to wait till all results are consumed

2024-02-19 Thread Alexey Leonov-Vendrovskiy
Hey, Piotrek, Thanks for the response and thoughts! I don't think it is possible to tell the difference between different cases -- when someone would not want the results back from the instantiated CollectSinkFunction. It is not clear why this would be the case, unless it is some test flow that e

Re: Making CollectSinkFunction to wait till all results are consumed

2024-02-14 Thread Piotr Nowojski
Hi! Interesting catch. I think the current master branch behaviour is broken. The chance to lose some records on `endInput` is simply a critical bug. The limited buffer size is still problematic, as it can surprise users. Having said that, the newly proposed behaviour without any buffer is also pr

Making CollectSinkFunction to wait till all results are consumed

2024-02-11 Thread Alexey Leonov-Vendrovskiy
Hey all, We propose to slightly change the behavior of the CollectSinkFunction and make it wait till all