Re: Making CollectSinkFunction to wait till all results are consumed

2024-02-19 Thread Alexey Leonov-Vendrovskiy
Hey, Piotrek, Thanks for the response and thoughts! I don't think it is possible to tell the difference between different cases -- when someone would not want the results back from the instantiated CollectSinkFunction. It is not clear why this would be the case, unless it is some test flow that e

Re: Making CollectSinkFunction to wait till all results are consumed

2024-02-14 Thread Piotr Nowojski
Hi! Interesting catch. I think the current master branch behaviour is broken. The chance to lose some records on `endInput` is simply a critical bug. The limited buffer size is still problematic, as it can surprise users. Having said that, the newly proposed behaviour without any buffer is also pr