Re: BufferTimeout throughput vs latency.

2020-09-16 Thread David Anderson
The performance loss being referred to there is reduced throughput. There's a blog post by Nico Kruber [1] that covers Flink's network stack in considerable detail. The last section on latency vs throughput gives some more insight on this point. In the experiment reported on there, the difference

BufferTimeout throughput vs latency.

2020-09-16 Thread Mazen Ezzeddine
Hi all, I have read the below in the documentation : "To maximize throughput, set setBufferTimeout(-1) which will remove the timeout and buffers will only be flushed when they are full. To minimize latency, set the timeout to a value close to 0 (for example 5 or 10 ms). A buffer timeout of 0 sh