Hi there, I have got confused by the issue about the end-2-end latency statics. When I run benchmark(similar to yahoo streaming benchmark, yet without Redis, data generated by Flink, sink to Kafka), key parameters set as below: Task manager(short for tm) number: 3, slots per tm: 3, parallel: 9, buffer. Timeout: 100ms
the plan as below: [cid:image003.jpg@01D5AAAB.AC77F590] When I set injection rate to be 10k, the latency measured is 108ms, but when set injection rate to be 1k, latency is 560ms. [cid:image004.jpg@01D5AAAB.AC77F590] IMO, the low injection rate may get low latency, but the result could match. Some body could give me the explain, thanks. Best Regards & Thanks Rui
