Hi all, Dong(cc'ed) and I are opening this thread to discuss our proposal to support configuring end-to-end allowed latency for Flink jobs, which has been documented in FLIP-325 <https://cwiki.apache.org/confluence/display/FLINK/FLIP-325%3A+Support+configuring+end-to-end+allowed+latency>.
By configuring the latency requirement for a Flink job, users would be able to optimize the throughput and overhead of the job while still acceptably increasing latency. This approach is particularly useful when dealing with records that do not require immediate processing and emission upon arrival. Please refer to the FLIP document for more details about the proposed design and implementation. We welcome any feedback and opinions on this proposal. Best regards. Dong and Yunfeng