Hi Steve, in the FLIP-238 [1] I propose to also introduce a rate limiter with a simple API at the level of SourceReader: RateLimiter.java <https://github.com/afedulov/flink/blob/FLINK-27919-generator-source/flink-core/src/main/java/org/apache/flink/api/common/io/ratelimiting/RateLimiter.java> GuavaRateLimiter.java <https://github.com/afedulov/flink/blob/FLINK-27919-generator-source/flink-core/src/main/java/org/apache/flink/api/common/io/ratelimiting/GuavaRateLimiter.java> RateLimitedSourceReader.java <https://github.com/afedulov/flink/blob/FLINK-27919-generator-source/flink-core/src/main/java/org/apache/flink/api/connector/source/lib/util/RateLimitedSourceReader.java> DataGeneratorSourceV3.java#L140 <https://github.com/afedulov/flink/blob/FLINK-27919-generator-source/flink-core/src/main/java/org/apache/flink/api/connector/source/lib/DataGeneratorSourceV3.java#L140>
Did you plan to go further than this? [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-238%3A+Introduce+FLIP-27-based+Data+Generator+Source Best, Alexander Fedulov On Wed, Jul 13, 2022 at 6:38 PM Steve Yurong Su <r...@apache.org> wrote: > Hi Jark, > > Thanks a lot :) > > Steve > > Jark Wu <imj...@gmail.com> 于2022年7月13日周三 22:48写道： > > > > Hi Steve, > > > > Welcome to the Flink community. I have granted the edit permission to > you. > > Looking forward to your FLIP. > > > > Best, > > Jark > > > > On Wed, 13 Jul 2022 at 19:56, Steve Yurong Su <r...@apache.org> wrote: > > > > > Hi folks! > > > > > > My name is Steve Su, and I am currently a third-year master’s student > > > at Tsinghua University. > > > > > > I am now participating in a Flink-related student project in OSPP > > > (Open Source Promotion Plan[1]). The project aims to design and > > > implement the generic rate limiter for the FLIP-27 source and apply > > > the rate-limiting feature to the Flink CDC project. @Leonard Xu is my > > > mentor in this project. > > > > > > We already had many discussions on source rate-limiting on the mailing > > > list, such as [2], [3], and so on. Leonard and I had an offline > > > discussion, and we thought that it would be great to have a generic > > > rate limiter, so I’d like to raise a new FLIP to illustrate the design > > > further. > > > > > > Please grant my account FLIP edit permissions. My apache confluence > > > account id is `steveyurongsu`. :D > > > > > > Thanks, > > > Steve Su > > > --- > > > [1] https://summer-ospp.ac.cn/homepagy > > > [2]https://lists.apache.org/thread/ff6mcos8g4otnhjrp030lrcrf3omgfmf > > > [3] https://lists.apache.org/thread/7gjxto1rmkpff4kl54j8nlg5db2rqhkt > > > >
