Re: Flink operator throttle

2020-05-17 Thread
everage the back-pressure feature to do this. > We can hear more from others whether this is a valid need. > > 王雷 于2020年5月17日周日 下午2:32写道: > >> Hi Benchao >> >> Thanks for your answer! >> >> According to your answer, I found `GuavaFlinkConnectorRateLimiter` whi

Re: Flink operator throttle

2020-05-16 Thread
miter. > (I assume you uses Kafka) > However it only exists in Kafka 0.10 DataStream Connector, not in other > versions nor table api. > > 王雷 于2020年5月14日周四 下午5:31写道: > >> hi, All >> >> Does Flink support rate limitation? >> How to limit the rate when the ex

Flink operator throttle

2020-05-14 Thread
hi, All Does Flink support rate limitation? How to limit the rate when the external database connected by the sink operator has throughput limitation. Instead of passive back pressure after reaching the limit of the external database, we want to limit rate actively. Thanks Ray