Hi folks,
I've been working on a custom PTransform that makes requests to another
service, and would like to add a rate limiting feature there. The
fundamental issue that I'm running into here is that I need a decent
heuristic to estimate the worker count, so that each worker can
independently set
Evan Galpin wrote:
>
>> Could you possibly use a side input with fixed interval triggering[1] to
>> query the Dataflow API to get the most recent log statement of scaling as
>> suggested here[2]?
>>
>> [1]
>> https://beam.apache.org/documentation/patterns/s
