hey we have a big job that fails after it hits BigQuery Storage API Read quota limits, we’ve increased it once already but it keeps happening. When a job fails we see a spike of 429 s on the API Monitoring page for “ReadRows” and eventually we see "The worker lost contact with the service in Dataflow.." Shouldn’t this PR [1] on the Beam project have prevented that issue from happening?
Is there a way for us to throttle our requests and keep that from happening on the Beam side? [1] https://github.com/apache/beam/pull/15445
