Thank you. +1 to adding this to wiki. FYI - @Damon Douglas <damondoug...@google.com> shared a related doc earlier for alternative ideas for Beam to prevent overloading external services. ( https://docs.google.com/document/d/1VZ9YphDO7kewBSz5oMXVPHWaib3S03Z6aZ66BhciB3E/edit?usp=sharing&resourcekey=0-ItxMSG72EzfSwVedSz-Zeg )
On Tue, May 30, 2023 at 3:52 PM Robert Burke <rob...@frantil.com> wrote: > Great article! > > Though it's depressing to see we have a pair of magic counter names to > help modulate scaling behavior. > > On Tue, May 30, 2023, 11:42 AM Jack McCluskey via dev <dev@beam.apache.org> > wrote: > >> Hey everyone, >> >> While working on some remote model handler code I hit a point where I >> needed to understand how Beam IOs interpret and action on being throttled >> by an external service. This turned into a few discussions and then a small >> write-up doc ( >> https://docs.google.com/document/d/1ePorJGZnLbNCmLD9mR7iFYOdPsyDA1rDnTpYnbdrzSU/edit?usp=sharing) >> to encapsulate the basics of what I learned. If you're familiar with this >> topic feel free to make suggestions on the doc, I'm intending to add this >> to the wiki so there's a resource for how this works in the future! >> >> Thanks, >> >> Jack McCluskey >> >> -- >> >> >> Jack McCluskey >> SWE - DataPLS PLAT/ Dataflow ML >> RDU >> jrmcclus...@google.com >> >> >>
