Thank you. +1 to adding this to wiki.
FYI - @Damon Douglas shared a related doc earlier
for alternative ideas for Beam to prevent overloading external services. (
https://docs.google.com/document/d/1VZ9YphDO7kewBSz5oMXVPHWaib3S03Z6aZ66BhciB3E/edit?usp=sharing&resourcekey=0-ItxMSG72EzfSwVedSz-Zeg
Great article!
Though it's depressing to see we have a pair of magic counter names to help
modulate scaling behavior.
On Tue, May 30, 2023, 11:42 AM Jack McCluskey via dev
wrote:
> Hey everyone,
>
> While working on some remote model handler code I hit a point where I
> needed to understand how
