Thanks, I'll check it out.
On Sun, 11 May 2025, 22:44 Robert Engels, wrote:
>
> This seems to be a decent meta reference
> https://www.linkedin.com/advice/0/what-key-skills-tools-cloud-performance-tuning?utm_source=share&utm_medium=member_ios&utm_campaign=share_via#:~:text=Cloud%20performance%
Thanks for the tip!
Could you suggest some resources for the same regarding these design
considerations if you know of any ?
On Sun, 11 May 2025, 21:48 Robert Engels, wrote:
> Of that I’m not sure. It is based on deep knowledge of how these things
> are built from the hardware to the kernel to
Of that I’m not sure. It is based on deep knowledge of how these things are built from the hardware to the kernel to network protocols to the service layers. It broadly falls under performance tuning of which there is lots of literature. The key element of how channels and go routines play into thi
Does we have any kind of documented material or mathematical theory type
stuff for these things or is it more like hit or try
On Sun, 11 May 2025, 08:04 ren...@ix.netcom.com,
wrote:
> The two most likely limiters in performance will be your network pipe to
> the cloud and the QPS quota offered b
The two most likely limiters in performance will be your network pipe to
the cloud and the QPS quota offered by the service. If you are not reaching
those limits you should increase the parallelism until you do. If your cpu
becomes saturated first you probably need larger buffer sizes in the I/o
If you are asking how to benchmark variations of a design, rather an
improve an existing one, this is a nice survey of tools:
https://betterstack.com/community/guides/scaling-go/golang-benchmarking/
The classic pprof intro which gives a step by step example is:
https://go.dev/blog/pprof
On Friday
There's not enough detail here to be more prescriptive than "use the
profiler". You can of course insert calls to t := time.Now() at lots of
places, compute time.Since(t) after an aggregate operation, and collect
statistics on the time each operation takes -- a kind of poor-person's
manual prof
