Re: [go-nuts] running tests against benchmarks

2021-03-15 Thread Jeremy French
Nice! Thanks. On Mon, Mar 15, 2021 at 10:36 PM Wojciech S. Czarnecki wrote: > Dnia 2021-03-15, o godz. 10:44:50 > Jeremy French napisał(a): > > > So it seems like the logical solution would be to create a test that > runs a > > benchmark and makes sure the benchmark results are within some > a

Re: [go-nuts] running tests against benchmarks

2021-03-15 Thread Wojciech S. Czarnecki
Dnia 2021-03-15, o godz. 10:44:50 Jeremy French napisał(a): > So it seems like the logical solution would be to create a test that runs a > benchmark and makes sure the benchmark results are within some acceptable > range. I realize that benchmarks are going to differ from machine to > machin

Re: [go-nuts] running tests against benchmarks

2021-03-15 Thread Jeremy French
Yes, I thought of something similar. You could certainly save/write the results of a benchmark to any version of a db/textfile, and then run another program to analyze it and do whatever you like with it. That just seems like unnecessary overhead. It would seem that since the test is just a func

Re: [go-nuts] running tests against benchmarks

2021-03-15 Thread Marcin Romaszewicz
What you want to do is common, but it's application-specific enough that there aren't so many generalized solutions. What I've always done is create a Go program which takes a while to run (I shoot for at least a minute) which runs your BeefyFunc in various ways that make sense to you, then I make

[go-nuts] running tests against benchmarks

2021-03-15 Thread Jeremy French
I keep running into this solution to a particular problem, but when I go to search on how to do it, I find that not only are there seemingly no solutions out there in search-results-land, there doesn't seem to be anyone else even asking about it. This then leads me to suspect, that I'm going a