I left some small comments, but overall this is a great proposal. I think this should help fill a really important gap in our infrastructure and will help make our perf dashboards actionable. Thanks for taking this on Anand!
On Wed, Nov 2, 2022 at 12:32 PM Anand Inguva via dev <dev@beam.apache.org> wrote: > Hi, > > Python load tests/perf tests compute metrics and publish those metrics to > Grafana for visualization. > > As of now, there is no automated way of creating alerts(Github issues) > when a performance regression is detected in the perf tests. > > I created a doc[1] which outlines an API to perform Change Point Analysis > on the metric data computed by the python performance tests and how to file > Github issues(alerts) when a performance regression is observed. > > Please take a look and let me know what you think. Any feedback would be > appreciated. > > Thanks, > Anand > > > https://docs.google.com/document/d/1jhcmP405s5IRSB2T5ZlCAuBy8duhQjO0kgRLF0SfSl8/edit?usp=sharing >
