There was a really interesting presentation from the Lucene folks at ApacheCon about how they're doing perf regression testing. That combined with some recent contributors wanting to get involved on some performance work and not having much direction or clarity on how to get involved led some of us to come together and riff on what we might be able to take away from that presentation and context.
Lucene presentation: "Learning from 11+ years of Apache Lucene benchmarks": https://docs.google.com/presentation/d/1Tix2g7W5YoSFK8jRNULxOtqGQTdwQH3dpuBf4Kp4ouY/edit#slide=id.p Their nightly indexing benchmark site: https://home.apache.org/~mikemccand/lucenebench/indexing.html I've checked in with a handful of performance minded contributors in early December and we came up with a first draft, then some others of us met on an adhoc call on the 12/9 (which was recorded; ping on this thread if you'd like that linked - I believe Joey Lynch has that). Here's where we landed after the discussions earlier this month (1st page, estimated reading time 5 minutes): https://docs.google.com/document/d/1X5C0dQdl6-oGRr9mXVPwAJTPjkS8lyt2Iz3hWTI4yIk/edit# Curious to hear what other perspectives there are out there on the topic. Early Happy New Years everyone! ~Josh