janhoy commented on PR #4280: URL: https://github.com/apache/solr/pull/4280#issuecomment-5601461730
Tests may be fragmented, for sure. But I agree with David that there are types of tests that we can accept being run mainly during the modification of a cetain feature and before each release. If RAT tests were heavy and slow that would be a good candidate. Same with these upgrade tests, they need only prevent that we ship something that is broken. And if we can run such tests weekly or nightly in CI, we also get some feedback without haling each PR run forever. The fact that noone cares about the failure logs of nightly is a different problem. I wonder if we could give `solrbot` some LLM credits and have him do test status analysis each Sunday for each of our active branches - a summary that yells loudly, with link to offending commit, when tests consistently fail, when there is a new flaky test, when test execution time sky-rocket etc. It could be well worth the spending of some tokens. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
