Hello, Igniters! I want to suggest improvement for TeamCity Helper [1] – we need an easy way to get list of failed tests that don’t fall in the master branch. These tests should: * fail in the PR * not fail in the master * not be flaky.
Also, I want to suggest to create a GitHub plugin, which will notify PR if it has such tests. PR will have a marker, which allows/prohibits merge. This marker will be shown near PR conflicts. Allowing marker will be shown in case: * no new fails. Prohibiting marker will be shown in cases: * new fails – tests must be fixed. * new timed out test suite – suite should be restarted or tests must be fixed. * runAll wasn’t launched – tests must be launched. This will make test checks much faster and easier. Also, this will decrease the number of merges with new failed tests made by inattention to the tests. Further, we can expand the plugin by adding new checks, showing PR quality. [1] https://github.com/apache/ignite-teamcity-bot
