Hi Slawomir, Pls follow this page https://maven.apache.org/surefire/maven-surefire-plugin/examples/junit-platform.html
There is a chapter "How to run multiple APIs or Engines". There are also some links pointing to our integration test in the Apache project. Pls have a look. Cheers Tibor On Wed, Nov 3, 2021 at 6:22 PM Slawomir Jaranowski <s.jaranow...@gmail.com> wrote: > Hi, > > I understand the difference between framework and providers. > I also know that we can add specific providers as dependency to the plugin > and in the result we have manually selected providers. > > When we don't configure any dependency the provider is chosen automatically > depending on what we have on classpath, what framework. > > eg. When we have on classpath junit4 and junit5, but without junit5 vintage > - junit4 tests are silently skipped. > > In most cases in the project we use one testing framework so > automatically choosing one provider is ok. > > When we use more that one framework it is probably during migration, so we > should define proper dependency. > It is ok when we have control on what we do in a project, but there are > some situations when we can make mistakes, like > - user add second testing framework and forgot about configuration > - we change project dependency and in transitive dependency we got next > testing framework > > So I want to mitigate the risk of skipped tests by warning / failing that > we have many frameworks and automatically provider selection takes place. > > We can also try to choose many providers (not one) automatically, but I > think it will be more complicated and in standard usage is not needed. > For automatic detection we have many corner cases, like testng + junit4 - > testng by default runs junit4 tests, so without special configuration for > testng we run some of the tests twice. > > > śr., 3 lis 2021 o 15:09 Tibor Digana <tibordig...@apache.org> napisał(a): > > > Hi Slawomir, > > > > The reality is different. > > It's not the frameworks but providers. > > So the plugin iterates over providers. > > You may choose whether you will define the provider artifacts in plugin > > deps or you let the plugin to select the providers upon dependencies > which > > means that there is some logic and JUnit5 deps may activate one provider > > for both the junit4 and 5. > > > > T > > > > On Tue, Nov 2, 2021 at 7:46 PM Slawomir Jaranowski < > s.jaranow...@gmail.com > > > > > wrote: > > > > > Hi, > > > > > > When multiple test frameworks are present on project classpath surefire > > > chooses one framework for running the tests. > > > > > > In such situations, some tests are silently skipped. > > > > > > > > > I've created issue [1] for it with a simple proposition. > > > > > > After discussion on slack another proposition was in place to detect > the > > > test framework with other dependencies and choose a proper provider. > > > > > > Or use multiple providers instead of only one. > > > > > > > > > It will be good to choose how to solve this problem. > > > > > > > > > [1] https://issues.apache.org/jira/browse/SUREFIRE-1954 > > > > > > -- > > > Sławomir Jaranowski > > > > > > https://twitter.com/SlawekJaran > > > https://github.com/slawekjaranowski > > > https://linkedin.com/in/slawomirjaranowski > > > > > > > > -- > Sławomir Jaranowski >
