* The next tier could be an automated test suite that runs in a
simulator.
This would be accessible to the greatest numbers of developers and
contributors, because there's nothing to buy.
* The highest tier could be testing on a reference hardware board.
I think we need to assure that these two "tiers" are compatible and
use the same test infrastructure. The should have these things in common:
1. Same top-level test infrastructure,
2. Common assessment of test results from the target console output.
If we could all come to some consensus about that "top-level test
infrastructure" is, then we could actually begin experimenting with some
test cases now. I see several open source automated test frameworks on
github, but I have not familiarity with any of them. Does anyone out
there have a recommendation for non-invasive automated test framworks?
It seems to me that we would want to be able to run some simulator based
testing as part of the nightly builds. This would require some github
integration. But I personally would like to see the tests available
that anyone could set up at their own site/home to work with their
hardware of interest. So it would nice to have a standalone capability
as well.
If we could buy into a test framework, I would be interest to work with
a home setup.
