Moving this discussion from a 2020/05/17 thread titled: "Backporting Fixes [was: heap malloc when executing binary/elf file]"
The discussion about automated testing begins at [1] where Greg asks whether we want to invest in an exhaustive functional test suite to qualify releases. I suggested that we could consider several tiers of testing: > * The lowest tier could be coding standard and build testing. (Which > we're already doing.) > > * The next tier could be static analysis of the code. > > There are free analyzers, as well as cloud based commercial ones > that are free for open source projects to use. > > * The next tier could be an automated test suite that runs in a > simulator. > > This would be accessible to the greatest numbers of developers and > contributors, because there's nothing to buy. > > * The highest tier could be testing on a reference hardware board. > > We could begin by perfecting the lowest tier and then gradually > climbing up the ladder by adding static analysis, etc. Renaming this thread so that we can continue that discussion... Cheers, Nathan [1] https://lists.apache.org/thread.html/r0a4db514b8ccfb5d0fde3e8bb2654a1fc27dc39501145ee4487a0719%40%3Cdev.nuttx.apache.org%3E
