[OE-core] [PATCH] oeqa/runtime: Update test names with testopia tc numbers.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/buildcvs.py | 4 ++-- meta/lib/oeqa/runtime/buildiptables.py | 4 ++-- meta/lib/oeqa/runtime/buildsudoku.py | 4 ++-- meta/lib/oeqa/runtime/connman.py | 8 +++ meta/lib/oeqa/runtime/date.py | 4 ++-- meta/lib

[OE-core] [PTACH V2] oeqa/runtime: Update test names with testopia tc numbers.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/buildcvs.py | 4 ++-- meta/lib/oeqa/runtime/buildiptables.py | 4 ++-- meta/lib/oeqa/runtime/buildsudoku.py | 4 ++-- meta/lib/oeqa/runtime/connman.py | 8 +++ meta/lib/oeqa/runtime/date.py | 4 ++-- meta/lib

[OE-core] [PATCH 2/2] oeqa/selftest/sstatetests: remove eglibc-initial from distro specific sstate test

Because eglibc-initial is non distro specific. Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/sstatetests.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/selftest/sstatetests.py b/meta/lib/oeqa/selftest/sstatetests.py index 2626483..8b58203 100644

[OE-core] [PATCH 1/2] Added test case numbers to test cases to aid in future automation of testopia status change.

We need automated tests to be mapped to Testopia test cases in order to aid in results logging. Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/bblayers.py | 10 +- meta/lib/oeqa/selftest/bbtests.py | 26 +- meta/lib/oeqa/selftest/buildoptions.py

[OE-core] [PATCH] Added new test cases for bitbake modes (-e -n -p -r -R -c -k)

Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/bbtests.py | 52 +++ 1 file changed, 52 insertions(+) diff --git a/meta/lib/oeqa/selftest/bbtests.py b/meta/lib/oeqa/selftest/bbtests.py index 6815ecf..d730bfd 100644 --- a/meta/lib/oeqa/selftest

[OE-core] [PATCH] Added testcase decorator to use in logging. Added class decorator LogResults that outputs test results in separate log file.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/base.py | 2 ++ meta/lib/oeqa/selftest/bblayers.py | 6 meta/lib/oeqa/utils/decorators.py | 66 ++ 3 files changed, 74 insertions(+) diff --git a/meta/lib/oeqa/selftest/base.py b/meta/lib/oeqa

[OE-core] [PATCH] Added test case decorators for the rest of selftest testcases except toaster

Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/bbtests.py | 22 ++ meta/lib/oeqa/selftest/oescripts.py | 12 +++- meta/lib/oeqa/selftest/prservice.py | 10 +- meta/lib/oeqa/selftest/sstatetests.py | 25 +++-- 4 files changed

[OE-core] [PATCH] oeqs/selftest: Added test case decorators for toaster

Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/_toaster.py | 94 ++ 1 file changed, 64 insertions(+), 30 deletions(-) diff --git a/meta/lib/oeqa/selftest/_toaster.py b/meta/lib/oeqa/selftest/_toaster.py index 5a42e93..1cf28a0 100644 --- a/meta/lib

[OE-core] [PATCH 2/2] oeqa/runtime: Added skipModule import for test modules that use it.

The modules that use skipModule should import it themselves and not rely on somebody else to import it. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/buildcvs.py | 2 +- meta/lib/oeqa/runtime/buildiptables.py | 2 +- meta/lib/oeqa/runtime/buildsudoku.py | 2 +- meta/lib/oeqa

[OE-core] [PATCH 1/2] oeqa: Refactor test skipping decorators to use the unittest result object

, then return a list of failed, skipped and error tests. Also removed the oetest import from decorators.py because it was no longer required. Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py | 17 - meta/lib/oeqa/utils/decorators.py | 40

[OE-core] [PATCH] oeqa/rutime: Added testcase decorators for automated runtime tests. Also added LogResults decorator for oeTest class in oetest.py

Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py| 2 ++ meta/lib/oeqa/runtime/buildcvs.py | 1 + meta/lib/oeqa/runtime/buildiptables.py | 1 + meta/lib/oeqa/runtime/buildsudoku.py | 1 + meta/lib/oeqa/runtime/connman.py | 2 +- meta/lib/oeqa/runtime

[OE-core] [PATCH] oeqa/runtime: Automatic test for parsing the logs on a machine and search for certain error keywords.

Also it has machine dependent ignore filters. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 124 + 1 file changed, 124 insertions(+) create mode 100755 meta/lib/oeqa/runtime/parselogs.py diff --git a/meta/lib/oeqa/runtime/parselogs.py

[OE-core] [PATCH] oeqa/runtime: Automatic test for parsing the logs on a machine and search for certain error keywords.

Also it has machine dependent ignore filters. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 128 + 1 file changed, 128 insertions(+) create mode 100644 meta/lib/oeqa/runtime/parselogs.py diff --git a/meta/lib/oeqa/runtime/parselogs.py

[OE-core] [PATCH 3/3] oeqa/runtime: Automatic test for ptest

For images without ptest the packages are automatically installed alongside ptest-runner. Log results are saved in ./results folder. No cleanup is done for packages after the test is finished. Signed-off-by: Stefan Stanacar Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_ptest.py | 140

[OE-core] [PATCH 1/3] oeqa: Added package installer to oetest to aid in future automatic install of packages

Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py | 7 +++ 1 file changed, 7 insertions(+) diff --git a/meta/lib/oeqa/oetest.py b/meta/lib/oeqa/oetest.py index ed8b3b2..0b7e7dc 100644 --- a/meta/lib/oeqa/oetest.py +++ b/meta/lib/oeqa/oetest.py @@ -66,6 +66,13 @@ class oeRuntimeTest

[OE-core] [PATCH 2/3] oeqa/utils/logparser.py: results based log parser utility

log file. Signed-off-by: Corneliu Stoicescu Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/logparser.py | 126 +++ 1 file changed, 126 insertions(+) create mode 100644 meta/lib/oeqa/utils/logparser.py diff --git a/meta/lib/oeqa/utils/logparser.py b/meta

[OE-core] [PATCH 1/2] oeqa/utils/logparser.py: results based log parser utility

log file. Signed-off-by: Corneliu Stoicescu Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/logparser.py | 127 +++ 1 file changed, 127 insertions(+) create mode 100644 meta/lib/oeqa/utils/logparser.py diff --git a/meta/lib/oeqa/utils/logparser.py b/meta

[OE-core] [PATCH 2/2] oeqa/runtime: Automatic test for ptest

For images without ptest the packages are automatically installed alongside ptest-runner. Log results are saved in ./results folder. No cleanup is done for packages after the test is finished. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_ptest.py | 124

[OE-core] [PATCH 3/3] oeqa/runtime: Automatic test for ptest

For images without ptest the packages are automatically installed alongside ptest-runner. Log results are saved in ./results folder. No cleanup is done for packages after the test is finished. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_ptest.py | 124

[OE-core] [PATCH 1/3] oeqa: Added package installer to oetest to aid in future automatic install of packages

Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py | 7 +++ 1 file changed, 7 insertions(+) diff --git a/meta/lib/oeqa/oetest.py b/meta/lib/oeqa/oetest.py index ed8b3b2..0b7e7dc 100644 --- a/meta/lib/oeqa/oetest.py +++ b/meta/lib/oeqa/oetest.py @@ -66,6 +66,13 @@ class oeRuntimeTest

[OE-core] [PATCH 2/3] oeqa/utils/logparser.py: results based log parser utility

log file. Signed-off-by: Corneliu Stoicescu Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/logparser.py | 125 +++ 1 file changed, 125 insertions(+) create mode 100644 meta/lib/oeqa/utils/logparser.py diff --git a/meta/lib/oeqa/utils/logparser.py b/meta

[OE-core] [PATCH] oeqa/selftest: Added decorators to buildoptions.py

Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/buildoptions.py | 9 + 1 file changed, 9 insertions(+) diff --git a/meta/lib/oeqa/selftest/buildoptions.py b/meta/lib/oeqa/selftest/buildoptions.py index ec541e5..a250cae 100644 --- a/meta/lib/oeqa/selftest/buildoptions.py +++ b

[OE-core] [PATCH] oeqa/utils: Added filter to LogResults decorator to enforce custom log level.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/decorators.py | 6 ++ 1 file changed, 6 insertions(+) diff --git a/meta/lib/oeqa/utils/decorators.py b/meta/lib/oeqa/utils/decorators.py index a9e67ed..7f845db 100644 --- a/meta/lib/oeqa/utils/decorators.py +++ b/meta/lib/oeqa/utils

[OE-core] [PATCH] oeqa/runtime: Added some new filters for the log parser Including custom filters for edgerouter, minnow and jasperforest.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 36 +--- 1 file changed, 29 insertions(+), 7 deletions(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa/runtime/parselogs.py index 42cb1b5..19a4f1b 100644 --- a/meta/lib/oeqa

[OE-core] [PATCH] meta-yocto/distro: Updated SANITY_TESTED_DISTROS.

Removed Poky-1.4, Poky-1.5, Ubuntu-13.10, Fedora-19, CentOs-6.4,Suse-LINUX-12.2. Replaced the list of Debian-7.x with wildcard. Added Ubuntu 14.10. Signed-off-by: Lucian Musat --- meta-yocto/conf/distro/poky.conf | 16 ++-- 1 file changed, 2 insertions(+), 14 deletions(-) diff

[OE-core] [PATCH] oeqa/ptest: Removed buildhistory perequisite. Modified ptest runner detection and finished conditions.

Often ptest-runner will have exit code 1 even if it worked, probably because some of the tests failed. Modified the condition to ptest-runner existing and having no output. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_ptest.py | 20 ++-- 1 file changed, 10 insertions

[OE-core] [PATCH] oeqa/parselogs: Added a check in case the folder location does not contain any log files

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 7 --- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa/runtime/parselogs.py index 42cb1b5..1cb9939 100644 --- a/meta/lib/oeqa/runtime/parselogs.py +++ b/meta

[OE-core] [PATCH 2/2] oeqa/ptest: Fixed complementary package install detection and added ptest-runner exit code check

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_ptest.py | 9 ++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/meta/lib/oeqa/runtime/_ptest.py b/meta/lib/oeqa/runtime/_ptest.py index 01ecfe3..ccfbaa9 100644 --- a/meta/lib/oeqa/runtime/_ptest.py +++ b/meta/lib/oeqa

[OE-core] [PATCH 1/2] oeqa/ptest: Removed buildhistory as requirement for ptest

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_ptest.py | 8 +++- 1 file changed, 3 insertions(+), 5 deletions(-) diff --git a/meta/lib/oeqa/runtime/_ptest.py b/meta/lib/oeqa/runtime/_ptest.py index 4c58dc1..01ecfe3 100644 --- a/meta/lib/oeqa/runtime/_ptest.py +++ b/meta/lib/oeqa

[OE-core] [PATCH 2/2] oeqa/rpm: Added some new test cases

Signed-off-by: Lucian Musat --- .../packagegroups/packagegroup-core-boot.bbappend | 1 + .../qa-recipes/qa-dependency-test/COPYRIGHT| 15 ++ .../qa-dependency-test/qa-dependency-test.sh | 6 ++ .../qa-recipes/qa-dependency-test_0.1.bb | 20

[OE-core] [PATCH 1/2] oeqa/smart: Added some new test cases

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/smart.py | 48 ++ 1 file changed, 48 insertions(+) diff --git a/meta/lib/oeqa/runtime/smart.py b/meta/lib/oeqa/runtime/smart.py index 3b49314..dba3bd6 100644 --- a/meta/lib/oeqa/runtime/smart.py +++ b

[OE-core] [PATCH] oeqa/selftest: Added a testcase to verify INCOMPATIBLE_LICENSE option.

Fixes bug 6933 Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/bbtests.py | 11 +++ 1 file changed, 11 insertions(+) diff --git a/meta/lib/oeqa/selftest/bbtests.py b/meta/lib/oeqa/selftest/bbtests.py index 5708d3d..aeccbf5 100644 --- a/meta/lib/oeqa/selftest/bbtests.py +++ b

[OE-core] [PATCH] oeqa/runtime: Some new tweaks to the error log parser.

These errors keep showing up in the automated tests and should be whitelisted. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa/runtime/parselogs.py index

[OE-core] [PATCH] oeqa/runtime: Fixed a problem in logparser where it failed to whitelist some common errors.

And some minor tweaks like moving some errors from qemu to common. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 9 + 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa/runtime/parselogs.py index

[OE-core] [PATCH] oeqa/runtime: Added a new auto rpm test

The test tries to query the rpm list with a non-root user Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/rpm.py | 10 ++ 1 file changed, 10 insertions(+) diff --git a/meta/lib/oeqa/runtime/rpm.py b/meta/lib/oeqa/runtime/rpm.py index b17e8b4..0529992 100644 --- a/meta/lib/oeqa

[OE-core] [PATCH] oeqa/selftest: New auto bitbake test for poky tiny.

The test builds a poky-tiny image, boots it in background and tries to comunicate with it via serial. Signed-off-by: Lucian Musat --- meta/lib/oeqa/selftest/bbtests.py | 29 + 1 file changed, 29 insertions(+) diff --git a/meta/lib/oeqa/selftest/bbtests.py b/meta

[OE-core] [PATCH 1/6] oeqa/runtime/ldd: Added new decorators for existing automated tests.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/ldd.py | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/lib/oeqa/runtime/ldd.py b/meta/lib/oeqa/runtime/ldd.py index bce56c4..47b3885 100644 --- a/meta/lib/oeqa/runtime/ldd.py +++ b/meta/lib/oeqa/runtime/ldd.py @@ -8,6 +8,7 @@ def

[OE-core] [PATCH 2/6] oeqa/runtime/connman: Added new decorators for existing automated tests.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/connman.py | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/lib/oeqa/runtime/connman.py b/meta/lib/oeqa/runtime/connman.py index cc537f7..bd9dba3 100644 --- a/meta/lib/oeqa/runtime/connman.py +++ b/meta/lib/oeqa/runtime/connman.py

[OE-core] [PATCH 4/6] oeqa/runtime/ping: Added new decorators for existing automated tests.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/ping.py | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/lib/oeqa/runtime/ping.py b/meta/lib/oeqa/runtime/ping.py index a73c724..80c4601 100644 --- a/meta/lib/oeqa/runtime/ping.py +++ b/meta/lib/oeqa/runtime/ping.py @@ -3,9 +3,11

[OE-core] [PATCH 3/3] oeqa/runtime: Boot test for poky-tiny.

Bug 6705. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_qemutiny.py | 9 + 1 file changed, 9 insertions(+) create mode 100644 meta/lib/oeqa/runtime/_qemutiny.py diff --git a/meta/lib/oeqa/runtime/_qemutiny.py b/meta/lib/oeqa/runtime/_qemutiny.py new file mode 100644 index

[OE-core] [PATCH 2/3] oeqa/utils: Add runner for poky-tiny qemu.

The connection and commands are done via serial. Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/qemutinyrunner.py | 170 ++ 1 file changed, 170 insertions(+) create mode 100644 meta/lib/oeqa/utils/qemutinyrunner.py diff --git a/meta/lib/oeqa/utils

[OE-core] [PATCH 1/3] oeqa/targetcontrol: Add support for poky-tiny in QemuTarget.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/targetcontrol.py | 33 - 1 file changed, 24 insertions(+), 9 deletions(-) diff --git a/meta/lib/oeqa/targetcontrol.py b/meta/lib/oeqa/targetcontrol.py index 1f4770f..9a681a3 100644 --- a/meta/lib/oeqa/targetcontrol.py

[OE-core] [PATCH 6/6] oeqa/runtime/smart: Added new decorators for existing automated tests.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/smart.py | 4 1 file changed, 4 insertions(+) diff --git a/meta/lib/oeqa/runtime/smart.py b/meta/lib/oeqa/runtime/smart.py index dba3bd6..e978227 100644 --- a/meta/lib/oeqa/runtime/smart.py +++ b/meta/lib/oeqa/runtime/smart.py @@ -30,6

[OE-core] [PATCH 5/6] oeqa/runtime/rpm: Added new decorators for existing automated tests.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/rpm.py | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/lib/oeqa/runtime/rpm.py b/meta/lib/oeqa/runtime/rpm.py index 0529992..4ca193b 100644 --- a/meta/lib/oeqa/runtime/rpm.py +++ b/meta/lib/oeqa/runtime/rpm.py @@ -13,6 +13,7 @@ def

[OE-core] [PATCH 3/6] oeqa/runtime/parselogs: Added new decorators for existing automated tests.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa/runtime/parselogs.py index 7721912..e9ccd0c 100644 --- a/meta/lib/oeqa/runtime/parselogs.py +++ b/meta/lib/oeqa/runtime

[OE-core] [PATCH] oeqa/utils: Fixed a problem with get_bb_var not returning right variable.

It searches using regex now and should be more accurate. Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/commands.py | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/meta/lib/oeqa/utils/commands.py b/meta/lib/oeqa/utils/commands.py index bc1dbb1..663e4e7 100644 --- a

[OE-core] [PATCH] oeqa/runtime: Added wifi tests.

A few wifi tests ported from IOT. They use expect scripts to connect and an external config file for the SSIDs and passwords. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/files/config.ini | 10 ++ meta/lib/oeqa/runtime/files/wifi_connect.exp | 47 + .../lib/oeqa

[OE-core] [PATCH] oeqa/parselogs: Added another batch of errors to the whitelist.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 15 +++ 1 file changed, 11 insertions(+), 4 deletions(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa/runtime/parselogs.py index e9ccd0c..9c1b822 100644 --- a/meta/lib/oeqa/runtime/parselogs.py

[OE-core] [PATCH] oeqa/utils: Added timeout decorator for testcases.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/decorators.py | 26 ++ 1 file changed, 26 insertions(+) diff --git a/meta/lib/oeqa/utils/decorators.py b/meta/lib/oeqa/utils/decorators.py index 61a1a73..b9fc76c 100644 --- a/meta/lib/oeqa/utils/decorators.py +++ b

[OE-core] [PATCH] oeqa/parselogs: The logs are now copied and parsed locally.

This is to fix a problem with reaching the limit of the whitelist size. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 30 +++--- 1 file changed, 23 insertions(+), 7 deletions(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa

[OE-core] [PATCH] oeqa/parselogs: Added some more errors to the whitelist.

Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 29 + 1 file changed, 25 insertions(+), 4 deletions(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa/runtime/parselogs.py index e641366..a9ab9a3 100644 --- a/meta/lib/oeqa/runtime

[OE-core] [PATCH] oeqa/parselogs: Fixed a problem in parselogs

When the test passed it returned an error because grep did not return any error and the variable that held the results was being referenced but not assigned any value. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions

[OE-core] [PATCH] oeqa/runtime: Added decorators for the remaining auto tests.

This helps for the automatic completion of the results in testopia. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/connman.py | 1 + meta/lib/oeqa/runtime/gcc.py | 1 + meta/lib/oeqa/runtime/perl.py| 1 + meta/lib/oeqa/runtime/python.py | 3 ++- meta/lib/oeqa/runtime/smart.py

[OE-core] [PATCH] oeqa/runtime: Added skip condition to kernel module test

because it caused failures in core-image-lsb images. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/kernelmodule.py | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/lib/oeqa/runtime/kernelmodule.py b/meta/lib/oeqa/runtime/kernelmodule.py index 2e81720..9318c28 100644 --- a

[OE-core] [PATCH] oeqa/syslog: Removed a pointless testcase and added skip for another.

The testcase syslog --help was rather useless and also causing problems on images where syslog was non-busybox, like LSB images so I removed it. Added a skip condition for TC 202 for the same reason. If syslog is non-busybox then the test skips. Signed-off-by: Lucian Musat --- meta/lib/oeqa

[OE-core] [PATCH 1/2] ptest-runner: Added timeout per tests.

Until now if a test hanged it would hang the whole process indefinitely. I added a timeout so that if one test takes too long it will kill it and skip to the next one. Signed-off-by: Lucian Musat --- meta/recipes-support/ptest-runner/files/ptest-runner | 2 +- 1 file changed, 1 insertion(+), 1

[OE-core] [PATCH 2/2] ptest-runner: Added the option to run a single package ptest suite.

If you give it a ptest enabled package as a paramter it will run only it's suite. Signed-off-by: Lucian Musat --- .../ptest-runner/files/ptest-runner| 47 +- 1 file changed, 28 insertions(+), 19 deletions(-) diff --git a/meta/recipes-support/ptest-r

[OE-core] [PATCH] lsbtest: sync test suite packages version

Sync file packages_list with upstream test suite packages version. Signed-off-by: Lucian Musat --- meta/recipes-extended/lsb/lsbtest/packages_list | 10 +- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/meta/recipes-extended/lsb/lsbtest/packages_list b/meta/recipes

[OE-core] [PATCH] oeqa/ptest: Modified regex to find FAILED testcases no just FAIL.

Some ptests output failed tests as FAILED instead of FAIL, like glib and pango. Bug #6601 Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/_ptest.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/runtime/_ptest.py b/meta/lib/oeqa/runtime/_ptest.py index

[OE-core] [PATCH] oeqa/ptest: Fixed glib ptest output.

It was creating output with FAILED instead of FAIL and it was not compliant with our log parser. Signed-off-by: Lucian Musat --- meta/recipes-core/glib-2.0/glib-2.0/run-ptest | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-core/glib-2.0/glib-2.0/run-ptest b

[OE-core] [PATCH] oeqa/ptest: Fixed pango ptest output.

It was creating output with FAILED instead of FAIL and it was not compliant with our log parser. Signed-off-by: Lucian Musat --- meta/recipes-graphics/pango/pango/run-ptest | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-graphics/pango/pango/run-ptest b/meta

[OE-core] [PATCH] oeqa/decorators: Fixed a problem with tests having the same names.

When two or more tests had the same name but different classes then the decorator log whould have the output all wrong. This was because a comparison which was made only between method names but now it compares classes too. Bug #8029 Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils

[OE-core] [PATCH V2] oeqa/decorators: Fixed a problem with tests having the same names.

When two or more tests had the same name but different classes then the decorator log whould have the output all wrong. This was because a comparison which was made only between method names but now it compares classes too. YOCTO #8029 Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils

[OE-core] [PATCH] oeqa/testimage: Enhance -v switch in testimage

When testimage is run with -v switch now individual test progress can be seen directly in bitbake console. [YOCTO #6841] Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py | 13 + 1 file changed, 13 insertions(+) diff --git a/meta/lib/oeqa/oetest.py b/meta/lib/oeqa/oetest.py

[OE-core] [PATCH] oeqa/decorators: Added decorator to restart the DUT in case of test hang.

] Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py | 6 ++ meta/lib/oeqa/utils/decorators.py | 25 + 2 files changed, 31 insertions(+) diff --git a/meta/lib/oeqa/oetest.py b/meta/lib/oeqa/oetest.py index 0fe68d4..a6f89b6 100644 --- a/meta/lib/oeqa

[OE-core] [PATCH 2/2] oeqa/runexported: Removed DEPLOY_DIR as mandatory.

We don't need DEPLOY_DIR for every runtime test so there is no need for it to be mandatory. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/runexported.py b/meta/lib/oeqa/runexported.py index 96

[OE-core] [PATCH 1/2] oeqa/oetest: Remove bb as requirement for oetest.

In order for the test export runner to work oetest needs to be separated from bitbake environment. There is no need to use bb import here so we can use a logger instead. Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py | 12 +++- 1 file changed, 7 insertions(+), 5 deletions

[OE-core] [PATCHv2 1/2] oeqa/oetest: Remove bb as requirement for oetest.

In order for the test export runner to work oetest needs to be separated from bitbake environment. There is no need to use bb import here so we can use a logger instead. Signed-off-by: Lucian Musat --- meta/lib/oeqa/oetest.py | 29 + 1 file changed, 21 insertions

[OE-core] [PATCHv2 2/2] oeqa/runexported: Removed DEPLOY_DIR as mandatory.

We don't need DEPLOY_DIR for every runtime test so there is no need for it to be mandatory. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/runexported.py b/meta/lib/oeqa/runexported.py index 96

[OE-core] [PATCH] oeqa/testimage: Remove absolute path to oeqa from json

In the json file the whole datastore is serialized which contains absolute path to the oeqa folder. This breaks the functionality when trying to run the tests from other machines. Signed-off-by: Lucian Musat --- meta/classes/testimage.bbclass | 11 ++- 1 file changed, 10 insertions

[OE-core] [PATCH] oeqa/runexported: Added default json file name as first parameter.

Instead of exiting when no parameter is given the default json file name should be used. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/runexported.py b/meta/lib/oeqa/runexported.py index 4213cab

[OE-core] [PATCH] oeqa/runexported: Fix a problem with ssh_target_log existing in folder.

When copying the exported tests to a remote machine ssh_target_log can be transformed from softlink to file. This will recreate the link. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/lib/oeqa/runexported.py b/meta/lib

[OE-core] [PATCH] oeqa/decorators: Add timestamp to decorator logs.

To avoid logs being overwriten when running the automated tests multiple times, log files include timestamps in their names and a link is created to point to the latest one. Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils/decorators.py | 17 +++-- 1 file changed, 15 insertions

[OE-core] [PATCH] oeqa/parselogs: Updated log parser whitelist.

Added some fixes for meta-intel boards and moved some errors from specific images to common. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 10 -- 1 file changed, 4 insertions(+), 6 deletions(-) diff --git a/meta/lib/oeqa/runtime/parselogs.py b/meta/lib/oeqa

[OE-core] [PATCH] oeqa/testimage: Add ability to run single test from suite.

Just like we have in oe-selftest, you can add .. in TEST_SUITES in order to run just that test. Signed-off-by: Lucian Musat --- meta/classes/testimage.bbclass | 7 +++ 1 file changed, 7 insertions(+) diff --git a/meta/classes/testimage.bbclass b/meta/classes/testimage.bbclass index 2efab29

[OE-core] [PATCH] oeqa/runexported: Fix a problem with ssh_target_log existing in folder.

When copying the exported tests to a remote machine ssh_target_log can be transformed from softlink to file which will throw an error when trying to run again. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a

[OE-core] [PATCHv2] oeqa/testimage: Add ability to run single test from suite.

Just like we have in oe-selftest, you can add .. in TEST_SUITES in order to run just that test Signed-off-by: Lucian Musat --- meta/classes/testimage.bbclass | 7 +++ 1 file changed, 7 insertions(+) diff --git a/meta/classes/testimage.bbclass b/meta/classes/testimage.bbclass index 2efab29

[OE-core] [PATCH] oeqa/decorators: Fixed a problem with decorator logs link.

When not doing actual tests with testimage, like for example exporting tests, the link to the log file was still created although the actual log file was not existent. Fixed it by moving the link creation part into the run() method. Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils

[OE-core] [PATCHv2] oeqa/decorators: Fixed a problem with decorator logs link.

When not doing actual tests with testimage, like for example exporting tests, the link to the log file was still created although the actual log file was not existent. Fixed it by moving the link creation part into the run() method. Signed-off-by: Lucian Musat --- meta/lib/oeqa/utils

[OE-core] [PATCH] oeqa/runexported: Replaced optionparser with argparse.

Also added the default json file name as default for the first positional argument. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 36 +--- 1 file changed, 17 insertions(+), 19 deletions(-) diff --git a/meta/lib/oeqa/runexported.py b/meta/lib

[OE-core] [PATCH] oeqa/testimage: Added support for folder names in TEST_SUITES.

You can add oeqa.runtime. and it will run all the tests found in it. Basically extends the functionality of feature [YOCTO #7834] Signed-off-by: Lucian Musat --- meta/classes/testimage.bbclass | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/meta/classes

[OE-core] [PATCH] oeqa/runexported: Add option to run arbitrary tests.

You can now overwrite the default TEST_SUITES from the json file and can choose the tests you want to run. Also you can display the list of tests. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 13 +++-- 1 file changed, 11 insertions(+), 2 deletions(-) diff --git a/meta

[OE-core] [PATCH] oeqa/testimage: Add support for test folder export.

If tests are organized in folders then it will copy the whole folder to the export location. This should keep the original directory structure for exported oeqa/runtime. Signed-off-by: Lucian Musat --- meta/classes/testimage.bbclass | 14 +- 1 file changed, 13 insertions(+), 1

[OE-core] [PATCH] oeqa/runexported: Add ability to run tests grouped in folders.

It can accept parameters like oeqa.runtime. and it will run all test files from that folder. Also a small fix for detecting ssh_target_log symlink when it points to a nonexisting file. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runexported.py | 8 +++- 1 file changed, 7 insertions(+), 1

[OE-core] [PATCH] oeqa/runtime: Removed obsolete testcase dmesg.

The dmesg parser test was made obsolete by the parselogs testcase, that searches in all the logs, including dmesg. --- meta/lib/oeqa/runtime/dmesg.py | 12 1 file changed, 12 deletions(-) delete mode 100644 meta/lib/oeqa/runtime/dmesg.py diff --git a/meta/lib/oeqa/runtime/dmesg.py b

[OE-core] [PATCH] oeqa/parselogs: Updated whitelist

Moved an error to common, and whitelisted the BAR errors and ati module. Also the uvesafb related errors will be ignored in LSB images which do not have graphic interface. Signed-off-by: Lucian Musat --- meta/lib/oeqa/runtime/parselogs.py | 16 1 file changed, 12 insertions