Re: [OE-core] [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 12/13/2016 10:32 AM, Burton, Ross wrote: On 13 December 2016 at 16:17, Burton, Ross > wrote: It took over a minute to load a few tests. Do you have any idea why the discovery is so slow? at my host is very fast the load (1 second) jgperezc@jgpere

[OE-core] [PATCH] runtime: Add cleanup for logrotate tests

From: Jose Perez Carranza Delete logrotate dir to avoid errors when test are executed more than 1 time on the same target. Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/runtime/logrotate.py | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/lib/oeqa/runtime/logrotate.py b/meta

[OE-core] [PATCH] Tinfoil: Add test IDs to tinfoil test cases

From: Jose Perez Carranza Testopia entrances were created and the IDs retrieved are added to their corresponding test case on tinfoil script. Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/tinfoil.py | 9 + 1 file changed, 9 insertions(+) diff --git a/meta/lib/oeqa

[OE-core] [PATCH] selftest/devtool: Add test to verify "modify virtual/kernel"

From: Jose Perez Carranza The purpose of this test case is to verify that devtool modify works correctly when building the kernel. [YOCTO #10817] Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/devtool.py | 85 +++ 1 file changed, 85

[OE-core] [PATCH] selftest/runtime-tests: Modify positins test to reduce execution time

From: Jose Perez Carranza Currently test_postinst_roofs_and_boot is building a full-cmdline image this is taking a lot of time to execute the test, so a minimal image will be build instead. Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/runtime-test.py | 11 ++- 1 file

[OE-core] [PATCH] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

From: Jose Perez Carranza Currently the unittests for scripts on meta/lib/oe are not being executed by any suite hence the best option is migrate them to meta/lib/oeqa/selftest to be executed along with the selftest suite. [YOCTO #7376] Signed-off-by: Jose Perez Carranza --- meta/lib/oe

Re: [OE-core] [PATCH] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 11/03/2016 06:12 PM, Benjamin Esquivel wrote: Hello José, a couple of comments below. On Thu, 2016-11-03 at 17:46 -0500, jose.perez.carra...@linux.intel.com wrote: From: Jose Perez Carranza Currently the unittests for scripts on meta/lib/oe are not being executed by any suite hence the

[OE-core] [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

From: Jose Perez Carranza Currently the unittests for scripts on meta/lib/oe/tests are not being executed by any suite hence the best option is migrate them to meta/lib/oeqa/selftest/oelib-tests to be executed along with the selftest suite. [YOCTO #7376] Signed-off-by: Jose Perez Carranza

Re: [OE-core] [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 11/15/2016 11:16 AM, Burton, Ross wrote: On 15 November 2016 at 16:24, > wrote: +class TestPackagesFilterOutSystem(oeSelfTest): As the tests don't need anything special that oeSelfTest provides, can they remain as testcase.TestCase instan

Re: [OE-core] FW: [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 11/15/2016 03:11 PM, Burton, Ross wrote: On 15 November 2016 at 19:10, Benjamin Esquivel > wrote: The reason for the migration of the tests is for them to be included in the selftest execution. And for that execution, it needs to base

Re: [OE-core] [PATCH] Test needed to verify postinst script order.

On 11/17/2016 06:14 AM, Burton, Ross wrote: On 16 November 2016 at 00:50, Francisco Pedraza > wrote: Will verify the following: 1. Compile a minimal image. 2. The compiled image will add the created layer with the recipes postin

[OE-core] [PATCH] runtime: Update test cases numbers for runtime tests

From: Jose Perez Carranza Update test case numbers on runtime tests to do match with templates defined on Testopia for 2.3 release Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/runtime/buildgalculator.py | 1 + meta/lib/oeqa/runtime/kernelmodule.py| 2 +- meta/lib/oeqa/runtime

[OE-core] [PATCH] postinst: Add a test case to verify postinst scripts behavior

From: Jose Perez Carranza Add test case that verify behavior of postinst scripts at roofts time and when is delayed to the first boot directly on the target. Signed-off-by: Jose Perez Carranza --- .../recipes-test/postinst/postinst_1.0.bb | 2 + meta/lib/oeqa/selftest/runtime

Re: [OE-core] [PATCH] selftest/devtool: Add test to verify "modify virtual/kernel"

On 03/09/2017 01:57 PM, Burton, Ross wrote: On 23 January 2017 at 22:13, > wrote: > > +checkmodcode = runCmd("strings %s | head -n 10 | grep '%s'" % (bzimagefile, modstring)) Annoyingly this bit is failing on some autobuilders: Do you ha

[OE-core] [PATCH v2] selftest/devtool: Add test to verify "modify virtual/kernel"

From: Jose Perez Carranza The purpose of this test case is to verify that devtool modify works correctly when building the kernel. [YOCTO #10817] Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/devtool.py | 85 +++ 1 file changed, 85

[OE-core] [PATCH] runtime/dnf : Add ID to the dnf test cases

From: Jose Perez Carranza Add the corresponding Testopia ID to the test cases for dnf Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/runtime/cases/dnf.py | 12 1 file changed, 12 insertions(+) diff --git a/meta/lib/oeqa/runtime/cases/dnf.py b/meta/lib/oeqa/runtime/cases

[OE-core] [PATCH] oe-selftest : Unset SANITY_TESTED_DISTROS to avoid warnings on execution

From: Jose Perez Carranza Unsetting SANITY_TESTED_DISTROS is required to avoid warnings that are treated like failures by oe-selftest suite. [YOCTO #11401] Signed-off-by: Jose Perez Carranza --- scripts/oe-selftest | 15 +-- 1 file changed, 13 insertions(+), 2 deletions(-) diff

[OE-core] [PATCH] devtool: Avoid touch sstates when cleaning linux-yocto environment

From: Jose Perez Carranza sstates are cleaned when ruining test_devtool_virtual_kernel_modify to have a clean environment but this is affecting eSDK test that are dependent of those sstates, hence “cleansstate” is replaced for “clean”. [YOCTO #11300] Signed-off-by: Jose Perez Carranza

[OE-core] [PATCH] selftest/devtool: Modify test to use default config

From: Jose Perez Carranza Modify “test_devtool_virtual_kernel_modify” to be executed with default configuration defined on oe-selftest test suite. A shorter string was added to the the header file to avoid overlapped sections when building kernel for qemux86-64. [Yocto #11300] Signed-off-by

[OE-core] [PATCH] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza --- meta/classes/testimage.bbclass | 11

[OE-core] [PATCH v2] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza --- meta/classes/testimage.bbclass | 11

Re: [OE-core] [PATCH v2] runtime/dnf: Add new dnf test cases

On 05/11/2017 01:56 PM, Alexander Kanavin wrote: On 05/11/2017 08:33 PM, jose.perez.carra...@linux.intel.com wrote: +def test_dnf_exclude(self): +excludepkg = 'curl-dev' +self.dnf('list %s' % excludepkg, 0) +self.dnf_with_repo('remove -y curl') +self.dnf_wit

[OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza --- meta/classes/testimage.bbclass | 11

[OE-core] [PATCH] oeqa/controllers: Add test target for Systemd-boot

A new test target is neede to test Systemd-boot similar to gummiboot. Created a copy of GummibootTarget class and named as SystemdbootTarget, at this point the gummibootTarget will remain until documentation is updated with new systed information. Signed-off-by: Jose Perez Carranza --- meta/lib

[OE-core] [PATCH] buildperf: Add support for times without decimal part

Add logic for the cases when the time retrieved does not have decimal part. Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/buildperf/base.py | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index

[OE-core] [PATCH] lsb/lsbtests: Update package lists to use latest version of binary

From: Jose Perez Carranza Currently package list is pointing to "lsb-setup-4.1.0-1.noarch.rpm" which is not available anymore on http://ftp.linuxfoundation.org/pub/lsb/base/released-all/binary/ hence BASE_PACKAGES_LIST is updated to point to the latest available version. [YO

[OE-core] [PATCH v5] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza --- meta/classes/testimage.bbclass | 11

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

When I tried this test image was built without using states hence "busybox*.rpm" and "curl*.rpm"where present under "tmp/deploy/rpm/core2_64" hence the repo i taking tha packages form there to add them to repo and used on the image, but when using sstates those packages are not being built so a

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

On 06/08/2017 06:31 AM, Alexander Kanavin wrote: On 06/07/2017 08:31 PM, Jose Perez Carranza wrote: When I tried this test image was built without using states hence "busybox*.rpm" and "curl*.rpm"where present under "tmp/deploy/rpm/core2_64" hence the repo i tak

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

On 06/08/2017 07:49 AM, Alexander Kanavin wrote: On 06/08/2017 03:49 PM, Jose Perez Carranza wrote: 1. bitbake core-image-sato using shared states (I'm using local sstates) When you do this, tmp/deploy/rpm should get re-populated with rpm packages, regardless of whether they're

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

Thank you Alex ! I will work on a patch with your approach On 06/09/2017 04:22 AM, Alexander Kanavin wrote: On 06/08/2017 07:35 PM, Alexander Kanavin wrote: I haven't been able to reproduce the installroot failure, works fine here. The installroot issue is most likely due to dnf architecture

[OE-core] [PATCH v4] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza --- meta/classes/testimage.bbclass | 11

Re: [OE-core] [PATCH v4] runtime/dnf: Add new dnf test cases

On 06/14/2017 07:00 AM, Alexander Kanavin wrote: On 06/13/2017 10:56 PM, jose.perez.carra...@linux.intel.com wrote: From: Jose Perez Carranza Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed

[OE-core] [PATCH 1/2] systemdboot: Add Test to check boot file is created correctly

From: Jose Perez Carranza Add Test case to verify if EFI bootloader for systemd boot is correctly build inside of image. [YOCTO #9903] Signed-off-by: Jose Perez Carranza --- .../lib/oeqa/selftest/cases/systemd_boot.py| 54 -- 1 file changed, 50 insertions(+), 4

[OE-core] [PATCH 2/2] selftest: Add Testopia ID to test cases

From: Jose Perez Carranza Add decorator @OETestID() with proper Tesopia TC ID to the test cases that did not have it set. Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/cases/containerimage.py | 2 ++ meta/lib/oeqa/selftest/cases/devtool.py| 10 ++ meta

[OE-core] [PATCH] selftest/seltest.py: Add test to check imports from other layers

From: Jose Perez Carranza This tests adds a check of selftest itself to verify if can add test from other layers. [YOCTO #9770] Signed-off-by: Mariano Lopez Signed-off-by: Jose Perez Carranza --- .../lib/oeqa/selftest/cases/external-layer.py | 16 +++ meta/lib/oeqa/selftest/cases

[OE-core] [PATCH] selftest/bbtests: Create test case to verify bberror/waring

From: Jose Perez Carranza Create test case that uses “crasher.bbclass” to generate some warnings and errors and verify that are correctly displayed on log. [YOCTO #9949] Signed-off-by: Jose Perez Carranza --- meta-selftest/classes/crasher.bbclass | 37 +++ meta/lib/oeqa

[OE-core] [PATCH] oeqa/sdk: Replace buildiptables for buildgzip tests

From: Jose Perez Carranza Buildiptables test cases are conflicting with images built with “musl” as standard C library, in order to avoid those issues gzip package was selected to be used on the tests as this does not conflicts with “musl”. [YOCTO #11713] Signed-off-by: Jose Perez Carranza

Re: [OE-core] [PATCH] oeqa/sdk: Replace buildiptables for buildgzip tests

On 07/03/2017 11:59 AM, Khem Raj wrote: On Mon, Jul 3, 2017 at 9:26 AM, wrote: From: Jose Perez Carranza Buildiptables test cases are conflicting with images built with “musl” as standard C library, in order to avoid those issues gzip package was selected to be used on the tests as this

[OE-core] [PATCH v2] oeqa/sdk: Replace buildiptables for buildlzip tests

From: Jose Perez Carranza Buildiptables test cases are conflicting with images built with “musl” as standard C library, in order to avoid those issues lzip package was selected to be used on the tests as this does not have any "musl" dependency. [YOCTO #11713] Signed-off-by:

Re: [OE-core] [PATCH 22/22] testimage: Use the renamed buildlzip

On 07/06/2017 09:33 AM, Khem Raj wrote: buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj --- meta/classes/testimage.bbclass | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/meta/classes/testimage.bbclass b/meta/classes/testimage.bbclass index 6

Re: [OE-core] [PATCH 22/22] testimage: Use the renamed buildlzip

On 07/06/2017 10:40 AM, Khem Raj wrote: On Thu, Jul 6, 2017 at 8:34 AM, Jose Perez Carranza wrote: On 07/06/2017 09:33 AM, Khem Raj wrote: buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj --- meta/classes/testimage.bbclass | 6 +++--- 1 file changed, 3

[OE-core] [PATCH 0/2] Add lzip test instead of iptables for runtime

From: Jose Perez Carranza This series is created to replace iptables tests for lzip test and avoid conflicts with images built with “musl”. A two separate patches were sent before related to this, one for SDK [1] and other one to add changes to testimage.bbclass[2], the second one itself doe

[OE-core] [PATCH 2/2] testimage: Use the renamed buildlzip

From: Khem Raj buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj --- meta/classes/testimage.bbclass | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/meta/classes/testimage.bbclass b/meta/classes/testimage.bbclass index 6fa2d6fd9f4..0c4a84e1119 1006

[OE-core] [PATCH 1/2] oeqa/runtime: Replace buildiptables for buildlzip on runtime tests

From: Jose Perez Carranza Buildiptables test cases are conflicting with images built with “musl” as standard C library, in order to avoid those issues lzip package was selected to be used on the tests as this does not have any "musl" dependency. This patch is applicable for testi

Re: [OE-core] [PATCH 22/22] testimage: Use the renamed buildlzip

On 07/06/2017 09:33 AM, Khem Raj wrote: buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj --- meta/classes/testimage.bbclass | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/meta/classes/testimage.bbclass b/meta/classes/testimage.bbclass index

[OE-core] [PATCH] buildperf/tests_basics: sync the system to have clean esdk deploy dir

From: Jose Perez Carranza In some cases and depending on the resources measurement of disk usage for eSDK deploy dir is failing due “measure_disk_usage” was locking for tmp files (bitbake.lock and bitbake.sock) that were not deleted on time, this can be avoided by a sync on the system to allow

[OE-core] [PATCH] oeqa/buildperf: Add 'bitbake -m' on sync function to ensure bitbake is unloaded

From: Jose Perez Carranza Add 'bitbake -m' to the sync method and ensure all process related to bitbake are correctly unloaded before doing the different measurements. Also add a call to sync funtion on Test4 before final measurment of eSDK deploy dir disk usage. Signed-off-by:

[OE-core] [PATCH v2] oeqa/buildperf: Add 'bitbake -m' on sync function to ensure bitbake is unloaded

From: Jose Perez Carranza Add 'bitbake -m' to the sync method and ensure all process related to bitbake are correctly unloaded before doing the different measurements. Also add a call to sync funtion on Test4 before final measurment of eSDK deploy dir disk usage. Signed-off-by:

[OE-core] [PATCH] oeqa/selftest: Add missing IDs to various test cases

From: Jose Perez Carranza Add decorator @OETestID() with Tesopia TC-ID to the test cases that did not have it properly set. [YOCTO #11873] Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/cases/archiver.py | 3 ++- meta/lib/oeqa/selftest/cases/distrodata.py| 2

[OE-core] [PATCH v2] oeqa/selftest: Add missing IDs to various test cases

From: Jose Perez Carranza Add decorator @OETestID() with Tesopia TC-ID to the test cases that did not have it properly set. [YOCTO #11873] Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/cases/archiver.py | 3 ++- meta/lib/oeqa/selftest/cases/distrodata.py| 2

[OE-core] [PATCH] test_sdkext: Add support to execute suite with pre-built artifacts from Auto Builder

From: Jose Perez Carranza testsdkest' suite is not working properly when using pre-built artifacts downloaded from AutoBuilder, some updates are applied as follows: - testsdk.bbclass: add functionally to override the .data.json file with the paths of the host were the test are being exe

[OE-core] [PATCH] selftest/devtool: Avoid writing on TOPDIR on kernel test case

From: Jose Perez Carranza Use a tempdir to copy the .config file from the kernel instead of being copied to build directory. Signed-off-by: Jose Perez Carranza --- meta/lib/oeqa/selftest/cases/devtool.py | 9 + 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/meta/lib