ch.
https://lists.openembedded.org/g/openembedded-core/message/137697
Best regards,
Yeoh Ee Peng
-Original Message-
From: Richard Purdie
Sent: Thursday, April 23, 2020 4:53 PM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Cc: Humberto Ibarra
Subject: Re: [OE-core] [PATCH
Add new testcase to check IMAGE_GEN_DEBUGFS. Test makes
sure that debug filesystem is created accordingly. Test also check
for debug symbols for some packages as suggested by Ross Burton.
[YOCTO #10906]
Signed-off-by: Humberto Ibarra
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/selftest
.stamp
| WARNING: exit code 1 from a shell command.
|
NOTE: recipe bison-native-3.5.4-r0: task do_compile: Failed
ERROR: Task
(virtual:native:/data/eyeoh7/tmp/poky/meta/recipes-devtools/bison/bison_3.5.4.bb:do_compile)
failed with exit code '1'
I will continue debugging this.
Best regard
tionError: 0 == 0 : debug filesystem not generated
-Original Message-
From: Richard Purdie
Sent: Thursday, April 23, 2020 4:53 PM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Cc: Humberto Ibarra
Subject: Re: [OE-core] [PATCH] selftest/imagefeatures: Enable sanity test for
IMA
Hi all,
Anyone has any inputs or suggestions for this patch that enable selftest for
IMAGE_GEN_DEBUGFS?
Thank you very much for your attention and help!
Best regards,
Yeoh Ee Peng
-Original Message-
From: Yeoh, Ee Peng
Sent: Wednesday, April 1, 2020 1:38 PM
To: openembedded-core
nitialization
to track detail for debugging in case test fail
Thanks,
Ee Peng
-Original Message-
From: Richard Purdie
Sent: Friday, April 17, 2020 10:24 PM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Subject: Re: [OE-core] [PATCH] oeqa/runtime/weston: Enhance west
logging for wayland compositor initialization
to track detail for debugging in case test fail
Yeoh Ee Peng (1):
oeqa/runtime/weston: Enhance weston tests
meta/lib/oeqa/runtime/cases/weston.py | 50 +++
1 file changed, 50 insertions(+)
--
2.7.4
-=-=-=-=-=-=-=-=
checking for
wayland processes up to 5 times)
- enable weston logging for debugging when fail
to initialize wayland compositor
[YOCTO# 10690]
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/weston.py | 50 +++
1 file changed, 50 insertions(+)
diff
.
Thank you very much!
Thanks,
Yeoh Ee Peng
-Original Message-
From: Richard Purdie
Sent: Friday, April 17, 2020 6:35 AM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Subject: Re: [OE-core] [PATCH] oeqa/runtime/weston: Enhance weston tests
On Mon, 2020-04-13 at 16:49
checking for
wayland processes up to 5 times)
[YOCTO# 10690]
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/weston.py | 40 +++
1 file changed, 40 insertions(+)
diff --git a/meta/lib/oeqa/runtime/cases/weston.py
b/meta/lib/oeqa/runtime/cases/weston.py
# 10690]
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/weston.py | 30 ++
1 file changed, 30 insertions(+)
diff --git a/meta/lib/oeqa/runtime/cases/weston.py
b/meta/lib/oeqa/runtime/cases/weston.py
index f32599a..f79ed64 100644
--- a/meta/lib/oeqa/runtime
/106075?p=,,,20,0,0,0::Created,,IMAGE_GEN_DEBUGFS,20,2,20,72347194
Thanks,
Ee Peng
-Original Message-
From: openembedded-core@lists.openembedded.org
On Behalf Of Yeoh Ee Peng
Sent: Wednesday, April 1, 2020 1:38 PM
To: openembedded-core@lists.openembedded.org
Cc: Yeoh, Ee Peng ; Humberto
Add new testcase to check IMAGE_GEN_DEBUGFS. Test makes
sure that debug filesystem is created accordingly. Test also check
for debug symbols for some packages as suggested by Ross Burton.
[YOCTO #10906]
Signed-off-by: Humberto Ibarra
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/selftest
Enable reporting selected test case result given the user provided
the selected test case id. If both test result id and test case id
were provided, report the selected test case result from the
selected test result id.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/report.py | 33
Add total passed, failed, and skipped statistic to test result.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/report.py | 5 +
scripts/lib/resulttool/template/test_report_full_text.txt | 3 ++-
2 files changed, 7 insertions(+), 1 deletion(-)
diff --git a
environment used for bitbake
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/store.py | 5 -
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git a/scripts/lib/resulttool/store.py b/scripts/lib/resulttool/store.py
index 79c83dd..e0951f0 100644
--- a/scripts/lib/resulttool/store.py
+++ b
only showing
partial result set.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/report.py | 16 +++-
scripts/lib/resulttool/resultutils.py | 4 ++--
2 files changed, 13 insertions(+), 7 deletions(-)
diff --git a/scripts/lib/resulttool/report.py b/scripts/lib/resulttool
In case of debugging, report user need to acccess the raw
test result. Instead of going back to source file/directory/URL
to manually pull out the raw result, provide alternative
way to let report showing raw test results by providing
the result id (optional).
Signed-off-by: Yeoh Ee Peng
Resulttool minor enhancements
- Enable report to use regression_map
- Enable report to output raw test results
- Enable report to print total test result statistic
- Enable store to add extra test environment config data
Yeoh Ee Peng (4):
scripts/resulttool/report: Enable report to use
The list-pkgs currently print packages in unordered format.
Enable list-pkgs to print ordered packages that will ease
viewing.
Signed-off-by: Yeoh Ee Peng
---
scripts/oe-pkgdata-util | 17 -
1 file changed, 8 insertions(+), 9 deletions(-)
diff --git a/scripts/oe-pkgdata-util b
environment used for bitbake
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/store.py | 5 -
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git a/scripts/lib/resulttool/store.py b/scripts/lib/resulttool/store.py
index 79c83dd..e0951f0 100644
--- a/scripts/lib/resulttool/store.py
+++ b
configuration section.
Example of virtual/kernel and version added to testresult configuration:
- "KERNEL_PROVIDER_VERSION": "linux-intel_4.19"
Signed-off-by: Yeoh Ee Peng
---
meta/classes/testimage.bbclass | 20 ++--
1 file changed, 18 insertions(+), 2 deletions(-
configuration section.
Example of virtual/kernel and version added to testresult configuration:
- "KERNEL_PROVIDER_VERSION": "linux-intel_4.19"
Signed-off-by: Yeoh Ee Peng
---
meta/classes/testimage.bbclass | 20 ++--
1 file changed, 18 insertions(+), 2 deletions(-
Remove the bsps-hw.bsps-hw.Graphics_-_ABAT as it was replaced by the
new automated runtime oeqa/runtime/cases/graphic.py.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/manual/bsp-hw.json | 26 --
1 file changed, 26 deletions(-)
diff --git a/meta/lib/oeqa/manual/bsp
Convert manual testcase bsps-hw.bsps-hw.bsps-hw.Graphics_-_ABAT
from oeqa/manual/bsp-hw.json to runtime automated test.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/graphic.py | 25 +
1 file changed, 25 insertions(+)
create mode 100644 meta/lib/oeqa
code.
Thank you very much for your inputs.
Thanks,
Yeoh Ee Peng
-Original Message-
From: Richard Purdie [mailto:richard.pur...@linuxfoundation.org]
Sent: Friday, May 17, 2019 2:02 PM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Subject: Re: [OE-core] [PATCH 1/2 v3] oeqa
Remove the bsps-hw.bsps-hw.rpm_-__install_dependency_package
as it was replaced by the test_rpm_install_dependency inside
oeqa/runtime/cases/rpm.py.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/manual/bsp-hw.json | 26 --
1 file changed, 26 deletions(-)
diff --git a
Convert manual testcase bsps-hw.bsps-hw.rpm_-__install_dependency_package
from oeqa/manual/bsp-hw.json to runtime automated test.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/rpm.py | 34 ++
1 file changed, 34 insertions(+)
diff --git a/meta/lib
Peng
-Original Message-
From: Richard Purdie [mailto:richard.pur...@linuxfoundation.org]
Sent: Friday, May 17, 2019 3:29 AM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Subject: Re: [OE-core] [PATCH 1/2 v2] oeqa/runtime/cases/rpm.py: Enable rpm
install dependency testing
Remove the bsps-hw.bsps-hw.rpm_-__install_dependency_package
as it was replaced by the test_rpm_install_dependency inside
oeqa/runtime/cases/rpm.py.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/manual/bsp-hw.json | 26 --
1 file changed, 26 deletions(-)
diff --git a
Convert manual testcase bsps-hw.bsps-hw.rpm_-__install_dependency_package
from oeqa/manual/bsp-hw.json to runtime automated test.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/rpm.py | 34 ++
1 file changed, 34 insertions(+)
diff --git a/meta/lib
Hi Richard and Alex,
Thanks for the inputs!
I added the OETestDepends decorator to the test case.
Best regards,
Yeoh Ee Peng
-Original Message-
From: richard.pur...@linuxfoundation.org
[mailto:richard.pur...@linuxfoundation.org]
Sent: Thursday, May 16, 2019 4:08 AM
To: Alexander
Convert manual testcase bsps-hw.bsps-hw.rpm_-__install_dependency_package
from oeqa/manual/bsp-hw.json to runtime automated test.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/rpm.py | 30 ++
1 file changed, 30 insertions(+)
diff --git a/meta/lib/oeqa
Remove the bsps-hw.bsps-hw.rpm_-__install_dependency_package
as it was replaced by the test_rpm_install_dependency inside
oeqa/runtime/cases/rpm.py.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/manual/bsp-hw.json | 26 --
1 file changed, 26 deletions(-)
diff --git a
Remove the bsps-hw.bsps-hw.rpm_-__install_dependency_package
as it was replaced by the test_rpm_install_dependency inside
oeqa/runtime/cases/rpm.py.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/manual/bsp-hw.json | 26 --
1 file changed, 26 deletions(-)
diff --git a
Convert manual testcase bsps-hw.bsps-hw.rpm_-__install_dependency_package
from oeqa/manual/bsp-hw.json to runtime automated test.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/runtime/cases/rpm.py | 29 +
1 file changed, 29 insertions(+)
diff --git a/meta/lib/oeqa
Remove duplicate codes. Replace unnecessary class variables with
local variables. Rename variables and arguments with simple and
standard name.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/manualexecution.py | 87 ++-
1 file changed, 40 insertions(+), 47
genericx86-64"
}
},
"bsps-qemu": {
"IMAGE_BASENAME": {
"1": "core-image-sato-sdk"
},
"MACHINE": {
"1": "qemuarm",
"2": "qemuarm64",
Allow the creation of configuration option file based on user inputs.
Where this configuration option file will be used by the the manual
execution to display options for configuration rather than user
need to inputs configuration manually.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool
Current manualexecution required pressing enter button to show each step
information, where this was wasting execution time. Enable display
full steps without needing to any press enter button.
Signed-off-by: Mazliana
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/manualexecution.py
Simplify and removed unnecessary codes.
Refactor to allow pythonic loop.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/manualexecution.py | 56 +++
1 file changed, 20 insertions(+), 36 deletions(-)
diff --git a/scripts/lib/resulttool/manualexecution.py
b
Current input checking does not match the standard input practiced
by QA team. Change the input checking to match the standard
input practiced by the QA team.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/manualexecution.py | 4 ++--
1 file changed, 2 insertions(+), 2 deletions
Currently the manual execution display step by sorting
the step as string, where steps were not being sorted
correctly when there are more than 9 steps.
Fixed the step sorting by sorting step as integer.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/manualexecution.py | 2 +-
1 file
These series of patches include enhancement and fixes for manualexecution:
- Enhance input check to standardize checking
- Enhancement to display full steps without press enter
- Fix test steps display order
- Refactor to simplify code and align to pythonic style
Yeoh Ee Peng (4
Current results stored does not have information needed to trace who
executed the tests. Enable store to add EXECUTED_BY configuration
to results file in order to track who executed the tests.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/store.py | 7 ++-
1 file changed, 6
Current QA team need to merge test result files from multiple sources.
Adding TESTSERIES configuration too early will have negative
implication to report and regression. Enable control to add TESTSERIES
when needed. Also enable adding EXECUTED_BY configuration when
needed.
Signed-off-by: Yeoh Ee
uot;EXECUTED_BY" configuration to track who executed
each results file.
Enable merge to control the adding of "TESTSERIES" configuration
as well as allow adding "EXECUTED_BY" configuration when needed.
Yeoh Ee Peng (3):
resulttool/resultutils: Enable add extra configuratio
Current resultutils library always add "TESTSERIES" configuration
to results. Enhance this to allow control of adding "TESTSERIES"
configuration as well as allow adding extra configurations
when needed.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool
Testseries configuration has important implication to report and
regression. Enable turn off testseries configuration creation
during results merge.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/merge.py | 13 +++--
scripts/lib/resulttool/resultutils.py | 10 +-
2
.
Signed-off-by: Yeoh Ee Peng
---
scripts/resulttool | 10 --
1 file changed, 10 deletions(-)
diff --git a/scripts/resulttool b/scripts/resulttool
index 5a89e1c..18ac101 100755
--- a/scripts/resulttool
+++ b/scripts/resulttool
@@ -51,13 +51,6 @@ import resulttool.report
import
Hi RP,
Yes, we will separate the changes into different patches as suggested.
Thank you for your inputs.
Thanks,
Ee Peng
-Original Message-
From: Richard Purdie [mailto:richard.pur...@linuxfoundation.org]
Sent: Thursday, March 28, 2019 3:43 PM
To: Yeoh, Ee Peng ;
openembedded-core
19-March/280547.html
http://lists.openembedded.org/pipermail/openembedded-core/2019-March/280548.html
Please let us know if you have any more inputs or questions. Thank you very
much for your attention and help!
Best regards,
Yeoh Ee Peng
-Original Message-
From: Richard Purdie [mailto:
control for creation of testseries configuration.
Yeoh Ee Peng (1):
resulttool/merge: Merge files from folders and control add testseries
meta/lib/oeqa/selftest/cases/resulttooltests.py | 16 ++--
scripts/lib/resulttool/merge.py | 29 --
scripts/lib/resulttool/regression.py
ation. Futhermore, since the map_results were
only needed by report and regression, we pulled the instructions
used to turn results data to map_results data to another function.
Finally, we renamed the functions and arguments to clearly
seperated the functions using results data from the one using
m
QA team execute extra testing that create multiple test result files,
where these test result files need to be merged into a single file
under certain use case.
Enable merge to allow merging results into a single test result file.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/merge.py
test_module match the file name itself.
This file was using test_module name that does not match the file name
itself. Fixed test_module name as well as the test_suite name.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/manual/toaster-managed-mode.json | 130 +++
meta/lib/oeqa/manual
Enable roll-up all test results belong to a commit
and to provide a roll-up report.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/report.py | 16 +---
1 file changed, 13 insertions(+), 3 deletions(-)
diff --git a/scripts/lib/resulttool/report.py b/scripts/lib/resulttool
MACHINE', 'IMAGE_BASENAME') to manualexecution.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/manualexecution.py | 36 +--
scripts/lib/resulttool/resultutils.py | 9 +---
2 files changed, 26 insertions(+), 19 deletions(-)
diff --git a/scri
Sorted regression results to provide friendly viewing of report.
Signed-off-by: Yeoh Ee Peng
---
scripts/lib/resulttool/regression.py | 8
1 file changed, 4 insertions(+), 4 deletions(-)
diff --git a/scripts/lib/resulttool/regression.py
b/scripts/lib/resulttool/regression.py
index
Hi RP,
Noted, thank you once again for your great help and inputs! Really glad to hear
that resulttool was ready!
We shall plan forward for future improvement in html reports and graphs. Also
we shall look into future test case development if needed.
Cheers,
Yeoh Ee Peng
-Original
Hi RP,
Noted, thank you once again for your help and inputs! Really glad to hear that
resulttool was ready!
We shall plan forward for future improvement in html reports and graphs. Also
we shall look into future test case development if needed.
Cheers,
Yeoh Ee Peng
-Original Message
pening.
> > We
> > really want to model how oe-build-perf-report handles git repos
> > for
> > comparisons:
> > - Its able to query data from git repos without changing the
> > current
> > working branch,
> > - it can search on tag forma
RP,
Noted, thanks.
Cheers,
Ee Peng
-Original Message-
From: Richard Purdie [mailto:richard.pur...@linuxfoundation.org]
Sent: Monday, February 18, 2019 6:12 PM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Subject: Re: [OE-core] [PATCH 0/2 v7] test-case-mgmt
On Mon
: Monday, February 18, 2019 5:08 PM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Subject: Re: [OE-core] [PATCH 0/2 v7] test-case-mgmt
Hi Ee Peng,
On Mon, 2019-02-18 at 08:09 +, Yeoh, Ee Peng wrote:
> I did some testing with the latest from resulttool: Update to use
> gita
ot;debian-9",
"HOST_NAME": "debian9-ty-2.yocto.io",
"LAYERS": {
"meta": {
"branch": "master",
"commit": "5fa3b5b15229babc9f96606c79436ab83651
x27;MACHINE', 'SDKMACHINE', 'IMAGE_BASENAME'],
"sdkext": ['TEST_TYPE', 'MACHINE', 'SDKMACHINE', 'IMAGE_BASENAME']
Doing so, it will store oeselftest in a more useful file directory structure
with host distro comprehended.
└
Hi RP,
Thank you very much for providing me your precious advices and I will
definitely look into them.
Let me look into all the improvements that you had developed and I will try my
best to provide further improvement needed.
Best regards,
Yeoh Ee Peng
-Original Message-
From
inja2 framework. Do we need html
report for this regression? Any requirement for the html report?
http://lists.openembedded.org/pipermail/openembedded-core/2019-February/278971.html
http://lists.openembedded.org/pipermail/openembedded-core/2019-February/278972.html
http://lists.openembedded.o
,
"log": ""
},
}
},
}
To use these scripts, first source oe environment, then run the
entry point script to look for help.
$ resulttool
To store test result from oeqa automated tests, execute the below
$ resulttool store
To m
sult creation
Yeoh Ee Peng (1):
resulttool: enable merge, store, report and regression analysis
meta/lib/oeqa/files/testresults/testresults.json | 40
meta/lib/oeqa/selftest/cases/resulttooltests.py| 104 +++
scripts/lib/resulttool/__init__.py | 0
scripts
From: Mazliana
Integrated “manualexecution” operation to resulttool scripts.
Manual execution script is a helper script to execute all manual
test cases in baseline command, which consists of user guideline
steps and the expected results. The last step will ask user to
provide their input to exec
d perform tests, let me look into them. Thank you for sharing the
logparser.
http://git.yoctoproject.org/cgit.cgi/poky-contrib/tree/meta/lib/oeqa/utils/logparser.py#n101
Best regards,
Yeoh Ee Peng
-Original Message-
From: Richard Purdie [mailto:richard.pur...@linuxfoundation.org]
Sent
;,
"log": ""
},
}
},
}
To use these scripts, first source oe environment, then run the
entry point script to look for help.
$ resultstool
To store test result from oeqa automated tests, execute the below
$ resultstool store
T
ment, then run the
entry point script to look for help.
$ resultstool
To execute manual test cases, execute the below
$ resultstool manualexecution
By default testresults.json store in /tmp/log/manual/
[YOCTO #12651]
Signed-off-by: Mazliana
Signed-off-by: Yeoh Ee Peng
---
s
for directory and git repository
Enable regression pairing base set to multiple target sets
Revise selftest testing for regression
Mazliana (1):
scripts/resultstool: enable manual execution and result creation
Yeoh Ee Peng (1):
resultstool: enable merge, store, report and regression analysis
, 2019 11:44 PM
To: Yeoh, Ee Peng ;
openembedded-core@lists.openembedded.org
Cc: Eggleton, Paul ; Burton, Ross
Subject: Re: [OE-core] [PATCH 1/2 v5] resultstool: enable merge, store, report
and regression analysis
On Tue, 2019-01-22 at 17:42 +0800, Yeoh Ee Peng wrote:
> OEQA outputs test res
git_branch_1 and
result_set_x from git_branch_2 if they both have matching configurations).
Any idea which regression use cases above was needed? We shall develop the next
regression functionalities based on your inputs.
Best regards,
Yeoh Ee Peng
-Original Message-
From: Yeoh, Ee Peng
Sent
://lists.openembedded.org/pipermail/openembedded-core/2019-January/278244.html
http://lists.openembedded.org/pipermail/openembedded-core/2019-January/278245.html
-Original Message-
From: Yeoh, Ee Peng
Sent: Tuesday, January 22, 2019 5:45 PM
To: Richard Purdie ;
openembedded-core
ment, then run the
entry point script to look for help.
$ resultstool
To execute manual test cases, execute the below
$ resultstool manualexecution
By default testresults.json store in /tmp/log/manual/
[YOCTO #12651]
Signed-off-by: Mazliana
Signed-off-by: Yeoh Ee Peng
---
s
"log": ""
},
...
"": {
"status": "",
"log": ""
},
}
},
}
To use these scripts, first source oe environment, then run the
entr
ipts/resultstool: enable manual execution and result creation
Yeoh Ee Peng (1):
resultstool: enable merge, store, report and regression analysis
meta/lib/oeqa/files/testresults/testresults.json | 40 ++
meta/lib/oeqa/selftest/cases/resultstooltests.py | 104
scripts/lib/results
this will need further enhancement.
Please let me know if any questions and inputs. Thank you very much for your
sharing and help!
Thanks,
Yeoh Ee Peng
-Original Message-
From: Richard Purdie [mailto:richard.pur...@linuxfoundation.org]
Sent: Monday, January 21, 2019 10:26 PM
To: Yeoh, Ee P
ment, then run the
entry point script to look for help.
$ resultstool
To execute manual test cases, execute the below
$ resultstool manualexecution
By default testresults.json store in /tmp/log/manual/
[YOCTO #12651]
Signed-off-by: Mazliana
Signed-off-by: Yeoh Ee Peng
---
s
Yeoh Ee Peng (1):
resultstool: enable merge, store, report and regression analysis
meta/lib/oeqa/selftest/cases/resultstooltests.py | 104
scripts/lib/resultstool/__init__.py| 0
scripts/lib/resultstool/manualexecution.py |
"log": ""
},
...
"": {
"status": "",
"log": ""
},
}
},
}
To use these scripts, first source oe environment,
From: Mazliana
Integrated “manualexecution” operation to test-case-mgmt scripts.
Manual execution script is a helper script to execute all manual
test cases in baseline command, which consists of user guideline
steps and the expected results. The last step will ask user to
provide their input to
},
}
},
}
To use these scripts, first source oe environment, then run the
entry point script to look for help.
$ test-case-mgmt
To store test result from oeqa automated tests, execute the below
$ test-case-mgmt store
By default, test result will be stored
improve code readability and easy to understand
Mazliana (1):
scripts/test-case-mgmt: enable manual execution and result creation
Yeoh Ee Peng (2):
scripts/oe-git-archive: fix non-existent key referencing error
scripts/test-case-mgmt: store test result and reporting
scripts/lib/testcasemgmt
hive", line 229, in main
'commit_count': metadata['layers']['meta']['commit_count'],
KeyError: 'commit_count'
Fix this error by adding exception catch when referencing
non-existent key (based on inputs provided by Richard Purdie).
[YOCTO#
},
}
},
}
To use these scripts, first source oe environment, then run the
entry point script to look for help.
$ test-case-mgmt
To store test result from oeqa automated tests, execute the below
$ test-case-mgmt store
By default, test result will be stored
From: Mazliana
Integrated “manualexecution” operation to test-case-mgmt scripts.
Manual execution script is a helper script to execute all manual
test cases in baseline command, which consists of user guideline
steps and the expected results. The last step will ask user to
provide their input to
hive", line 229, in main
'commit_count': metadata['layers']['meta']['commit_count'],
KeyError: 'commit_count'
Fix this error by checking the key existent from metadata before
referencing it.
[YOCTO# 13082]
Signed-off-by: Yeoh Ee Peng
result creation
Yeoh Ee Peng (2):
scripts/oe-git-archive: fix non-existent key referencing error
scripts/test-case-mgmt: store test result and reporting
scripts/lib/testcasemgmt/__init__.py | 0
scripts/lib/testcasemgmt/gitstore.py | 172
From: Mazliana
Manual execution script is a helper script to execute all manual test cases in
baseline command,
which consists of user guideline steps and the expected results. The last step
will ask user to
provide their input to execute result. The input options are
passed/failed/blocked/ski
cripts depends on scripts/oe-git-archive where it was
facing error if gitpython package not installed. Refer to
[YOCTO# 13082] for more detail.
To use these scripts, first source oe environment, then run the
entry point script to look for help.
$ test-case-mgmt
To store test resu
Enable qemu for slirp. Initialize Qemurunner with slirp. Setup ip
and port attribute to enable connection with qemu running with slirp.
[YOCTO#10713]
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/core/target/qemu.py | 22 +++---
1 file changed, 19 insertions(+), 3 deletions
Enable testimage to support qemu slirp. Configure "QEMU_USE_SLIRP"
& "TEST_SERVER_IP" variables to enable slirp.
[YOCTO#10713]
Signed-off-by: Yeoh Ee Peng
---
meta/classes/testimage.bbclass | 5 +
1 file changed, 5 insertions(+)
diff --git a/meta/classes/testimag
Qemu do not use the ip input from external. It will
retrieve ip from QemuRunner instance and assign
ip value.
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/core/target/qemu.py | 5 ++---
meta/lib/oeqa/runtime/context.py | 2 +-
2 files changed, 3 insertions(+), 4 deletions(-)
diff --git a
Enable qemurunner for slirp. Retrieved the ip & port from host machine
to connect to qemu from host machine.
[YOCTO#10713]
Signed-off-by: Yeoh Ee Peng
---
meta/lib/oeqa/utils/qemurunner.py | 17 +
1 file changed, 13 insertions(+), 4 deletions(-)
diff --git a/meta/lib/
Changes:
[v2]
- enable qemu slirp and like kvm, enable it only for testimage
- QemuRunner by default has use_slirp=False, where oe-selftest
will skipped all the new logic related to slirp
Yeoh Ee Peng (4):
oeqa/qemu & runtime: qemu do not need ip input from external
qemurunner:
1 - 100 of 213 matches
Mail list logo
