This patchset optimizes the way buildstats are stored in oe-build-perf-test result data. After this change buildstats are stored under refs/notes/buildstats/* in Git, and thus, they're not cloned/fetched by default. The motivation is to reduce the data footprint as buildstats are rarely used but they take a lot of space. With thousands of test runs, the amount of data transfer required by git clone drops from the order of gigabytes to megabytes. If needed for deeper analysis, buildstats can always be fetched separately.
The first patch in this changeset packs all buildstats into one JSON-formatted file so that they're easier to work with under git-notes. The second patch optimizes buildstats data footprint by combining rusage values. Patches #3, #4 and #5 add oe-git-archive script the ability to store data under git-notes, also fixing one bug in the git push functionality. The last patch changes the build perf test worker script to store buildstats under git-notes. The following changes since commit 3b5ac72bdf76ac8ff98dc3c882a4edc77c6e2c33: rpm: add a "rpm-build" PROVIDES (2017-03-22 15:09:26 +0000) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/buildperf/buildstats http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/buildstats Markus Lehtonen (6): oe-build-perf-test: pack all buildstat in one file oe-build-perf-test: sum rusage in buildstats scripts/oe-git-archive: fix pushing scripts/oe-git-archive: implement --exclude scripts/oe-git-archive: implement --notes build-perf-test-wrapper.sh: store buildstats under git-notes meta/lib/oeqa/buildperf/base.py | 66 ++++++++++++++++-------------- meta/lib/oeqa/buildperf/test_basic.py | 24 +++++------ scripts/contrib/build-perf-test-wrapper.sh | 2 + scripts/oe-build-perf-test | 1 + scripts/oe-git-archive | 32 +++++++++++++-- 5 files changed, 78 insertions(+), 47 deletions(-) -- 2.6.6 -- _______________________________________________ Openembedded-core mailing list Openembedded-core@lists.openembedded.org http://lists.openembedded.org/mailman/listinfo/openembedded-core
