[OE-core] [PATCH] bitbake.conf: re-order DEBUG_PREFIX_MAP

2018-04-19 Thread Juro Bystricky
/glibc/2.27-r0/recipe-sysroot-native/usr/lib/x86_64-poky-linux.gcc-cross-initial-x86_64/gcc/x86_64-poky-linux/7.3.0/include But that one needs to be fixed in the recipe for glibc. Signed-off-by: Juro Bystricky --- meta/conf/bitbake.conf | 3 ++- 1 file changed, 2 insertions(+), 1 deletion

[OE-core] [PATCH v2] glib-2.0/glib.inc: fix broken mingw build

2018-04-19 Thread Juro Bystricky
w file that exists is "gio-querymodules.exe" instead of "gio-qeurymodules". The fix is to append the names of executables by an OS specific EXEEXT. [YOCTO #12679] Signed-off-by: Juro Bystricky --- meta/recipes-core/glib-2.0/glib.inc | 5 - 1 file changed, 4 insertions(+), 1 deleti

[OE-core] [PATCH v5] rootfs-postcommands.bbclass: improve binary reproducibility

2018-04-13 Thread Juro Bystricky
value is taken from the variable REPRODUCIBLE_TIMESTAMP_ROOTFS. [YOCTO #11176] [YOCTO #12422] Signed-off-by: Juro Bystricky --- meta/classes/rootfs-postcommands.bbclass | 25 +++-- 1 file changed, 23 insertions(+), 2 deletions(-) diff --git a/meta/classes/rootfs

[OE-core] [PATCH] qemu_2.11.1.bb: support mingw build

2018-04-13 Thread Juro Bystricky
s possible to simply remove the whole patch for mingw build (via a .bbappend file in meta-mingw), it makes more sense to modify the patch itself. Signed-off-by: Juro Bystricky --- ...ardev-connect-socket-to-a-spawned-command.patch | 46 +++--- 1 file changed, 31 insertions(+), 15

[OE-core] [PATCH] glib-2.0/glib.inc: fix broken mingw build

2018-04-12 Thread Juro Bystricky
io-querymodules [YOCTO #12679] Signed-off-by: Juro Bystricky --- meta/recipes-core/glib-2.0/glib.inc | 5 - 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/meta/recipes-core/glib-2.0/glib.inc b/meta/recipes-core/glib-2.0/glib.inc index b7c32e6..92ac19e 100644 --- a/meta/recipes-

[OE-core] [PATCH 1/1] python-xcbgen_1.12: improve reproducibility

2018-04-06 Thread Juro Bystricky
computationally expensive, so we resort to python3-native only when building reproducible packages: (BUILD_REPRODUCIBLE_BINARIES = '1'), otherwise we use the host python3. [YOCTO #12543] Signed-off-by: Juro Bystricky --- meta/recipes-graphics/xorg-proto/xcb-proto_1.12.bb | 5 + 1 file

[OE-core] [PATCH 0/1] python-xcbgen: improve reproducibility

2018-04-06 Thread Juro Bystricky
building python3-native itself can be computationally quite expensive. So, as a compromise, we use python3-native only when BUILD_REPRODUCIBLE_BINARIES = '1' host Python3 otherwise. Juro Bystricky (1): python-xcbgen_1.12:

[OE-core] [PATCH] hello-mod_0.1.bb: add RPROVIDES

2018-04-05 Thread Juro Bystricky
+= "kernel-module-hello" to the recipe fixes the problem. [YOCTO #12641] Signed-off-by: Juro Bystricky --- meta-skeleton/recipes-kernel/hello-mod/hello-mod_0.1.bb | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta-skeleton/recipes-kernel/hello-mod/hello-mod_0.1.bb b/meta-ske

[OE-core] [PATCH] linux-yocto_4.14.bb: fix for deterministic srcversion

2018-03-30 Thread Juro Bystricky
irly long directory name. The reason for incorrect srcversion is that some source files can be simply silently skipped from the checksum calculation due to limited buffer space for line parsing. [YOCTO #12544] Signed-off-by: Juro Bystricky --- .../modpost-srcversion-sometimes-incorrect.patch | 4

[OE-core] [PATCH v2] libc6-dbg: improve reproducibility

2018-03-29 Thread Juro Bystricky
Prevent bison from generating #line comments containing build host paths references. [YOCTO #12625] Signed-off-by: Juro Bystricky --- .../glibc/0030-plural_c_no_preprocessor_lines.patch | 21 + meta/recipes-core/glibc/glibc_2.27.bb | 1 + 2 files changed, 22

[OE-core] [PATCH] libpcre-ptest: skip locale test

2018-03-29 Thread Juro Bystricky
If a fr_FR locale is found, it is automatically tested. The test will fail if the locale is UTF-8, as the test blindly assumes (and expects) a non-UTF fr_FR locale. The remedy is to skip the test. [YOCTO #12215] Signed-off-by: Juro Bystricky --- meta/recipes-support/libpcre/libpcre_8.41.bb | 4

[OE-core] [PATCH] libc6-dbg: improve reproducibility

2018-03-29 Thread Juro Bystricky
Prevent bison from generating #line comments containing build host paths references. [YOCTO #12625] Signed-off-by: Juro Bystricky --- .../glibc/0029-plural_c_no_preprocessor_lines.patch | 21 + meta/recipes-core/glibc/glibc_2.27.bb | 1 + 2 files changed, 22

[OE-core] [PATCH] distcc-doc_3.2: improve reproducibility

2018-03-20 Thread Juro Bystricky
Remove timestamps from metadata of gzip compressed files. Signed-off-by: Juro Bystricky --- meta/recipes-devtools/distcc/distcc_3.2.bb | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/meta/recipes-devtools/distcc/distcc_3.2.bb b/meta/recipes-devtools/distcc/distcc_3.2.bb

[OE-core] [PATCH] libical-dev_2.0: improve reproducibility

2018-03-20 Thread Juro Bystricky
Remove build host references from distributed files. Signed-off-by: Juro Bystricky --- meta/recipes-support/libical/libical_2.0.0.bb | 7 +++ 1 file changed, 7 insertions(+) diff --git a/meta/recipes-support/libical/libical_2.0.0.bb b/meta/recipes-support/libical/libical_2.0.0.bb index

[OE-core] [PATCH v5] reproducible_build.bbclass: support for binary reproducibility

2018-03-20 Thread Juro Bystricky
und in the file. Uasge: INHERIT += "reproducible_build" [YOCTO#11178] [YOCTO#11179] Signed-off-by: Juro Bystricky --- meta/classes/reproducible_build.bbclass | 150 1 file changed, 150 insertions(+) create mode 100644 meta/classes/reproducible_build.b

[OE-core] [rocko][PATCH] gcc6: Patch to fix broken gcc-sanitizers build

2018-03-13 Thread Juro Bystricky
Backport a patch to fix errors such as: error: aggregate 'sigaltstack handler_stack' has incomplete type and cannot be defined Signed-off-by: Juro Bystricky --- meta/recipes-devtools/gcc/gcc-6.4.inc | 1 + .../gcc/gcc-6.4/backport/0013-gcc-sanitizers.

[OE-core] [PATCH] openssl_1.0.2n: improve reproducibility

2018-03-10 Thread Juro Bystricky
ed to pass sanitized CFLAGS to the script generating this file ("mkbuildinf.pl". ) 2. We also need to modify the script "mkbuildinf.pl" itsel in order to generate a build timestamp based on SOURCE_DATE_EPOCH, if present in the environment. Signed-off-by: Juro Bystric

[OE-core] [PATCH] dbus-test-ptest: improve reproducibility

2018-03-10 Thread Juro Bystricky
Remove build host references from additional files. Signed-off-by: Juro Bystricky --- meta/recipes-core/dbus/dbus-test_1.12.2.bb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-core/dbus/dbus-test_1.12.2.bb b/meta/recipes-core/dbus/dbus-test_1.12.2.bb index

[OE-core] [PATCH] reproducible_build_simple.bbclass: simple environment for reproducible binaries

2018-03-10 Thread Juro Bystricky
H for each recipe. Signed-off-by: Juro Bystricky --- meta/classes/reproducible_build_simple.bbclass | 11 +++ 1 file changed, 11 insertions(+) create mode 100644 meta/classes/reproducible_build_simple.bbclass diff --git a/meta/classes/reproducible_build_simple.bbclass b/me

[OE-core] [PATCH] BUILD_REPRODUCIBLE_BINARIES: use expanded value

2018-03-10 Thread Juro Bystricky
Replace the occurences of BUILD_REPRODUCIBLE_BINARIES with expanded values ${BUILD_REPRODUCIBLE_BINARIES} so the variable does not need to be exported. Signed-off-by: Juro Bystricky --- meta/classes/image-prelink.bbclass| 2 +- meta/classes/image.bbclass| 2 +- meta/classes

[OE-core] [morty][PATCH v2] gcc6.4 upgrade

2018-03-09 Thread Juro Bystricky
Second attempt. Added some more patches, mostly ARM specific. AFAIK this patchset passed all x86-64 tests. I also did some limited testing with meta-raspberrypi and musl library. (raspberrypi did not build with v1 of the patchset) Juro Bystricky (1): gcc6: Upgrade to 6.4.0 (latest stable

[OE-core] [PATCH] e2fsprogs_1.43.8.bb: improve reproducibility

2018-03-02 Thread Juro Bystricky
file mktime), so some "make" rules sometimes fired, sometimes did not. The remedy is to explicitly "touch" files that cause non-deterministic build. [YOCTO #12516] Signed-off-by: Juro Bystricky --- meta/recipes-devtools/e2fsprogs/e2fsprogs_1.43.8.bb | 3 +++ 1 file changed, 3

[OE-core] [PATCH] libjpeg-turbo: improve reproducibility

2018-03-01 Thread Juro Bystricky
e as build date. Although the build date is a generic string, we keep it in the same format MMDD. [YOCTO #12526] Signed-off-by: Juro Bystricky --- meta/recipes-graphics/jpeg/libjpeg-turbo_1.5.3.bb | 8 1 file changed, 8 insertions(+) diff --git a/meta/recipes-graphics/jpeg/libjpeg-t

[OE-core] [PATCH] dbus-test_1.12.2: various fixes

2018-02-27 Thread Juro Bystricky
installed ones. 3. Add a few more tests. (There are still some additional tests built that are not used, but they would have to be special-cased). 4. When evaluating the test results, differentiate between "FAIL" and "SKIP" [YOCTO #10841] [YOCTO #12277] Signed-off-by: Juro

[OE-core] [PATCH] autoconf-doc: improve reproducibility

2018-02-06 Thread Juro Bystricky
ent on purpose. The fix is to set the mtime of "autoconf.texi" based on SOURCE_DATE_EPOCH. [YOCTO #12524] Signed-off-by: Juro Bystricky --- meta/recipes-devtools/autoconf/autoconf.inc | 9 + 1 file changed, 9 insertions(+) diff --git a/meta/recipes-devtools/autoconf/autoco

[OE-core] [PATCH] glibc: improve reproducibility with multilib

2018-02-05 Thread Juro Bystricky
Multilib builds specify several loaders which will end up embedded in some binaries or script files. To support reproducible builds, we must ensure the loaders are always in deterministic order. [YOCTO #2655] [YOCTO #12478] [YOCTO #12480] Signed-off-by: Juro Bystricky --- meta/recipes-core

[OE-core] [PATCH] opkg-build: differentiate between compressorargs and zipargs

2018-02-05 Thread Juro Bystricky
control.tar.gz is always compressed with gzip. If data.tar is compressed by a compressor other than gzip, control.tar.gz may end up compressed with timestamp in the compressed image header. This would result in packages that are not binary reproducible. [YOCTO #11242] Signed-off-by: Juro

[OE-core] [PATCH] sanity.bbclass: modified error message

2018-01-30 Thread Juro Bystricky
Signed-off-by: Juro Bystricky --- meta/classes/sanity.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes/sanity.bbclass b/meta/classes/sanity.bbclass index d0f507e0..6716985 100644 --- a/meta/classes/sanity.bbclass +++ b/meta/classes/sanity.bbclass @@ -709,7

[OE-core] [PATCH 0/3] Unused patch files?

2018-01-29 Thread Juro Bystricky
There seem to be some patch files present in the repository that are not referenced anywhere anymore. Juro Bystricky (3): tzcode: remove unused patch files kexec-tools: remove unused patch file libcrypt: remove unused patch file .../files/0001-Fix-Makefile-quoting-bug.patch | 174

[OE-core] [PATCH 3/3] libcrypt: remove unused patch file

2018-01-29 Thread Juro Bystricky
Signed-off-by: Juro Bystricky --- ...g-AArch32-CE-implementations-when-target-.patch | 96 -- 1 file changed, 96 deletions(-) delete mode 100644 meta/recipes-support/libgcrypt/files/0006-Fix-building-AArch32-CE-implementations-when-target-.patch diff --git a/meta/recipes

[OE-core] [PATCH 2/3] kexec-tools: remove unused patch file

2018-01-29 Thread Juro Bystricky
Signed-off-by: Juro Bystricky --- .../kexec/kexec-tools/kexec-aarch64.patch | 801 - 1 file changed, 801 deletions(-) delete mode 100644 meta/recipes-kernel/kexec/kexec-tools/kexec-aarch64.patch diff --git a/meta/recipes-kernel/kexec/kexec-tools/kexec-aarch64.patch

[OE-core] [PATCH 1/3] tzcode: remove unused patch files

2018-01-29 Thread Juro Bystricky
Signed-off-by: Juro Bystricky --- .../files/0001-Fix-Makefile-quoting-bug.patch | 174 - .../files/0002-Port-zdump-to-C90-snprintf.patch| 115 -- 2 files changed, 289 deletions(-) delete mode 100644 meta/recipes-extended/tzcode/files/0001-Fix-Makefile

[OE-core] [PATCH] package_rpm.bbclass: improve reproducibility of RPM packages

2018-01-25 Thread Juro Bystricky
The RPM packages contain BUILDHOST based on the current build host. This breaks reproducibility if the same package is build on two different hosts. To improve reproducible builds, we always set BUILDHOST as "reproducible". Signed-off-by: Juro Bystricky --- meta/classes/package_rpm.b

[OE-core] [PATCH] glibc-locale.inc: avoid duplicate packages

2018-01-22 Thread Juro Bystricky
PACKAGES_DYNAMIC contained an identical set of packages twice. I suspect this was a result of global search/replace when moving recipes from eglibc to glibc long time ago. Signed-off-by: Juro Bystricky --- meta/recipes-core/glibc/glibc-locale.inc | 1 - 1 file changed, 1 deletion(-) diff --git

[OE-core] [PATCH v2] libc6: improve reproducibility

2018-01-22 Thread Juro Bystricky
uire bison to be installed and unconditionally re-generate plural.c. (This is achieved by touching plural.y). [YOCTO #12291] Signed-off-by: Juro Bystricky --- meta/recipes-core/glibc/glibc_2.26.bb | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/meta/recipes-core/glibc/gli

[OE-core] [PATCH] libc6: improve reproducibility

2018-01-12 Thread Juro Bystricky
uire bison to be installed and unconditionally re-generate plural.c. (This is achieved by touching plural.y). [YOCTO #12291] Signed-off-by: Juro Bystricky --- meta/recipes-core/glibc/glibc_2.26.bb | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/meta/recipes-core/glibc/glibc_

[OE-core] [PATCH v2] icu-dev: improve reproducibility

2018-01-12 Thread Juro Bystricky
Remove all build host references from several distributed files: Makefile.inc, icu-config, pkgdata.inc Signed-off-by: Juro Bystricky --- meta/recipes-support/icu/icu.inc | 8 1 file changed, 8 insertions(+) diff --git a/meta/recipes-support/icu/icu.inc b/meta/recipes-support/icu

[OE-core] [PATCH] qemu-2.10.1.bb: support mingw build

2018-01-11 Thread Juro Bystricky
atform, it makes more sense to modify the patch itself. Signed-off-by: Juro Bystricky --- ...ardev-connect-socket-to-a-spawned-command.patch | 37 +- 1 file changed, 29 insertions(+), 8 deletions(-) diff --git a/meta/recipes-devtools/qemu/qemu/chardev-connect-socket-to

[OE-core] [PATCH 1/2] icu-dbg: improve reproducibility

2018-01-07 Thread Juro Bystricky
Make sure build host references do not end up being compiled in the image. This only affects libicutu and icu-dbg. Signed-off-by: Juro Bystricky --- meta/recipes-support/icu/icu.inc | 9 + 1 file changed, 9 insertions(+) diff --git a/meta/recipes-support/icu/icu.inc b/meta/recipes

[OE-core] [PATCH 2/2] icu-dev: improve reproducibility

2018-01-07 Thread Juro Bystricky
Remove all build host references from several distributed files: Makefile.inc, icu-config, pkgdata.inc Signed-off-by: Juro Bystricky --- meta/recipes-support/icu/icu.inc | 8 1 file changed, 8 insertions(+) diff --git a/meta/recipes-support/icu/icu.inc b/meta/recipes-support/icu

[OE-core] [PATCH 1/2] groff_1.22.3.bb: support SOURCE_DATE_EPOCH

2018-01-07 Thread Juro Bystricky
value specified by SOURCE_DATE_EPOCH (if present in environment). Signed-off-by: Juro Bystricky --- .../groff/groff-1.22.3/source-date-epoch.patch | 286 + meta/recipes-extended/groff/groff_1.22.3.bb| 1 + 2 files changed, 287 insertions(+) create mode 100644

[OE-core] [PATCH 2/2] groff-doc: improve reproducibility

2018-01-07 Thread Juro Bystricky
Some examples used "random" numbers to generate random RGB colors. This would break reproducible builds. The issue was solved by a patch backported from Debian. Signed-off-by: Juro Bystricky --- .../groff-1.22.3/hdtbl-examples-less-random.patch | 41 ++ me

[OE-core] [PATCH 2/2] perl-ptest: various fixes

2018-01-07 Thread Juro Bystricky
ences they are harmless). Fix the expected checksum of MakeMaker/lib/ExtUtils/Liblist/Kid.pm to match the one expected: We modified the file, but did not recalculate/update the file checksum accordingly. (This fixes the only failing test.) Signed-off-by: Juro Bystricky --- meta/recipes-devtools

[OE-core] [PATCH 1/2] perl-dbg: improve reproducibility

2018-01-07 Thread Juro Bystricky
Remove various build host references scattered within comments in numerous files that are distributed in the package. Signed-off-by: Juro Bystricky --- meta/recipes-devtools/perl/perl_5.24.1.bb | 13 + 1 file changed, 13 insertions(+) diff --git a/meta/recipes-devtools/perl

[OE-core] [PATCH 5/5] openssl-ptest: improve reproducibility

2018-01-04 Thread Juro Bystricky
Remove buildhost references from Makefile and Configure. Signed-off-by: Juro Bystricky --- meta/recipes-connectivity/openssl/openssl10.inc | 6 ++ 1 file changed, 6 insertions(+) diff --git a/meta/recipes-connectivity/openssl/openssl10.inc b/meta/recipes-connectivity/openssl/openssl10.inc

[OE-core] [PATCH 2/5] gcc-runtime: improve reproducibility

2018-01-04 Thread Juro Bystricky
sources are in a shared folder (work-shared)/ Additionally, DWARF info seems to store symlink names but gcc seems to resolve symlink names referenced in -fdebug-prefix-map. Signed-off-by: Juro Bystricky --- meta/recipes-devtools/gcc/gcc-runtime.inc | 12 1 file changed, 12 insertions

[OE-core] [PATCH 4/5] sed-ptest: improve reproducibility

2018-01-04 Thread Juro Bystricky
Remove build host references Signed-off-by: Juro Bystricky --- meta/recipes-extended/sed/sed_4.2.2.bb | 6 ++ 1 file changed, 6 insertions(+) diff --git a/meta/recipes-extended/sed/sed_4.2.2.bb b/meta/recipes-extended/sed/sed_4.2.2.bb index e31bec2..f10e365 100644 --- a/meta/recipes

[OE-core] [PATCH 3/5] attr-doc: improve reproducibility

2018-01-04 Thread Juro Bystricky
Use gzip compression without timestamps in the metadata. (Use gzip -n). Signed-off-by: Juro Bystricky --- meta/recipes-support/attr/ea-acl.inc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-support/attr/ea-acl.inc b/meta/recipes-support/attr/ea-acl.inc index

[OE-core] [PATCH 0/5] improve reproducibility of several packages

2018-01-04 Thread Juro Bystricky
The patches in this patch set are independent and can be applied in any order/subset. They all allow building binary reproducible packages if built on the same host. This is accomplished mostly by removing various buil dhost information leaks or useless timestams. Juro Bystricky (5): python3

[OE-core] [PATCH 1/5] python3-dev: improve reproducibility

2018-01-04 Thread Juro Bystricky
Remove remaining build host references from packaged files. [#YOCTO 11472] Signed-off-by: Juro Bystricky --- meta/recipes-devtools/python/python3_3.5.3.bb | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/recipes-devtools/python/python3_3.5.3.bb b/meta/recipes-devtools/python

[OE-core] [PATCH v2] package_rpm.bbclass: clamp timestamps

2018-01-04 Thread Juro Bystricky
Improve binary reproducibility of RPM packages. Ensure timestamps in RPM packages are not later than the value of SOURCE_DATE_EPOCH. If SOURCE_DATE_EPOCH is not set, timestamps are not clamped. Signed-off-by: Juro Bystricky --- meta/classes/package_rpm.bbclass | 1 + 1 file changed, 1 insertion

[OE-core] [PATCH 0/1] rpm_4.14.0: clamp timestamps

2018-01-02 Thread Juro Bystricky
ldhost" which should be used to define some kind of a "standard" buildhost name in order to improve reproducibility. (Otherwise, I think, buildost is taken from /etc/hosts). But that's a subject of a separate patch. Juro Bystricky (1): rpm_4.14.0: clamp timestamps by default ...

[OE-core] [PATCH 1/1] rpm_4.14.0: clamp timestamps by default

2018-01-02 Thread Juro Bystricky
Improve reproducibility by making sure that timestamps in built rpms are not later than the value of SOURCE_DATE_EPOCH as found in the environment. Timestamps as usual when SOURCE_DATE_EPOCH is not set. [YOCTO #12425] Signed-off-by: Juro Bystricky --- .../recipes-devtools/rpm/files/0001

[OE-core] [PATCH 1/4] compiler-options.bbclass: provide and validate options

2017-12-13 Thread Juro Bystricky
As we may be using external toolchains, we cannot assume various compiler options to be valid. Signed-off-by: Juro Bystricky --- meta/classes/compiler-options.bbclass | 24 1 file changed, 24 insertions(+) create mode 100644 meta/classes/compiler-options.bbclass diff

[OE-core] [PATCH 2/4] kernel.bbclass: use class compiler-options

2017-12-13 Thread Juro Bystricky
We use gcc option "-ffile-prefix-map" if available. Remove the local code that detects the availability of this compiler option (get_cc_option) and use a more generic code imported from compiler-option.bbclass. Signed-off-by: Juro Bystricky --- meta/classes/kernel.bb

[OE-core] [PATCH 3/4] module.bbclass: improve reproducibility

2017-12-13 Thread Juro Bystricky
Use gcc option "-ffile-prefix-map" if available. This will remap any hard-coded __FILE__ containing build host path to a reproducible value, with the absolute build-host path stripped. Signed-off-by: Juro Bystricky --- meta/classes/module.bbclass | 5 +++-- 1 file changed, 3 insert

[OE-core] [PATCH 4/4] pulseaudio: improve reproducibility

2017-12-13 Thread Juro Bystricky
. Take care of any embedded __FILE__ strings, but only if the compiler supports -ffile-prefix-map option. Signed-off-by: Juro Bystricky --- .../pulseaudio/pulseaudio/no-builddir.patch| 74 ++ .../pulseaudio/pulseaudio_11.1.bb | 12 +++- 2 files

[OE-core] [PATCH 0/4] Refactor usage of gcc -ffile-prefix-map

2017-12-13 Thread Juro Bystricky
er-options in a recipe. Juro Bystricky (4): compiler-options.bbclass: provide and validate options kernel.bbclass: use class compiler-options module.bbclass: improve reproducibility pulseaudio: improve reproducibility meta/classes/compiler-options.bbclass | 24 +++ me

[OE-core] [PATCH] ltp: improve reproducibility

2017-11-22 Thread Juro Bystricky
ltp package contains several gzipped files. Improve reproducibility of the build by ensuring the gzipped files do not contain timestamps in their headers. https://wiki.debian.org/ReproducibleBuilds/TimestampsInGzipHeaders Signed-off-by: Juro Bystricky --- .../ltp/ltp/0038-generate-reproducible

[OE-core] [PATCH 2/4] grub-efi_2.02.bb: improve reproducibility

2017-11-16 Thread Juro Bystricky
Remove several build host references from modinfo.sh files. Signed-off-by: Juro Bystricky --- meta/recipes-bsp/grub/grub-efi_2.02.bb | 10 ++ 1 file changed, 10 insertions(+) diff --git a/meta/recipes-bsp/grub/grub-efi_2.02.bb b/meta/recipes-bsp/grub/grub-efi_2.02.bb index b949beb

[OE-core] [PATCH 1/4] gnutls: improve reproducibility

2017-11-16 Thread Juro Bystricky
HELL "bash" With this change we can build reproducible libgnutls-bin, libgnutls-dev and libgnutls-dbg packages. Signed-off-by: Juro Bystricky --- meta/recipes-support/gnutls/gnutls.inc | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/recipes-support/gnutls/gnutls.inc b/

[OE-core] [PATCH 3/4] x11perf: improve reproducibility

2017-11-16 Thread Juro Bystricky
Remove build host refeences. Signed-off-by: Juro Bystricky --- meta/recipes-graphics/xorg-app/x11perf_1.6.0.bb | 4 1 file changed, 4 insertions(+) diff --git a/meta/recipes-graphics/xorg-app/x11perf_1.6.0.bb b/meta/recipes-graphics/xorg-app/x11perf_1.6.0.bb index 4e93558..a06aa26 100644

[OE-core] [PATCH 4/4] sudo: improve reproducibility

2017-11-16 Thread Juro Bystricky
an as root. Signed-off-by: Juro Bystricky --- meta/recipes-extended/sudo/sudo.inc | 6 ++ 1 file changed, 6 insertions(+) diff --git a/meta/recipes-extended/sudo/sudo.inc b/meta/recipes-extended/sudo/sudo.inc index 8c16d83..80ec0ae 100644 --- a/meta/recipes-extended/sudo/sudo.inc +++ b/me

[OE-core] [PATCH 0/4] improve reproducibility of several packages

2017-11-16 Thread Juro Bystricky
These are independent patches with the same theme: leaking build host information in various distributed files. Juro Bystricky (4): gnutls: improve reproducibility grub-efi_2.02.bb: improve reproducibility x11perf: improve reproducibility sudo: improve reproducibility meta/recipes-bsp

[OE-core] [PATCH] curl_7.54.1.bb: improve reproducibility

2017-10-30 Thread Juro Bystricky
Improve reproducible build of curl-dev and curl-dbg packages. curl-dev: Correctly remove build host references from curl-config curl-dbg: Do not generate time stamps in files generated by mkhelp.pl Signed-off-by: Juro Bystricky --- .../curl/curl/reproducible-mkhelp.patch| 32

[OE-core] [PATCH] e2fsprogs-ptest: improve reproducibility

2017-10-25 Thread Juro Bystricky
Remove several Makefiles containing build host references. While at it, also remove some additional files not needed for testing. Signed-off-by: Juro Bystricky --- meta/recipes-devtools/e2fsprogs/e2fsprogs_1.43.5.bb | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/recipes-devtools

[OE-core] [PATCH] gobject-introspection: improve reproducibility

2017-10-24 Thread Juro Bystricky
Remove cross-compiler wrappers from the package, these contain numerous build host references. The wrappers are only needed for cross-compiling. [YOCTO #11705] Signed-off-by: Juro Bystricky --- .../gobject-introspection/gobject-introspection_1.52.1.bb| 9 + 1 file changed, 9

[OE-core] [PATCH v2] gmp-6.1.2: add ptest support

2017-10-24 Thread Juro Bystricky
GMP library contains code highly optimized for the host processor. The test suite for GMP is considered critical. GMP is heavily used in cryptography, internet security applications, GCC..., etc. Therefore it is only prudent to have a test suite available. Signed-off-by: Juro Bystricky

[OE-core] [PATCH] gmp-6.1.2: add ptest support

2017-10-24 Thread Juro Bystricky
GMP library contains code highly optimized for the host processor. The test suite for GMP is considered critical. GMP is heavily used in cryptography, internet security applications, GCC..., etc. Therefore it is only prudent to have a test suite available. Signed-off-by: Juro Bystricky

[OE-core] [PATCH 1/1] util-linux-ptest: various fixes

2017-10-18 Thread Juro Bystricky
iled tests that were previously missing. By the virtue of not copying the libtools scripts we also managed the achieve binary reproducible package, as previously leaked build host info was contained in libtool scripts, which are not copied anymore. [YOCTO #10953] Signed-off-by: Juro Bystricky

[OE-core] [PATCH 0/1] util-linux-ptest fixes

2017-10-18 Thread Juro Bystricky
--install /bin/kill kill /bin/kill/kill.util-linux 300 We will pass all "kill" tests as well, so we end up with only 7 failing tests. There are about 59 tests that are skipped because some components are not installed in core-image-sato-sdk-ptest. (i.e. dmsetup, mdadm, scsi_debug

[OE-core] [PATCH] nettle-ptest: fix a failing test

2017-10-13 Thread Juro Bystricky
test +program can find it. +Relative paths are not suitable, as the folder strucure for ptest +is different from the one expected by the nettle testsuite. + +Upstream-Status: Inappropriate [embedded specific] + +Signed-off-by: Juro Bystricky + +--- a/testsuite/dlopen-test.c 2016-10-01 00:28

[OE-core] [PATCH] gawk-ptest: fix a failing test

2017-10-13 Thread Juro Bystricky
This patch changes the result of the "include" test from FAIL to PASS. The test used to fail as the test prerequisite was missing. This was the only test out of 298 that used to fail. Signed-off-by: Juro Bystricky --- meta/recipes-extended/gawk/gawk_4.1.4.bb | 2 +- 1 file changed, 1

[OE-core] [PATCH] e2fsprogs: modify ptest script

2017-10-06 Thread Juro Bystricky
t; based on the actual test results. Aditionally, remove various files created by the testsuite. [YOCTO #12146] Signed-off-by: Juro Bystricky --- meta/recipes-devtools/e2fsprogs/e2fsprogs/run-ptest | 15 +++ 1 file changed, 7 insertions(+), 8 deletions(-) diff --git a/meta/r

[OE-core] [PATCH] bash-ptest: install additional locales

2017-10-05 Thread Juro Bystricky
bash-ptest fails several tests. This patch fixes: FAIL: run-intl The test used to fail because of missing locales (fr_FR, de_DE) [YOCTO #12145] Signed-off-by: Juro Bystricky --- meta/recipes-extended/bash/bash.inc | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/recipes-extended

[OE-core] [PATCH] python-ptest: various fixes

2017-10-05 Thread Juro Bystricky
python-ptest needs python-tests package installed in order to run any tests. This patch adds python-tests as a runtime dependency, so the test suite will be present in the image. While in there, also removed several build host references. [YOCTO #12144] Signed-off-by: Juro Bystricky --- meta

[OE-core] [PATCH v2] siteinfo: nios2-linux - remove wrong mutex info

2017-10-03 Thread Juro Bystricky
remove the incorrect cached entry and let db "configure" figure out which is the proper mutex to use. Signed-off-by: Juro Bystricky --- meta/site/nios2-linux | 1 - 1 file changed, 1 deletion(-) diff --git a/meta/site/nios2-linux b/meta/site/nios2-linux index 2f4e570..5bae748 100644 -

[OE-core] [PATCH] siteinfo: nios2-linux - remove wrong mutex info

2017-10-03 Thread Juro Bystricky
This fixes broken nios2 builds that involve db recipes. Signed-off-by: Juro Bystricky --- meta/site/nios2-linux | 1 - 1 file changed, 1 deletion(-) diff --git a/meta/site/nios2-linux b/meta/site/nios2-linux index 2f4e570..5bae748 100644 --- a/meta/site/nios2-linux +++ b/meta/site/nios2-linux

[OE-core] [PATCH] grub_2.02.bb: improve reproducibility

2017-09-25 Thread Juro Bystricky
Remove several build host references from modinfo.sh files. Signed-off-by: Juro Bystricky --- meta/recipes-bsp/grub/grub_2.02.bb | 7 +++ 1 file changed, 7 insertions(+) diff --git a/meta/recipes-bsp/grub/grub_2.02.bb b/meta/recipes-bsp/grub/grub_2.02.bb index 57c6559..b8055e7 100644

[OE-core] [PATCH 0/3] libxml2-ptest: various fixes

2017-09-25 Thread Juro Bystricky
failures. With these fixes we get 133 tests passed, 0 failed. (Previously it was 36 passed 3 failed, or something like that) Juro Bystricky (3): libxml2-ptest: improve reproducibility libxml2-ptest: support for encoding ISO-8859-5 libxml2-ptest: set LC_ALL=en_US.UTF-8 meta/recipes-core

[OE-core] [PATCH 1/3] libxml2-ptest: improve reproducibility

2017-09-25 Thread Juro Bystricky
Remove various build host references from libxml-ptest package. [YOCTO #11997] Signed-off-by: Juro Bystricky --- meta/recipes-core/libxml/libxml2_2.9.4.bb | 11 +++ 1 file changed, 11 insertions(+) diff --git a/meta/recipes-core/libxml/libxml2_2.9.4.bb b/meta/recipes-core/libxml

[OE-core] [PATCH 2/3] libxml2-ptest: support for encoding ISO-8859-5

2017-09-25 Thread Juro Bystricky
This fixes the error: ./test/errors/759398.xml:1: parser error : Unsupported encoding ISO-8859-5 ^ ./test/errors/759398.xml : failed to parse FAIL: Error cases stream regression tests Signed-off-by: Juro Bystricky --- meta/recipes-core/libxml

[OE-core] [PATCH 3/3] libxml2-ptest: set LC_ALL=en_US.UTF-8

2017-09-25 Thread Juro Bystricky
We need to specify UTF-8 in the environment to avoid an error such as: UnicodeEncodeError: 'ascii' codec can't encode character '\xe4' Signed-off-by: Juro Bystricky --- meta/recipes-core/libxml/libxml2/run-ptest | 1 + 1 file changed, 1 insertion(+) diff --git a

[OE-core] [PATCH] strace_4.18.bb: improve reproducibility

2017-09-20 Thread Juro Bystricky
Remove build host references from strace-ptest package. Also removed some unneeded timestaps. Signed-off-by: Juro Bystricky --- meta/recipes-devtools/strace/strace_4.18.bb | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/meta/recipes-devtools/strace/strace_4.18.bb

[OE-core] [PATCH] gzip_1.8.bb: improve reproducibility

2017-09-20 Thread Juro Bystricky
Remove build host references from gzip-ptest package. Signed-off-by: Juro Bystricky --- meta/recipes-extended/gzip/gzip_1.8.bb | 4 1 file changed, 4 insertions(+) diff --git a/meta/recipes-extended/gzip/gzip_1.8.bb b/meta/recipes-extended/gzip/gzip_1.8.bb index a0dec14..d093207 100644

[OE-core] [PATCH 1/1] gcc-6.3.inc: Use ucontext_t not struct ucontext.

2017-09-14 Thread Juro Bystricky
ucontext_t instead. This is similar to the removal of the struct siginfo tag from siginfo_t some years ago. Backport of patches by Joseph Myers, taken from https://gcc.gnu.org/viewcvs/gcc?limit_changes=0&view=revision&revision=249957 [YOCTO #12083] Signed-off-by: Juro Bystricky --- meta

[OE-core] [PATCH 0/1] gcc 6.3 with glib 2.26

2017-09-14 Thread Juro Bystricky
When one chooses to use gcc 6.3 with GCCVERSION = "6.3%" bitbake libgcc fails. This patch fixes building this particular issue. However, there is at least one more recipe that fails with gcc 6.3 (mesa_17.1.7.bb). Juro Bystricky (1): gcc-6.3.inc: Use ucontext_t not struct uconte

[OE-core] [PATCH] qemurunner.py: wait for PID to appear in procfs

2017-09-12 Thread Juro Bystricky
We need QEMU PID in order to access "/proc//cmdline" Having a valid QEMU PID does not mean we can access the proc entry immediately, we need to wait for the /proc/ to appear before we can access it. Signed-off-by: Juro Bystricky --- meta/lib/oeqa/utils/qemurunner.py | 7 --- 1 fi

[OE-core] [PATCH 1/1] qemurunner.py: refactor searching for QEMU PID

2017-09-06 Thread Juro Bystricky
Ask QEMU to store the QEMU process PID in a file, this way we don't have to parse running processes and analyze descendents. This is done via QEMU command line argument "-pidfile". [YOCTO #12001] Signed-off-by: Juro Bystricky --- meta/lib/oeqa/utils/qemu

[OE-core] [PATCH 0/1] qemurunner.py: simplify search for QEMU PID

2017-09-06 Thread Juro Bystricky
ents of the file and reports the value (PID). The file containing the qemu PIDis deleted after qemurunner terminates. The patch was tested with : $ bitbake core-image-sato -c testimage $ oe-selftest --all Juro Bystricky (1): qemurunner.py: refactor searching for QEMU PID

[OE-core] [PATCH] qemu: upgrade to version 2.10.0

2017-08-31 Thread Juro Bystricky
Remove recipes for older versions. Remove patches no longer needed. Modify the patch "add-ptest-in-makefile.patch" for version 2.10.0 Signed-off-by: Juro Bystricky --- ...0001-osdep-Add-runtime-OFD-lock-detection.patch | 141 ...e-posix-Do-runtime-check-for-ofd-lock-API.p

[OE-core] [PATCH 5/8] package_manager.py: improve reproducibility

2017-08-28 Thread Juro Bystricky
When creating Packages.gz, do not save the time stamp in the compressed file metadata. Signed-off-by: Juro Bystricky --- meta/lib/oe/package_manager.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oe/package_manager.py b/meta/lib/oe/package_manager.py index

[OE-core] [PATCH 8/8] qemuboot.bbclass: create deterministic qemuboot.conf file

2017-08-28 Thread Juro Bystricky
The lines in qemuboot.conf are in random order. This patch fixes this by printing the lines in sorted order. This makes it easier to compare two different builds for any differences. Signed-off-by: Juro Bystricky --- meta/classes/qemuboot.bbclass | 2 +- 1 file changed, 1 insertion(+), 1

[OE-core] [PATCH 7/8] image_types.bbclass: improve reproducibility of .gz files

2017-08-28 Thread Juro Bystricky
When compressing with "gzip", do not save the time stamp in the compressed file metadata. Signed-off-by: Juro Bystricky --- meta/classes/image_types.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes/image_types.bbclass b/meta/classes/image_typ

[OE-core] [PATCH 3/8] flex_2.6.0.bb: remove build host references

2017-08-28 Thread Juro Bystricky
Remove build host references from flex-ptest package. [YOCTO #11667] Signed-off-by: Juro Bystricky --- meta/recipes-devtools/flex/flex_2.6.0.bb | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/meta/recipes-devtools/flex/flex_2.6.0.bb b/meta/recipes-devtools/flex

[OE-core] [PATCH 6/8] eudev_3.2.2: improve reproducibility

2017-08-28 Thread Juro Bystricky
Remove all host build references from the eudev-dbg package Signed-off-by: Juro Bystricky --- meta/recipes-core/udev/eudev_3.2.2.bb | 6 ++ 1 file changed, 6 insertions(+) diff --git a/meta/recipes-core/udev/eudev_3.2.2.bb b/meta/recipes-core/udev/eudev_3.2.2.bb index 47d958b..fcadfa3

[OE-core] [PATCH 4/8] diffutils_3.6.bb: remove build host references

2017-08-28 Thread Juro Bystricky
Remove build host references from diffutils-ptest package. Signed-off-by: Juro Bystricky --- meta/recipes-extended/diffutils/diffutils_3.6.bb | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/meta/recipes-extended/diffutils/diffutils_3.6.bb b/meta/recipes-extended

[OE-core] [PATCH 1/8] zlib_1.2.11.bb: remove build host references

2017-08-28 Thread Juro Bystricky
Remove build host references from libz-ptest package. [YOCTO #11668] Signed-off-by: Juro Bystricky --- meta/recipes-core/zlib/zlib_1.2.11.bb | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/recipes-core/zlib/zlib_1.2.11.bb b/meta/recipes-core/zlib/zlib_1.2.11.bb index ba216f67

[OE-core] [PATCH 0/8] reproducibility fixes

2017-08-28 Thread Juro Bystricky
Various simple patches that eliminate buildhost references from several packages and improve the reproducibility/determinism when building package/images. Juro Bystricky (8): zlib_1.2.11.bb: remove build host references bash.inc: improve reproducibility flex_2.6.0.bb: remove build host

[OE-core] [PATCH 2/8] bash.inc: improve reproducibility

2017-08-28 Thread Juro Bystricky
Remove all host build references from the following bash packages: bash-ptest, bash-bashbug, bash-dev, bash-loadable. [YOCTO #11918] Signed-off-by: Juro Bystricky --- meta/recipes-extended/bash/bash.inc | 22 +++--- 1 file changed, 19 insertions(+), 3 deletions(-) diff --git a

  1   2   3   >