Re: No more update on stable/12

[Li-Wen Hsu]

On Wed, Dec 30, 2020 at 17:33 Yasuhiro Kimura  wrote:

> From: Peter Blok 
> Subject: No more update on stable/12
> Date: Wed, 30 Dec 2020 10:24:27 +0100
>
> > I switched to git, but I noticed there were no MFC or any other updates
> over the last couple of days after the migration. git fetch doesn’t show
> any change.
> >
> > Is this correct and just the learning process of git or is something
> wrong with my git clone?
>
> Which repository do you use?. Currently new canonical src repository
> (https://git.freebsd.org/src.git) is updated but not mirrored to
> GitHub yet.


Supported stable and releng branches will have git2svn exporters to keep
sync with git through their supporting life cycle.  I’m sorry the progress
is delayed, but it will be staring syncing soon.

Best,
Li-Wen

>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

Re: No more update on stable/12

[Li-Wen Hsu]

On Wed, Dec 30, 2020 at 17:44 Li-Wen Hsu  wrote:

> On Wed, Dec 30, 2020 at 17:33 Yasuhiro Kimura  wrote:
>
>> From: Peter Blok 
>> Subject: No more update on stable/12
>> Date: Wed, 30 Dec 2020 10:24:27 +0100
>>
>> > I switched to git, but I noticed there were no MFC or any other updates
>> over the last couple of days after the migration. git fetch doesn’t show
>> any change.
>> >
>> > Is this correct and just the learning process of git or is something
>> wrong with my git clone?
>>
>> Which repository do you use?. Currently new canonical src repository
>> (https://git.freebsd.org/src.git) is updated but not mirrored to
>> GitHub yet.
>
>
> Supported stable and releng branches will have git2svn exporters to keep
> sync with git through their supporting life cycle.  I’m sorry the progress
> is delayed, but it will be staring syncing soon.
>

And GitHub mirror will also be sync’d again soon after we completed the
repository adjustment. For now please get the latest changes of stable
branches from git.FreeBSD.org or other mirrors at GitLab and Codeberg.

Best,
Li-Wen

>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

Re: iPhone tethering not working

[Li-Wen Hsu]

On Sun, Apr 25, 2021 at 10:00 AM 宋立杰 via freebsd-stable
 wrote:
>
>
> I tried to connect my iPhone SE2 (iOS 13.7) to FreeBSD 12.2-stable. After 
> loaded the kernel module if_ipheth, I connected my phone.
> > ugen0.2:  at usbus0
>
> Then I typed usbconfig -u 0 -a 2 set_config 3
> > ipeth0 on uhub6
> > Ipeth0:  on usbus0
> Then I chose to trust the computer, but nothing happened. My computer still 
> can’t get to the internet.
>
> This is ifconfig ue0 output:
>
> > ue0: flags=8843 metric 0 mtu 1500
> > ether 
> > nd6 options=29
>
> I tried dhclient ue0, but got no reply from iPhone. What can I do?

I didn't see behavior before, previously if there is no ue0 found,
other than usbconfig set_config, I use `/usr/local/sbin/usbmuxd -U
root -f` from usbmuxd pkg.

For iOS 14, this patch is needed
https://cgit.freebsd.org/src/commit/?id=2076350d801b81f570850cea7e701388d8709cfb
but from the report it still compatiable for iOS 13. I'm not sure if
reverting it helps or not.

Does it work with previous versions (12.2-RELEASE, 13.0-RELEASE, or
older 12.2-STABLE), or other OS?

Best,
Li-Wen
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

Re: iPhone tethering not working

[Li-Wen Hsu]

On Sun, Apr 25, 2021 at 9:55 PM 宋立杰  wrote:
>
>
> > 在 2021年4月25日，19:08，Li-Wen Hsu  写道：
> >
> > 
> >
> > I didn't see behavior before, previously if there is no ue0 found,
> > other than usbconfig set_config, I use `/usr/local/sbin/usbmuxd -U
> > root -f` from usbmuxd pkg.
> >
> > For iOS 14, this patch is needed
> > https://cgit.freebsd.org/src/commit/?id=2076350d801b81f570850cea7e701388d8709cfb
> > but from the report it still compatiable for iOS 13. I'm not sure if
> > reverting it helps or not.
> >
> > Does it work with previous versions (12.2-RELEASE, 13.0-RELEASE, or
> > older 12.2-STABLE), or other OS?
> >
> > Best,
> > Li-Wen
>
> Yes, there is no ue0. And I made a mistake, it is 12.2-RELEASE other than 
> STABLE. Sorry for that. Do I need to install STABLE to keep up with the 
> newest development?
>
> This time usbmuxd works, but why it has to run in foreground? And what’s the 
> difference to usb_config?
> And running in background, I can get DHCP offer this time, but I still can’t 
> ping to any website, “The network is down”. Why?
>
> Best wishes,
> A BSD newbie

Please don't forget CC the list unless there is sensitive information,
the discussion may also help others.

For iOS 14, that patch is needed so if Apple did the same change in
the newer iOS 13 branch, upgrading to 12.2-STABLE is necessary. You
can also upgrade to 13.0-RELEASE if you want to keep tracking
-RELEASE.

You can exit usbmuxd when you see ue0 is available. TBH I don't check
the details in those tools.

If you can get an IP from DHCP, but cannot do any transmission, that's
exactly the same behavior on iOS 14 without that patch so upgrading to
a newer version might help.

Best,
Li-Wen
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

Re: iPhone tethering not working

[Li-Wen Hsu]

On Mon, Apr 26, 2021 at 8:34 PM 宋立杰  wrote:

>
> > 在 2021年4月25日，23:04，Li-Wen Hsu  写道：
> >
> > On Sun, Apr 25, 2021 at 9:55 PM 宋立杰  wrote:
> >>
> >> Yes, there is no ue0. And I made a mistake, it is 12.2-RELEASE other
> than STABLE. Sorry for that. Do I need to install STABLE to keep up with
> the newest development?
> >>
> >> This time usbmuxd works, but why it has to run in foreground? And
> what’s the difference to usb_config?
> >> And running in background, I can get DHCP offer this time, but I still
> can’t ping to any website, “The network is down”. Why?
> >>
> >> Best wishes,
> >> A BSD newbie
> >
> > Please don't forget CC the list unless there is sensitive information,
> > the discussion may also help others.
> >
> > For iOS 14, that patch is needed so if Apple did the same change in
> > the newer iOS 13 branch, upgrading to 12.2-STABLE is necessary. You
> > can also upgrade to 13.0-RELEASE if you want to keep tracking
> > -RELEASE.
> >
> > You can exit usbmuxd when you see ue0 is available. TBH I don't check
> > the details in those tools.
> >
> > If you can get an IP from DHCP, but cannot do any transmission, that's
> > exactly the same behavior on iOS 14 without that patch so upgrading to
> > a newer version might help.
> >
> > Best,
> > Li-Wen
>
> Sorry, I made another mistake 😂, this is my first time to use a mailing
> list.
>

That's OK, welcomed to the community. :-)


> Applying the 12.2-RELEASE-p6 patch doesn’t seem to work, how can I
> transfer to 12.2-STABLE?
>

-RELEASE only receive security and errata fixes, I'm not really sure that
patch should be in errata. But if others think it's worthy, I can try to do
so.

This doc should help, if there is any unclear, please report and help us
update it:

https://docs.freebsd.org/en/books/handbook/cutting-edge/#current-stable

Or you can just apply that patch to 12.2-RELEASE's source and rebuild the
if_ipheth.ko module to test, if that's easier for you.

Also, using 13.0-RELEASE might be easier to install and test. Please
consider this route if you don't have a special reason to stay with 12.

Best,
Li-Wen
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2018-01-20

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2018-01-20
===

Here's a summary of the FreeBSD Continuous Integration results for the
period from 2018-01-14 to 2018-01-20 (and some older results because
this is the first report).

During this period, we have 1961 builds (89.8% pass, 8.7% failed, 1.5%
exception) were executed on aarch64, amd64, armv6, armv7, i386, mips,
mips64, powerpc, powerpc64, powerpcspe, riscv64, sparc64 architectures;
and 496 test runs (51% pass, 49% unstable) were executed on amd64, i386,
riscv64 architectures.

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

Web version and archive are available at
http://hackfoldr.org/freebsd-ci-report/
Any help and suggestion are welcome.

## Failing Jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
Test VM panics because of memory modified after free, see
https://bugs.freebsd.org/235097 for more details.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
See https://bugs.freebsd.org/235097

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
GCC reports: `error: floating constant exceeds range of 'long double'
[-Werror=overflow]`


## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.msun.cbrt_test.cbrtl_powl
* lib.msun.trig_test.reduction
See https://bugs.freebsd.org/234040 for detail

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
  There are 63 failing cases, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
  for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.buffering.t_dtrace_contrib.tst_switch1_d
* common.drops.t_dtrace_contrib.drp_DTRACEDROP_PRINCIPAL_d
* common.syscall.t_dtrace_contrib.tst_args_d
* common.usdt.t_dtrace_contrib.tst_dlclose1_ksh
* common.rates.t_dtrace_contrib.tst_switchrate_dl
* common.misc.t_dtrace_contrib.tst_dynopt_d
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* sbin.bectl.bectl_test.bectl_mount
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)


## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
https://bugs.freebsd.org/211924

* sys.fs.tmpfs.mount_test.large
https://bugs.freebsd.org/212862

* sys.fs.tmpfs.link_test.kqueue
https://bugs.freebsd.org/213662

* sys.kqueue.libkqueue.kqueue_test.main
https://bugs.freebsd.org/233586

* usr.bin.procstat.procstat_test.command_line_arguments
https://bugs.freebsd.org/233587

* usr.bin.procstat.procstat_test.environment
https://bugs.freebsd.org/233588


## Open Issues

### New
* 235097: ci runs failing with panic in IPv6 code with use-after-free in
  epair/pfctl when running sys/netpfil/pf/nat tests
  https://bugs.freebsd.org/235097

### Cause build fails
* 29: genassym.o build race
  https://bugs.freebsd.org/29

### Others
Tickets related to testing@: https://preview.tinyurl.com/y9maauwg


## Other news

* We've started working on integrating FreeBSD CI into upstream projects
  via hosted services (in particular, to date that's Cirrus-CI).
  Progress is tracked on https://wiki.freebsd.org/HostedCI

* Result of daily Clang scan build:
  
https://ci.freebsd.org/job/FreeBSD-head-scan_build/lastCompletedBuild/clangScanBuildBugs/


-- 
Li-Wen Hsu 
https://lwhsu.org
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-01-27

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-01-27
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-01-21 to 2019-01-27.

During this period, we have:

* 2429 builds (91.2% pass, 7.3% failed, 1.5% exception) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 481 test runs (7.7% pass, 60% unstable, 15.6% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 10 doc buils (100% pass)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

Web version of this report is available at https://hackmd.io/s/SkFyq6bmN and
archive is available at http://hackfoldr.org/freebsd-ci-report/, any help is
welcome.

## Failing Jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
GCC reports `error: floating constant exceeds range of 'long double'
[-Werror=overflow]`

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* All are lib.libc.sys.sendfile_test.* and see
  https://bugs.freebsd.org/235200 for deails

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.misc.t_dtrace_contrib.tst_dynopt_d
* common.syscall.t_dtrace_contrib.tst_args_d
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are 63 failing cases, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
  for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* Other 20 are lib.libc.sys.sendfile_test.* and see
  https://bugs.freebsd.org/235200 for deails

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* sbin.bectl.bectl_test.bectl_mount
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
https://bugs.freebsd.org/211924

* sys.fs.tmpfs.mount_test.large
https://bugs.freebsd.org/212862

* sys.fs.tmpfs.link_test.kqueue
https://bugs.freebsd.org/213662

* sys.kqueue.libkqueue.kqueue_test.main
https://bugs.freebsd.org/233586

* usr.bin.procstat.procstat_test.command_line_arguments
https://bugs.freebsd.org/233587

* usr.bin.procstat.procstat_test.environment
https://bugs.freebsd.org/233588

* lib.msun.{cbrt_test.cbrtl_powl,trig_test.reduction}
https://bugs.freebsd.org/234040

## Open Issues

### New

* [235200: lib.libc.sys.sendfile_test.* fail](https://bugs.freebsd.org/235200)
* Patch available: https://reviews.freebsd.org/D19026

### Inprogress

* https://bugs.freebsd.org/235097
* Patch committed: https://svnweb.freebsd.org/changeset/base/343418

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Closed Issues

Works fine in the new CI infrastructure:
* https://bugs.freebsd.org/197600
* https://bugs.freebsd.org/200312
* https://bugs.freebsd.org/219759
* https://bugs.freebsd.org/219874

## Other news

* We still have 44 skipped tests in head-amd64, some of them because of test
  environment.  See
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/lastCompletedBuild/testReport/
  for details.
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-02-03

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-02-03
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-01-28 to 2019-02-03.

During this period, we have:

* 2220 builds (93.7% passed, 6.2% failed, 0.1% exception) were
executed on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc,
powerpc64, powerpcspe, riscv64, sparc64 architectures for building
world, GENERIC and LINT kernel of head, stable/12, stable/11 branches.
* 565 test runs (25.7% passed, 69.2% unstable, 5.1% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 7 doc buils (85.8% passed, 14.2% failed)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

Web version of this report is available at
https://hackmd.io/s/B1CMKdJNE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
  after r343713 (Enable COVERAGE and KCOV by default on arm64 and
amd64.), the test VM exits while executing dtrace test cases.

## Fixed Jobs
* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/8765/
* Fixed/workarounded by
* https://svnweb.freebsd.org/changeset/base/343670
* https://svnweb.freebsd.org/changeset/base/343671
* https://svnweb.freebsd.org/changeset/base/343672
* See also: https://bugs.freebsd.org/130067

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libc.sys.sendfile_test.hdtr_positive_v4
* lib.libc.sys.sendfile_test.hdtr_positive_v6
  see https://bugs.freebsd.org/235200 and
https://bugs.freebsd.org/234809 for deails

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are 61 (-3 since last report) failing cases, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.hdtr_positive_v4
* lib.libc.sys.sendfile_test.hdtr_positive_v6
  see https://bugs.freebsd.org/235200 and
https://bugs.freebsd.org/234809 for deails

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.msun.{cbrt_test.cbrtl_powl,trig_test.reduction}
  https://bugs.freebsd.org/234040

## Open Issues

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Closed Issues

* [235097: ci runs panic with use-after-free when running
sys/netpfil/pf/nat tests](https://bugs.freebsd.org/235097)
* patch committed (https://svnweb.freebsd.org/changeset/base/343418) and
  MFC to 12 (https://svnweb.freebsd.org/changeset/base/343652) and
  11 (https://svnweb.freebsd.org/changeset/base/343653)
* [235411: sys.netpfil.pf.fragmentation.v6 panics after
r343631](https://bugs.freebsd.org/235411)
* Fixed in https://svnweb.freebsd.org/changeset/base/343678

## Other News

* Facebook's zstd has FreeBSD CI integrated with Cirrus CI:
https://github.com/facebook/zstd/pull/1501

* We have a job does lint check the doc with
[igor](https

FreeBSD CI Weekly Report 2019-02-10

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-02-10
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-02-04 to 2019-02-10.

During this period, we have:

* 2564 builds (97.4% passed, 2.6% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 546 test runs (21.2% passed, 63.4% unstable, 15.4% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 12 doc buils (100% passed)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

Web version of this report is available at
https://hackmd.io/s/ryA8Crr4N and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test
  r343713 enabled COVERAGE and KCOV by default causes the test VM
exits while executing dtrace test cases, it then got disabled by
r343949.

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc
  Error message: `x86_64-unknown-freebsd12.0-gcc: error: unrecognized
command line option '-fsanitize-coverage=trace-pc,trace-cmp'; did you
mean '-fsanitize-coverage=trace-pc'?`
  Fixed in : https://svnweb.freebsd.org/changeset/base/343746

## Fixed Tests

* lib.msun.{cbrt_test.cbrtl_powl,trig_test.reduction}
* https://bugs.freebsd.org/234040
* https://svnweb.freebsd.org/changeset/base/343916
* https://svnweb.freebsd.org/changeset/base/343917

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libc.sys.sendfile_test.hdtr_positive_v4
* lib.libc.sys.sendfile_test.hdtr_positive_v6
  See https://bugs.freebsd.org/235200 and
https://bugs.freebsd.org/234809 for deails.
  WIP: https://bugs.freebsd.org/234809
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
  These two began failing since r343964, further examination is needed.

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are 60 (-1 since last report) failing cases, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.hdtr_positive_v4
* lib.libc.sys.sendfile_test.hdtr_positive_v6
  see https://bugs.freebsd.org/235200 and
https://bugs.freebsd.org/234809 for deails.
  WIP: https://bugs.freebsd.org/234809

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* (Updated) patch available:
https://people.freebsd.org/~bdrewery/patches/PR29.diff
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/1131/
  zfs test became very slow (~100 mins -> ~200 mins) after enabling
COVERAGE and KCOV by default (then disabled in r343949)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-s

FreeBSD CI Weekly Report 2019-02-17

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-02-17
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-02-11 to 2019-02-17.

During this period, we have:

* 2348 builds (93.4% passed, 6.6% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 553 test runs (23.7% passed, 73.6% unstable, 2.7% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 12 doc buils (100% passed)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

Web version of this report is available at
https://hackmd.io/s/By8HaYcSV and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
  These two began failing since r343964 and do not show up after r344128.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libc.sys.sendfile_test.hdtr_positive_v4
* lib.libc.sys.sendfile_test.hdtr_positive_v6
  See https://bugs.freebsd.org/235200 and
https://bugs.freebsd.org/234809 for deails.
  WIP: https://bugs.freebsd.org/234809

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.hdtr_positive_v4
* lib.libc.sys.sendfile_test.hdtr_positive_v6
  see https://bugs.freebsd.org/235200 and
https://bugs.freebsd.org/234809 for deails.
  WIP: https://bugs.freebsd.org/234809

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* Patch available:
https://people.freebsd.org/~bdrewery/patches/PR29.diff
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* QEMU has onboarded FreeBSD CI: https://cirrus-ci.com/github/qemu/qemu
* New clang800-import project jobs added:
* https://ci.freebsd.org/job/FreeBSD-srcproj-clang800-import-aarch64-build/
* https://ci.freebsd.org/job/FreeBSD-srcproj-clang800-import-amd64-build/
* https://ci.freebsd.org/job/FreeBSD-srcproj-clang800-import-amd64-test/
* https://ci.freebsd.org/job/FreeBSD-srcproj-clang800-import-i386-build/
* The artifacts are available at
https://artifact.ci.freebsd.org/snapshot/clang800-import/ for further
testing needs.
* Jobs for testing if drm pkgs (graphics/drm-*) can be built fine on
latest -current and -stable, are being tested in staging env.
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-02-24

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-02-24
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-02-18 to 2019-02-24.

During this period, we have:

* 2214 builds (98.7% passed, 1.3% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 575 test runs (32.2% passed, 65.5% unstable, 2.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 7 doc buils (100% passed)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

Web version of this report is available at
https://hackmd.io/s/rJAJu2RSE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libc.sys.sendfile_test.hdtr_positive_v4
* lib.libc.sys.sendfile_test.hdtr_positive_v6
  Fixed (Remove expected failure) in
https://svnweb.freebsd.org/changeset/base/344310

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.rates.t_dtrace_contrib.tst_switchrate_d
* common.syscall.t_dtrace_contrib.tst_args_d
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* Patch available:
https://people.freebsd.org/~bdrewery/patches/PR29.diff
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* After creating pipeline for clang800-import branch in project/, now
we support adding pipeline for other projects.  Please contact
jenkins-admin through "Testing & CI" component of "Services" product
on https://bugs.freebsd.org
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-03

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-03
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-02-25 to 2019-03-03.

During this period, we have:

* 2299 builds (98% passed, 2% failed) were executed on aarch64, amd64,
armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe,
riscv64, sparc64 architectures for head, stable/12, stable/11
branches.
* 574 test runs (32.2% passed, 59.6% unstable, 8.2% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 9 doc buils (100% passed)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

Web version of this report is available at
https://hackmd.io/s/rytoa05LE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## New & Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netpfil.pf.pass_block.nested_inline
  See https://bugs.freebsd.org/bugzilla/236223 for more detail.
  Fixed in https://svnweb.freebsd.org/changeset/base/344764 .

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.rates.t_dtrace_contrib.tst_switchrate_d
* common.syscall.t_dtrace_contrib.tst_args_d
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* Patch available:
https://people.freebsd.org/~bdrewery/patches/PR29.diff
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-10

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-10
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-02-03 to 2019-03-10.

During this period, we have:

* 1890 builds (95.6% passed, 4.4% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 358 test runs (49.2% passed, 50.5% unstable, 0.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 14 doc buils (100% passed)

(For more meaningful statistics, we omitted the numbers from experimental jobs)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/rka6WQnIE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## New Failed & Fixed jobs

* armv6 build job was broken on the Clang 8 importing and was fixed by
https://svnweb.freebsd.org/changeset/base/344798

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libarchive.functional_test.test_fuzz_zip
  (flakey) See https://bugs.freebsd.org/236300 for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* sys.netpfil.pf.pass_block.noalias
  (new) See https://bugs.freebsd.org/233678 for more details

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
  (new)
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
  (new)

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.rates.t_dtrace_contrib.tst_switchrate_d
* common.syscall.t_dtrace_contrib.tst_args_d
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

### New

* Flakey test case: lib.libarchive.functional_test.test_fuzz_zip
https://bugs.freebsd.org/236300

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* Patch available:
https://people.freebsd.org/~bdrewery/patches/PR29.diff
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* There is a traditional "tinderbox" view of the CI build status at
http://tinderbox.freebsd.org (redirect to
https://ci.freebsd.org/tinderbox/)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-17

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-17
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-03-11 to 2019-03-17.

During this period, we have:

* 1918 builds (93.2% passed, 2.3% failed, 86% exception) were executed
on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc,
powerpc64, powerpcspe, riscv64, sparc64 architectures for head,
stable/12, stable/11 branches.
* 339 test runs (54.9% passed, 44.8% unstable, 0.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 15 doc buils (100% passed)

(For more meaningful statistics, we omitted the numbers from experimental jobs)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/SJc5jaHw4 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libarchive.functional_test.test_fuzz_zip
  (flakey) See https://bugs.freebsd.org/236300 for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* (New) lib.libc.sys.sendfile_test.fd_positive_shm_v4
* (New) lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.rates.t_dtrace_contrib.tst_switchrate_d
* common.syscall.t_dtrace_contrib.tst_args_d
* common.misc.t_dtrace_contrib.tst_dynopt_d
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* Flakey test case: lib.libarchive.functional_test.test_fuzz_zip
https://bugs.freebsd.org/236300

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* Patch available:
https://people.freebsd.org/~bdrewery/patches/PR29.diff
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-24

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-24
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-03-18 to 2019-03-24.

During this period, we have:

* 2286 builds (98.3% passed, 1.7% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 498 test runs (37.3% passed, 60.7% unstable, 2% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 15 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/rybS4spvN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libarchive.functional_test.test_fuzz_zip
  (flakey) See https://bugs.freebsd.org/236300 for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* [29: genassym.o build race](https://bugs.freebsd.org/29)

* sys.netmap.ctrl-api-test.main failed after
https://svnweb.freebsd.org/changeset/base/345269 , fixed in
https://svnweb.freebsd.org/changeset/base/345323 .

* https://bugs.freebsd.org/236475 triggered assertion failure on
initialing ZFS in tests, is fixed in
https://svnweb.freebsd.org/changeset/base/345418

* sys.netpfil.pf.icmp.cve_2019_5598 added with wrong failname in
https://svnweb.freebsd.org/changeset/base/345409 , fixed in
https://svnweb.freebsd.org/changeset/base/345430

## Open Issues

* Flakey test case: lib.libarchive.functional_test.test_fuzz_zip
https://bugs.freebsd.org/236300

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* mizhka@ is fixing the subversion library used in Jenkins, which
solves the problem that Jenkins cannot checkout from a subversion
repository when running on FreeBSD after inode64 merge (FreeBSD
12.0-RELEASE). More details available:
  https://issues.tmatesoft.com/issue/SVNKIT-740
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-31

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-31
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-03-25 to 2019-03-31.

During this period, we have:

* 2095 builds (98.7% passed, 1.3% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 363 test runs (52.6% passed, 46.8% unstable, 0.6% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 8 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BymrvPI_4 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libarchive.functional_test.test_fuzz_zip
  Fixed in https://svnweb.freebsd.org/changeset/base/345497

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
  Fixed in https://svnweb.freebsd.org/changeset/base/345516

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* (New) lib.libc.gen.floatunditf_test.floatunditf
* (New) lib.libc.stdio.printfloat_test.hexadecimal_rounding
* (New) lib.msun.ctrig_test.test_small_inputs
* (New) lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* Flakey test case: lib.libarchive.functional_test.test_fuzz_zip
  https://bugs.freebsd.org/236300

## Oepn Issues

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-04-07

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-07
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-01 to 2019-04-07.

During this period, we have:

* 1841 builds (96% passed, 4% failed) were executed on aarch64, amd64,
armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe,
riscv64, sparc64 architectures for head, stable/12, stable/11
branches.
* 314 test runs (34.7% passed, 65% unstable, 0.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 4 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BymrvPI_4 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.online_resize_test.online_resize
  https://bugs.freebsd.org/237128

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
  https://bugs.freebsd.org/237129
* sys.opencrypto.runtests.main
  https://bugs.freebsd.org/237130
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* lib.libc.gen.floatunditf_test.floatunditf
* lib.libc.stdio.printfloat_test.hexadecimal_rounding
* lib.msun.ctrig_test.test_small_inputs
* lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
  https://bugs.freebsd.org/237129
* sys.opencrypto.runtests.main
  https://bugs.freebsd.org/237130
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
  https://bugs.freebsd.org/237129
* sys.opencrypto.runtests.main
  https://bugs.freebsd.org/237130
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Oepn Issues

### New

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

### In progress

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others

[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* Some PF tests are filing for a while because of py27-pcap-0.6.5,
thanks for kp@'s report and bofh@ committed update of py-pcap-0.6.6.
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-04-14

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-14
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-08 to 2019-04-14.

During this period, we have:

* 1702 builds (95.7% passed, 4.3% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 274 test runs (47.1% passed, 45.6% unstable, 7.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 13 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/r1EE3jotE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.online_resize_test.online_resize (at clean up stage)
  Fixed in https://svnweb.freebsd.org/changeset/base/346057

* https://ci.freebsd.org/job/FreeBSD-head-riscv64-test/
* Because Python default version switched 3, fixed in the test code.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* lib.libc.gen.floatunditf_test.floatunditf
* lib.libc.stdio.printfloat_test.hexadecimal_rounding
* lib.msun.ctrig_test.test_small_inputs
* lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936 (fixed when this report published)

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* https://bugs.freebsd.org/237128
sys/geom/class/eli:online_resize_test fails to clean up cleanly,
causing false positives
* https://bugs.freebsd.org/237129 sys.netmap.ctrl-api-test.main fails
on ^/stable/11 and ^/stable/12 i386 because the kernel lacks netmap
support

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

### In progress

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-04-21

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-21
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-15 to 2019-04-21.

During this period, we have:

* 2346 builds (95.5% passed, 4.5% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 400 test runs (13.5% passed, % 69.8unstable, 16.7% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
  Most of the exceptions were because of there is no initial entropy
pre-stored in the test VM image, and r346250 blocks read until the
device is seeded, whcih causes hang in boot. r346292 and r346358 added
tunables to not being blocked when reading from unseeded random
device.
* 25 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HJUJV7VcV and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* lib.libc.gen.floatunditf_test.floatunditf
* lib.libc.stdio.printfloat_test.hexadecimal_rounding
* lib.msun.ctrig_test.test_small_inputs
* lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936
  Fixed by https://svnweb.freebsd.org/changeset/base/346294

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.icmp.cve_2019_5598
* sys.netpfil.pf.set_tos.v4
  https://bugs.freebsd.org/237305 fix committed, wait for package build

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3

### In progress

* https://bugs.freebsd.org/237305 Multiple sys.netpfil.pf.* tests
failing on ^/head and ^/stable/12 because of TypeError with scapy
library reading interfaces from bpf

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/lis

FreeBSD Continuous Weekly Report 2019-04-28

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-28
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-22 to 2019-04-28.

During this period, we have:

* 2358 builds (96.9% passed, 3.1% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 436 test runs (34.9% passed, 59.4% unstable, 5.7% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 9 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/ByfvuSs54 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.icmp.cve_2019_5598
* sys.netpfil.pf.set_tos.v4
  https://bugs.freebsd.org/237305

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.kern.coredump_phnum_test.coredump_phnum
  https://svnweb.freebsd.org/changeset/base/346542

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh
  https://svnweb.freebsd.org/changeset/base/346854

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  MFC pending: https://svnweb.freebsd.org/changeset/base/346542
* sys.netpfil.pf.forward.v6
* usr.bin.procstat.procstat_test.command_line_arguments
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* (flaky) usr.bin.procstat.procstat_test.environment

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* https://bugs.freebsd.org/237305 Multiple sys.netpfil.pf.* tests
failing on ^/head and ^/stable/12 because of TypeError with scapy
library reading interfaces from bpf

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-05-05

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-05-05
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-29 to 2019-05-05.

During this period, we have:

* 2372 builds (99.9% passed, 0.1% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 384 test runs (53.9% passed, 44.5% unstable, 1.6% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 20 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/B13k-VEoN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.


## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.kern.coredump_phnum_test.coredump_phnum
  https://svnweb.freebsd.org/changeset/base/346909
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
  https://svnweb.freebsd.org/changeset/base/346912

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
  https://svnweb.freebsd.org/changeset/base/346911

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## New Issues

* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-05-12

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-05-12
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-06 to 2019-05-12.

During this period, we have:

* 2151 builds (98.2% passed, 1.8% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 394 test runs (43.9% passed, 13.7% unstable, 42.4% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 19 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/SJ9KUn16V and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-05-19

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-05-19
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-13 to 2019-05-19.

During this period, we have:

* 1845 builds (97% passed, 3% failed) were executed on aarch64, amd64,
armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe,
riscv64, sparc64 architectures for head, stable/12, stable/11
branches.
* test runs (58.7% passed, 19.6% unstable, 21.7% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 20 doc builds (95% passed)

Note: there was a updating of ci.freebsd.org system and resulted some
(less than 10) failures.

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/SJIjkSeaE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11251/testReport/junit/lib.libarchive/functional_test/test_read_format_zip_utf8_paths/
  Fixed in https://svnweb.freebsd.org/changeset/base/347999

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.
For more information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other news
* https://issues.tmatesoft.com/issue/SVNKIT-740
  The patch is asked to be updated and help wanted.

* https://bugs.freebsd.org/235356
  Help on how to reproduce and analyze is wanted.
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-05-26

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-05-26
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-20 to 2019-05-26.

During this period, we have:

* 2273 builds (97% passed, 3% failed) were executed on aarch64, amd64,
armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe,
riscv64, sparc64 architectures for head, stable/12, stable/11
branches.
* test runs (% passed, % unstable, % exception) were executed on
amd64, i386, riscv64 architectures for head, stable/12, stable/11
branches.
* 21 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HyiX1HETN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.init_test.init
* sys.geom.class.eli.init_test.init_a
* sys.geom.class.eli.init_test.init_alias
* sys.geom.class.eli.integrity_test.copy
* sys.geom.class.eli.integrity_test.data
* sys.geom.class.eli.integrity_test.hmac
  Those geli(8) test cases are failing because some algorithms are
deprecated in r348206 and the return value and output are changed.
The fix to the test cases are under development.
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.
For more information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512
* Same as amd64:
* sys.geom.class.eli.init_test.init
* sys.geom.class.eli.init_test.init_a
* sys.geom.class.eli.init_test.init_alias
* sys.geom.class.eli.integrity_test.copy
* sys.geom.class.eli.integrity_test.data
* sys.geom.class.eli.integrity_test.hmac
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* There are ~980 test cases failure with message:
`dtrace: failed to compile script err.D_AGG_SCALAR.maxnoarg.d:
[D_UNKNOWN] "/usr/lib/dtrace/mbuf.d", line 114: failed to copy type of
'm_data': Type information is in parent and unavailable`
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https

FreeBSD CI Weekly Report 2019-06-02

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-02
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-27 to 2019-06-02.

During this period, we have:

* 1752 builds (97.8% passed, 2.2% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 327 test runs (36.7% passed, 63.3% unstable) were executed on amd64,
i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 23 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/ryVi1WiaN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Removed Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.init_test.init
* sys.geom.class.eli.init_test.init_a
* sys.geom.class.eli.init_test.init_alias
* sys.geom.class.eli.integrity_test.copy
* sys.geom.class.eli.integrity_test.data
* sys.geom.class.eli.integrity_test.hmac
  Those geli(8) test cases are failing because some algorithms are
deprecated in [r348206](https://reviews.freebsd.org/rS348206) and the
return value and output are changed.  The fix to the test cases are
under development.  Those tests are removed in
[r348454](https://reviews.freebsd.org/rS348454), while it is still
wothy to adjust the test code to check if the deprecated algorithms
are correctly marked deprecated in the future.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Same as amd64

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.
For more information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512
* Same as amd64:
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Fixed Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* There are ~980 test cases failure with message:
`dtrace: failed to compile script err.D_AGG_SCALAR.maxnoarg.d:
[D_UNKNOWN] "/usr/lib/dtrace/mbuf.d", line 114: failed to copy type of
'm_data': Type information is in parent and unavailable`
  Fixed by https://svnweb.freebsd.org/changeset/base/348329

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tes

FreeBSD CI Weekly Report 2019-06-09

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-09
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-06-03 to 2019-06-09.

During this period, we have:

* 2444 builds (92.9% passed, 7.1% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 247 test runs (51% passed, 49% unstable) were executed on amd64,
i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 76 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BJI5k8RRV and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* [r348808](https://reviews.freebsd.org/rS348808) fixed i386
kernel panics on loading ipsec(4) kernel module, which is needed after
[347410](https://svnweb.freebsd.org/changeset/base/347410). For more
information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512

## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
* See https://reviews.freebsd.org/D20622

* pkg(8) now requires `/dev/null` which doesn't exist on jail builds
test VM image.  Fix is under development now.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Same as amd64:
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233

FreeBSD CI Weekly Report 2019-06-16

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-16
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-06-10 to 2019-06-16.

During this period, we have:

* 1927 builds (98.1% passed, 1.9% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 199 test runs (56.8% passed, 42.7% unstable, 0.5% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 45 doc builds (97.8% passed, 2.2 failed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BJmuwS5yS and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Builds

* All -testvm jobs
* Script for building test VM image in freebsd-ci has been updated
to fulfill that pkg(8) requires `/dev/null`

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
* Fixed in [r349008](https://reviews.freebsd.org/rS349008)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Same as amd64:
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
*
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
*
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* https://issues.tmatesoft.com/issue/SVNKIT-740

FreeBSD CI Weekly Report 2019-06-23

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-23
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-06-17 to 2019-06-23.

During this period, we have:

* 1835 builds (98.7% passed, 1.3% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 356 test runs (38.2% passed, 55.9% unstable, 5.9% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 32 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/Sy6_MI6kH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of 
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### New

* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### Open

* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386

### Cause build fails

* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* https://issues.tmatesoft.com/issue/SVNKIT-740
  The patch is asked to be updated and help wanted.
  
* https://bugs.freebsd.org/235356
  Help on how to reproduce and analyze is wanted.

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd

FreeBSD CI Weekly Report 2019-06-30

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-30
===

Here is a summary of the FreeBSD Continuous Integration results for the period 
from 2019-06-24 to 2019-06-30.

During this period, we have:

* 1764 builds (95.9% passed, 4.1% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 333 test runs (57.1% passed, 33.6% unstable, 9.3% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 44 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BkT334Wer and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```


* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of 
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### New

* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* https://issues.tmatesoft.com/issue

FreeBSD CI Weekly Report 2019-07-07

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-07-07
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-01 to 2019-07-07.

During this period, we have:

* 1871 builds (96.2% passed, 3.8% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 335 test runs (47.5% passed, 45.3% unstable, 7.2% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 34 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BJmFeVxbB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of 
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### Othe

FreeBSD CI Weekly Report 2019-07-14

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-07-14
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-08 to 2019-07-14.

During this period, we have:

* 1628 builds (97.4% passed, 2.6% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 317 test runs (54.3% passed, 37.5% unstable, 8.2% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 48 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/Bk5EdrMbB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
  Fixed in [r349872](https://reviews.freebsd.org/rS349872)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main
* Needs MFC more than r349872.
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* https://issues.tmatesoft.com/issue/SVNKIT-740
  The patch is asked

FreeBSD CI Weekly Report 2019-07-21

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-07-21
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-15 to 2019-07-21.

During this period, we have:

* 1659 builds (96.7% (-0.7) passed, 3.3% (+0.7) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 306 test runs (56.2% (+1.9) passed, 43.1% (+5.6) unstable, 0.7% (-7.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 18 doc builds (100% (+0) passed)

Test case status (by 2019-07-21 23:59):
| Branch/Architecture | Total | Pass | Fail | Skipped |
| --- | - |  |  | --- |
| head/amd64  | 7460  | 7411 | 0| 49  |
| head/i386   | 7458  | 7406 | 4| 48  |
| 12-STABLE/amd64 | 7388  | 7341 | 0| 47  |
| 12-STABLE/i386  | 7386  | 7335 | 5| 46  |
| 11-STABLE/amd64 | 6845  | 6800 | 0| 45  |
| 11-STABLE/i386  | 6843  | 6759 | 34   | 50  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/rJJdcpCbH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.opencrypto.runtests.main
  Fixed in http://svnweb.freebsd.org/changeset/base/350164

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items)

FreeBSD CI Weekly Report 2019-07-28

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-07-28
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-22 to 2019-07-28.

During this period, we have:

* 1689 builds (97.1% (+0.4) passed, 2.9% (-0.4) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 317 test runs (80.8% (+24.6) passed, 18.9% (-24.2) unstable, 0.3% (-0.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 36 doc builds (100% (+0) passed)

Test case status (on 2019-07-28 23:59):
| Branch/Architecture | Total  | Pass  | Fail| Skipped  |
| --- | -- | - | --- |  |
| head/amd64  | 7460 (+0)  | 7409 (-2) | 0 (+0)  | 51 (+2)  |
| head/i386   | 7458 (+0)  | 7400 (-6) | 0 (+0)  | 58 (+10) |
| 12-STABLE/amd64 | 7388 (+0)  | 7344 (+3) | 0 (+0)  | 44 (-3)  |
| 12-STABLE/i386  | 7386 (+0)  | 7335 (+0) | 0 (-5)  | 51 (+5)  |
| 11-STABLE/amd64 | 6845 (+0)  | 6797 (-3) | 1 (+1)  | 47 (+2)  |
| 11-STABLE/i386  | 6843 (+0)  | 6759 (+0) | 35 (+1) | 49 (-1)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/r1l5zGmMH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* This week we disabled most unstable test cases in CI runs to let the real 
error caused by the commit can be noticed more easier.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.opencrypto.runtests.main
  https://svnweb.freebsd.org/changeset/base/350209

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  Patch available: https://reviews.freebsd.org/D21069

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linu

FreeBSD CI Weekly Report 2019-08-04

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-04
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-29 to 2019-08-04.

During this period, we have:

* 1662 builds (95.8% (-1.3) passed, 4.2% (+1.3) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 309 test runs (87.4% (+6.6) passed, 12.6% (-6.3) unstable, 0% (-0.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 18 doc builds (100% (+0) passed)

Test case status (on 2019-07-28 23:59):
| Branch/Architecture | Total  | Pass  | Fail| Skipped  |
| --- | -- | - | --- |  |
| head/amd64  | 7460 (+0)  | 7409 (+0) | 0 (+0)  | 51 (+0)  |
| head/i386   | 7458 (+0)  | 7400 (+0) | 0 (+0)  | 58 (+0)  |
| 12-STABLE/amd64 | 7388 (+0)  | 7344 (+0) | 0 (+0)  | 44 (+0)  |
| 12-STABLE/i386  | 7386 (+0)  | 7332 (-3) | 0 (+0)  | 54 (+3)  |
| 11-STABLE/amd64 | 6845 (+0)  | 6800 (+3) | 1 (+0)  | 44 (-3)  |
| 11-STABLE/i386  | 6843 (+0)  | 6760 (+1) | 34 (-1) | 49 (+0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/rkEiIYr7B and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* We are skipping the test cases failing in CI system only when "ci"
  configuration variable is true.  This value can be set in kyua.conf
  or cli as: `kyua -v test_suites.FreeBSD.ci=true test`

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  Patch available: https://reviews.freebsd.org/D21069

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys

FreeBSD CI Weekly Report 2019-08-11

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-11
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-05 to 2019-08-11.

During this period, we have:

* 2066 builds (91% (-4.8) passed, 9% (4.8) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 343 test runs (85.1% (-2.3) passed, 14.9% (+2.3) unstable)
  were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 18 doc builds (100% (+0) passed)

Test case status (on 2019-08-11 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7507 (+47) | 7449 (+40) | 0 (0)   | 58 (+7) |
| head/i386   | 7505 (+47) | 7443 (+43) | 0 (0)   | 62 (+4) |
| 12-STABLE/amd64 | 7392 (+4)  | 7348 (+4)  | 0 (0)   | 44 (0)  |
| 12-STABLE/i386  | 7390 (+4)  | 7339 (+4)  | 0 (0)   | 51 (0)  |
| 11-STABLE/amd64 | 6845 (0)   | 6801 (+4)  | 0 (-1)  | 44 (-3) |
| 11-STABLE/i386  | 6843 (0)   | 6763 (+3)  | 34 (0)  | 46 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HySDseqQB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* This week we added LINT kernel build job for aarch64:
  https://ci.freebsd.org/job/FreeBSD-head-aarch64-LINT/
  We will add more LINT kernel build jobs for tier2 and tier3 soon.
  
* Total test case number increased a lot by fusefs update in
  [r350665](https://svnweb.freebsd.org/changeset/base/350665).

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  Patch available: https://reviews.freebsd.org/D21069

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: er

FreeBSD CI Weekly Report 2019-08-18

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-18
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-12 to 2019-08-18.

During this period, we have:

* 2205 builds (93.3% (+2.3) passed, 6.7% (-2.3) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 401 test runs (63.3% (-21.8) passed, 34.7% (+19.8) unstable, 2% (+2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 8 doc builds (100% (+0) passed)

Test case status (on 2019-08-18 23:59):
| Branch/Architecture | Total  | Pass  | Fail| Skipped  |
| --- | -- | - | --- |  |
| head/amd64  | 7511 (+4)  | 7446 (-3) | 2 (+2)  | 63 (+5)  |
| head/i386   | 7509 (+4)  | 7437 (-6) | 2 (+2)  | 70 (+8)  |
| 12-STABLE/amd64 | 7392 (0)   | 7341 (-7) | 2 (+2)  | 49 (+5)  |
| 12-STABLE/i386  | 7390 (0)   | 7332 (-7) | 2 (+2)  | 56 (+5)  |
| 11-STABLE/amd64 | 6845 (0)   | 6794 (-7) | 0 (0)   | 51 (+7)  |
| 11-STABLE/i386  | 6843 (0)   | 6756 (-7) | 34 (0)  | 53 (+7)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/S1ueobKEH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/12237/
* https://ci.freebsd.org/job/FreeBSD-head-i386-test/6383/
* sys.acl.00.main
* sys.acl.02.main
  These are due to /usr/local/bin/perl changed to be installed by 
lang/perl5.30 (fixed now).
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.icmp.cve_2019_5598

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  A fix is committed: https://svnweb.freebsd.org/changeset/base/351151

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests 

FreeBSD CI Weekly Report 2019-08-25

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-25
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-19 to 2019-08-25.

During this period, we have:

* 2262 builds (83% (-10.3) passed, 17% (+10.3) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 403 test runs (45.2% (-18.1) passed, 48.8% (+14.1) unstable, 6% (+4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 38 doc builds (100% (0) passed)

Test case status (on 2019-08-25 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7533 (+22) | 7463 (+17) | 0 (-2)  | 70 (+7)  |
| head/i386   | 7531 (+22) | 7455 (+18) | 0 (-2)  | 74 (+4)  |
| 12-STABLE/amd64 | 7392 (0)   | 7345 (+4)  | 0 (-2)  | 47 (-2)  |
| 12-STABLE/i386  | 7390 (0)   | 7336 (+4)  | 0 (-2)  | 54 (-2)  |
| 11-STABLE/amd64 | 6845 (0)   | 6801 (+7)  | 0 (0)   | 44 (-7)  |
| 11-STABLE/i386  | 6843 (0)   | 6763 (+7)  | 34 (0)  | 46 (-7)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HkcTCgnVB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* Per imp@ suggested [timeline of gcc 4.2.1 
removal](https://lists.freebsd.org/pipermail/freebsd-arch/2019-August/019674.html):
* -Werror has been turned off for gcc 4.2.1 in
  [r351429](https://svnweb.freebsd.org/changeset/base/351429) and
  [r351430](https://svnweb.freebsd.org/changeset/base/351430)
* power*-build has been fixed in 
[r351485](https://svnweb.freebsd.org/changeset/base/351485)
* amd64-gcc build still need fix, patch is being discussed in
  https://reviews.freebsd.org/D21418

* Some pf tests failing on i386 which may be related to bpf, need more help:
* https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/12237/
* https://ci.freebsd.org/job/FreeBSD-head-i386-test/6383/
* sys.acl.00.main
* sys.acl.02.main
  Fixed by update package to perl5.30
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.icmp.cve_2019_5598
  Due to [r351212](https://svnweb.freebsd.org/changeset/base/351212) 
changed options of ping6(8),
  fixed in [r351391](https://svnweb.freebsd.org/changeset/base/351391)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https:/

FreeBSD CI Weekly Report 2019-09-01

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-01
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-26 to 2019-09-01.

During this period, we have:

* 1625 builds (97.4% (+14.4) passed, 2.6% (-14.4) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 276 test runs (59.8% (+14.6) passed, 40.2% (-8.6) unstable, 0% (-6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 51 doc builds (98.0% (-2) passed, 2% (+2) failed)

Test case status (on 2019-09-01 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7550 (+17) | 7484 (+21) | 1 (+1)  | 65 (-5) |
| head/i386   | 7548 (+17) | 7477 (+22) | 2 (+2)  | 69 (-5) |
| 12-STABLE/amd64 | 7392 (0)   | 7348 (+3)  | 0 (0)   | 44 (-3) |
| 12-STABLE/i386  | 7390 (0)   | 7339 (+3)  | 0 (0)   | 51 (-3) |
| 11-STABLE/amd64 | 6845 (0)   | 6798 (-3)  | 0 (0)   | 47 (+3) |
| 11-STABLE/i386  | 6843 (0)   | 6760 (-3)  | 34 (0)  | 49 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190901 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
 
* Faliure notification has been turned on for 
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
 
* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) 
is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.kern.pdeathsig.signal_delivered_ptrace
* Reported in https://bugs.freebsd.org/237657
* Fixed in https://svnweb.freebsd.org/changeset/base/351210

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* sys.cddl.zfs.tests.atime.atime_test.atime_001_pos
* Reported in https://bugs.freebsd.org/240221
* Fixed in https://svnweb.freebsd.org/changeset/base/351642

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* (flaky) sys.sys.qmath_test.qdivq_s64q
* https://bugs.freebsd.org/240219
* Disabled in https://svnweb.freebsd.org/changeset/base/351739

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380 (updating net/scapy to 2.4.3 may fix this)
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /

Re: crash after revision 352091

[Li-Wen Hsu]

On Wed, Sep 11, 2019 at 2:12 PM Christos Chatzaras  wrote:
>
> Few hours ago I upgrade FreeBSD-12.0-STABLE (revision 351639) to 
> FreeBSD-12.0-STABLE (revision 352091).
>
> After running the new version for few hours 2 of my servers crashed and 
> auto-reboot.
>
> Logs show nothing.
>
> Any idea if a commit between these 2 versions can cause it?

Any chance if you can obtain the crash dump?

https://www.freebsd.org/doc/en_US.ISO8859-1/books/developers-handbook/kerneldebug.html#kerneldebug-obtain
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-09-08

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-08
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-02 to 2019-09-08.

During this period, we have:

* 2122 builds (99.4% (+2) passed, 0.6% (-2) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 373 test runs (59.6% (-0.2) passed, 39.1% (-1.1) unstable, 1.3% (+1.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc builds (100% (+2) passed)

Test case status (on 2019-09-08 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped  |
| --- | -- | -- | - |  |
| head/amd64  | 7556 (+6)  | 7495 (+11) | 0 (-1)| 61 (-4)  |
| head/i386   | 7554 (+6)  | 7484 (+7)  | 2 (0) | 68 (-1)  |
| 12-STABLE/amd64 | 7393 (+1)  | 7341 (-7)  | 11 (+11)  | 41 (-3)  |
| 12-STABLE/i386  | 7391 (+1)  | 7329 (-10) | 11 (+11)  | 51 (0)   |
| 11-STABLE/amd64 | 6846 (+1)  | 6802 (+4)  | 0 (0) | 44 (-3)  |
| 11-STABLE/i386  | 6844 (+1)  | 6767 (-7)  | 34 (0)| 43 (-6)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190908 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* Weekly CI report archive has been moved to https://hackmd.io/@FreeBSD-CI

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* (flakey) usr.bin.procstat.procstat_test.environment
* (flakey) usr.bin.procstat.procstat_test.command_line_arguments
  Fixed in https://svnweb.freebsd.org/changeset/base/351819

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-amd64-test/
* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netipsec.tunnel.aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aes_gcm_128.v6
* sys.netipsec.tunnel.aes_gcm_256.v6
* sys.netipsec.tunnel.aesni_aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aesni_aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aesni_aes_gcm_128.v6
* sys.netipsec.tunnel.aesni_aes_gcm_256.v6
* sys.netipsec.tunnel.empty.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.pass_block.v6
* https://bugs.freebsd.org/240511

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
  Patch available: https://reviews.freebsd.org/D21566
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380 (updating net/scapy to 2.4.3 may fix this)
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.or

FreeBSD CI Weekly Report 2019-09-15

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-15
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-09 to 2019-09-15.

During this period, we have:

* 2095 builds (95.3% (-4.1) passed, 4.7% (+4.1) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 358 test runs (58.4% (-1.2) passed, 31.0% (-8.1) unstable, 10.6% (+9.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 32 doc builds (100% (0) passed)

Test case status (on 2019-09-15 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7563 (+7)  | 7501 (+6)  | 0 (0)   | 62 (+1) |
| head/i386   | 7561 (+7)  | 7490 (+6)  | 2 (0)   | 69 (+1) |
| 12-STABLE/amd64 | 7433 (+40) | 7389 (+48) | 0 (-11) | 44 (+3) |
| 12-STABLE/i386  | 7431 (+40) | 7380 (+51) | 0 (-11) | 51 (0)  |
| 11-STABLE/amd64 | 6846 (0)   | 6802 (0)   | 0 (0)   | 44 (0)  |
| 11-STABLE/i386  | 6844 (0)   | 6767 (0)   | 34 (0)  | 43 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190915 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-amd64-test/
* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netipsec.tunnel.aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aes_gcm_128.v6
* sys.netipsec.tunnel.aes_gcm_256.v6
* sys.netipsec.tunnel.aesni_aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aesni_aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aesni_aes_gcm_128.v6
* sys.netipsec.tunnel.aesni_aes_gcm_256.v6
* sys.netipsec.tunnel.empty.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.pass_block.v6
* https://bugs.freebsd.org/240437

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
  Patch available: https://reviews.freebsd.org/D21566
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380 (updating net/scapy to 2.4.3 may fix this)
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* (new) sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510


## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset

FreeBSD CI Weekly Report 2019-09-22

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-22
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-16 to 2019-09-22.

During this period, we have:

* 2048 builds (99% (+3.7) passed, 1% (-3.7) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 359 test runs (77.2% (+18.8) passed, 22.8% (-8.2) unstable) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 42 doc builds (100% passed)

Test case status (on 2019-09-22 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7567 (+4)  | 7504 (+4)  | 0 (0)  | 63 (+1) |
| head/i386   | 7565 (+4)  | 7493 (+3)  | 0 (-2) | 72 (+3) |
| 12-STABLE/amd64 | 7474 (+41) | 7430 (+41) | 0 (0)  | 44 (0)  |
| 12-STABLE/i386  | 7472 (+41) | 7424 (+44) | 0 (0)  | 48 (-3) |
| 11-STABLE/amd64 | 6849 (+3)  | 6805 (+3)  | 0 (0)  | 44 (0)  |
| 11-STABLE/i386  | 6847 (+3)  | 6770 (+3)  | 34 (0) | 43 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190922 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* [Testing/CI session in 
DevSummit201909](https://wiki.freebsd.org/DevSummit/201909)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
  Patch available: https://reviews.freebsd.org/D21566
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* (new) sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* (new) lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https:

FreeBSD CI Weekly Report 2019-09-29

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-29
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-23 to 2019-09-29.

During this period, we have:

* 2159 builds (98.6% (-0.4) passed, 1.4% (+0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 340 test runs (71.5% (-5.7) passed, 20% (-2.8) unstable, 8.5% (+8.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% passed)

Test case status (on 2019-09-29 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7588 (+21) | 7525 (+21) | 0 (0)  | 63 (0)   |
| head/i386   | 7586 (+21) | 7514 (+21) | 0 (0)  | 72 (0)   |
| 12-STABLE/amd64 | 7474 (0)   | 7430 (0)   | 0 (0)  | 44 (0)   |
| 12-STABLE/i386  | 7472 (0)   | 7421 (0)   | 0 (0)  | 51 (+3)  |
| 11-STABLE/amd64 | 6849 (0)   | 6805 (0)   | 0 (0)  | 44 (0)   |
| 11-STABLE/i386  | 6847 (0)   | 6767 (-3)  | 34 (0) | 46 (+3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190929 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
* https://svnweb.freebsd.org/changeset/base/352807
* https://svnweb.freebsd.org/changeset/base/352869

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358
* Fixed in head https://svnweb.freebsd.org/changeset/base/353107

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:

FreeBSD CI Weekly Report 2019-10-06

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-06
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-30 to 2019-10-06.

During this period, we have:

* 2129 builds (99.4% (+0.8) passed, 0.6% (-0.8) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 333 test runs (81.7% (+10.2) passed, 18.3% (-1.7) unstable) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 42 doc builds (100% passed)

Test case status (on 2019-10-06 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7589 (+1)  | 7526 (+1)  | 0 (0)   | 63 (0)   |
| head/i386   | 7587 (+1)  | 7515 (+1)  | 0 (0)   | 72 (0)   |
| 12-STABLE/amd64 | 7482 (+8)  | 7441 (+11) | 0 (0)   | 41 (-3)  |
| 12-STABLE/i386  | 7480 (+8)  | 7434 (+13) | 0 (0)   | 48 (-3)  |
| 11-STABLE/amd64 | 6849 (0)   | 6808 (+3)  | 0 (0)   | 41 (-3)  |
| 11-STABLE/i386  | 6847 (0)   | 6770 (+3)  | 34 (0)  | 43 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191006 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* Fixed in head https://svnweb.freebsd.org/changeset/base/353107

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews

FreeBSD CI Weekly Report 2019-10-13

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-13
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-07 to 2019-10-13.

During this period, we have:

* 2217 builds (91.1% (-8.3) passed, 8.9% (+8.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (81.3% (-0.4) passed, 8.5% (-9.8) unstable, 10.2% (+10.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc builds (100% passed)

Test case status (on 2019-10-13 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7590 (+1) | 7527 (+1) | 0 (0)  | 63 (0)   |
| head/i386   | 7588 (+1) | 7516 (+1) | 0 (0)  | 72 (0)   |
| 12-STABLE/amd64 | 7482 (0)  | 7438 (-3) | 0 (0)  | 44 (+3)  |
| 12-STABLE/i386  | 7480 (0)  | 7432 (0)  | 0 (0)  | 48 (0)   |
| 11-STABLE/amd64 | 6849 (0)  | 6808 (0)  | 0 (0)  | 41 (0)   |
| 11-STABLE/i386  | 6847 (0)  | 6770 (0)  | 34 (0) | 43 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191013 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bug

FreeBSD CI Weekly Report 2019-10-20

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-20
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-14 to 2019-10-20.

During this period, we have:

* 2475 builds (93.6% (+2.5) passed, 6.4% (-2.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 341 test runs (89.4% (+8.1) passed, 10.6% (+2.1) unstable, 0% (-10.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 20 doc builds (100% (0) passed)

Test case status (on 2019-xx-xx 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped |
| --- | - | - | -- | --- |
| head/amd64  | 7590 (0)  | 7527 (0)  | 0 (0)  | 63 (0)  |
| head/i386   | 7588 (0)  | 7513 (-3) | 0 (0)  | 75 (+3) |
| 12-STABLE/amd64 | 7483 (+1) | 7439 (-1) | 0 (0)  | 44 (0)  |
| 12-STABLE/i386  | 7481 (+1) | 7430 (-2) | 0 (0)  | 51 (+2) |
| 11-STABLE/amd64 | 6849 (0)  | 6805 (-3) | 0 (0)  | 44 (+3) |
| 11-STABLE/i386  | 6847 (0)  | 6770 (0)  | 34 (0) | 43 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191020 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in sys/op

FreeBSD CI Weekly Report 2019-10-27

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-27
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-21 to 2019-10-27.

During this period, we have:

* 2267 builds (96.7% (+3.1) passed, 3.3% (-3.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 352 test runs (55.1% (+34.3) passed, 38.1% (+27.5) unstable, 6.8% (+6.8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% (0) passed)

Test case status (on 2019-10-27 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7609 (+19) | 7540 (+13) | 0 (0)  | 69 (+6) |
| head/i386   | 7586 (-2)  | 7509 (-4)  | 0 (0)  | 77 (+2) |
| 12-STABLE/amd64 | 7483 (+2)  | 7432 (-7)  | 0 (0)  | 51 (+7) |
| 12-STABLE/i386  | 7481 (0)   | 7426 (-4)  | 0 (0)  | 55 (+4) |
| 11-STABLE/amd64 | 6849 (0)   | 6805 (0)   | 0 (0)  | 44 (0)  |
| 11-STABLE/i386  | 6847 (0)   | 6767 (-3)  | 34 (0) | 46 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191027 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* (new) lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* (new) sys.netinet6.frag6.*
  https://bugs.freebsd.org/241493

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy ca

FreeBSD CI Weekly Report 2019-11-03

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-03
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-29 to 2019-11-03.

During this period, we have:

* 1820 builds (94.1% (-2.6) passed, 5.9% (+2.6) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 277 test runs (81.6% (+26.5) passed, 18.4% (-19.7) unstable, 0% (-6.8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 27 doc builds (88.0% (-12) passed)

Test case status (on 2019-11-03 23:59):
| Branch/Architecture | Total| Pass  | Fail   | Skipped |
| --- |  | - | -- | --- |
| head/amd64  | 7609 (0) | 7541 (+1) | 0 (0)  | 68 (-1) |
| head/i386   | 7586 (0) | 7512 (+3) | 0 (0)  | 74 (-3) |
| 12-STABLE/amd64 | 7483 (0) | 7436 (+4) | 0 (0)  | 47 (-4) |
| 12-STABLE/i386  | 7481 (0) | 7427 (+1) | 0 (0)  | 54 (-1) |
| 11-STABLE/amd64 | 6849 (0) | 6802 (-3) | 0 (0)  | 47 (+3) |
| 11-STABLE/i386  | 6847 (0) | 6764 (-3) | 34 (0) | 49 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191103 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at 
https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact 
freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or have 
new ideas.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* (new) lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* (new) sys.netinet6.frag6.*
  https://bugs.freebsd.org/241493

## Issues

## New

* https://bugs.freebsd.org/241562
  failing test case: lib.libexecinfo.backtrace_test.backtrace_fmt_basic
  (Already fixed on 2019-11-07)
* https://bugs.freebsd.org/241662
  Flakey test case: lib.libarchive.functional_test.test_fuzz_iso9660

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or dir

FreeBSD CI Weekly Report 2019-11-10

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-10
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-04 to 2019-11-10.

During this period, we have:

* 2331 builds (94.9% (+) passed, 5.1% () failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 267 test runs (92.1% (+) passed, 6.4% (-) unstable, 1.5% ()
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 86 doc builds (100% (0) passed)

Test case status (on 2019-11-10 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7611 (+2)  | 7543 (+2)  | 0 (0)   | 68 (0)  |
| head/i386   | 7609 (+23) | 7540 (+28) | 0 (0)   | 69 (-5) |
| 12-STABLE/amd64 | 7483 (0)   | 7435 (-1)  | 0 (0)   | 48 (+1) |
| 12-STABLE/i386  | 7481 (0)   | 7426 (-1)  | 0 (0)   | 55 (+1) |
| 11-STABLE/amd64 | 6849 (0)   | 6802 (0)   | 0 (-)   | 47 (0)  |
| 11-STABLE/i386  | 6847 (0)   | 6798 (+34) | 0 (-34) | 49 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191110 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Fixed tests

Tests of i386 netinet6 and netpfil were failing because a bug in scapy, fixed
by bz@ and upstreaming at https://github.com/secdev/scapy/pull/2329

* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.netpfil.common.forward.pf_v4 (i386 only)
  https://bugs.freebsd.org/240085
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* sys.netinet6.frag6.*
  https://bugs.freebsd.org/241493
  
libexecinfo tests are enabled and found that the tests needs unstripped binary,
and also found that we need to enable unwind tables on !amd64.

* https://bugs.freebsd.org/241562
  failing test case: lib.libexecinfo.backtrace_test.backtrace_fmt_basic

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://

FreeBSD CI Weekly Report 2019-11-17

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-17
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-11 to 2019-11-17.

During this period, we have:

* 2174 builds (91.2% (-3.7) passed, 8.8% (+3.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 331 test runs (97.9% (+5.8) passed, 2.1% (-4.3) unstable, 0% (-1.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc builds (100% passed)

Test case status (on 2019-11-17 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7611 (0)  | 7546 (+3) | 0 (0) | 65 (-3) |
| head/i386   | 7609 (0)  | 7537 (-3) | 0 (0) | 72 (+3) |
| 12-STABLE/amd64 | 7483 (0)  | 7435 (0)  | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7481 (0)  | 7423 (-3) | 0 (0) | 58 (+3) |
| 11-STABLE/amd64 | 6853 (+4) | 6806 (+4) | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6851 (+4) | 6799 (+1) | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191117 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~7 failing and ~100 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy 

FreeBSD CI Weekly Report 2019-11-24

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-24
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-18 to 2019-11-24.

During this period, we have:

* 2617 builds (95.1% (+3.9) passed, 4.9% (-3.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 349 test runs (83.1% (-14.8) passed, 8.9% (-6.8) unstable, 8.0% (+8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 48 doc builds (100% (0) passed)

Test case status (on 2019-11-24 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7618 (+7) | 7552 (+6) | 0 (0) | 66 (+1) |
| head/i386   | 7616 (+7) | 7546 (+9) | 0 (0) | 70 (-2) |
| 12-STABLE/amd64 | 7483 (0)  | 7435 (0)  | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7481 (0)  | 7426 (+3) | 0 (0) | 55 (-3) |
| 11-STABLE/amd64 | 6853 (0)  | 6803 (-3) | 0 (0) | 50 (+3) |
| 11-STABLE/i386  | 6851 (0)  | 6799 (0)  | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191124 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Fixed tests

* https://bugs.freebsd.org/242095
  failing test case: usr.bin.unifdef.basic_test.basic

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~100 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause ker

FreeBSD CI Weekly Report 2019-12-01

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-01
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-25 to 2019-12-01.

During this period, we have:

* 2134 builds (96.3% (+1.2) passed, 3.7% (-1.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (97.5% (+14.4) passed, 2.5% (-6.4) unstable, 0% (-8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% (0) passed)

Test case status (on 2019-12-01 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7620 (+2) | 7554 (+2) | 0 (0) | 66 (0)  |
| head/i386   | 7618 (+2) | 7548 (+2) | 0 (0) | 70 (0)  |
| 12-STABLE/amd64 | 7483 (0)  | 7432 (-3) | 0 (0) | 51 (+3) |
| 12-STABLE/i386  | 7481 (0)  | 7426 (0)  | 0 (0) | 55 (0)  |
| 11-STABLE/amd64 | 6853 (0)  | 6806 (+3) | 0 (0) | 47 (-3) |
| 11-STABLE/i386  | 6851 (0)  | 6802 (+3) | 0 (0) | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191201 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~14 failing and ~100 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synpr

FreeBSD CI Weekly Report 2019-12-08

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-08
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-02 to 2019-12-08.

During this period, we have:

* 2463 builds (95% (-1.3) passed, 5% (+1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 353 test runs (98% (+0.5) passed, 1.7% (-0.8) unstable, 0.3% (+0.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 42 doc builds (100% (0) passed)

Test case status (on 2019-12-08 23:59):
| Branch/Architecture | Total  | Pass  | Fail  | Skipped |
| --- | -- | - | - | --- |
| head/amd64  | 7632 (+12) | 7563 (+9) | 0 (0) | 69 (+3) |
| head/i386   | 7630 (+12) | 7557 (+9) | 0 (0) | 73 (+3) |
| 12-STABLE/amd64 | 7488 (+5)  | 7437 (+5) | 0 (0) | 51 (0)  |
| 12-STABLE/i386  | 7486 (+5)  | 7428 (+2) | 0 (0) | 58 (+3) |
| 11-STABLE/amd64 | 6858 (+5)  | 6811 (+5) | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6856 (+5)  | 6804 (+2) | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191208 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) lo

FreeBSD CI Weekly Report 2019-12-15

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-15
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-09 to 2019-12-15.

During this period, we have:

* 2566 builds (96.3% (+1.3) passed, 3.7% (-1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 400 test runs (96.4% (-1.6) passed, 1.8% (+0.1) unstable, 1.8% (+1.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 43 doc builds (93% (-7) passed, 7% (+7) failed)

Test case status (on 2019-12-15 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7635 (+3) | 7566 (+3) | 0 (0) | 69 (0)  |
| head/i386   | 7633 (+3) | 7560 (+3) | 0 (0) | 73 (0)  |
| 12-STABLE/amd64 | 7488 (0)  | 7440 (+3) | 0 (0) | 48 (-3) |
| 12-STABLE/i386  | 7486 (0)  | 7428 (0)  | 0 (0) | 58 (0)  |
| 11-STABLE/amd64 | 6858 (0)  | 6811 (0)  | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6856 (0)  | 6807 (+3) | 0 (0) | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191215 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
ma

FreeBSD CI Weekly Report 2019-12-22

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-22
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-15 to 2019-12-22.

During this period, we have:

* 2352 builds (98.5% (+2.2) passed, 1.5% (-2.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 313 test runs (86.6% (-9.8) passed, 7.0% (+5.2) unstable, 6.4% (+4.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 16 doc builds (100% (+7) passed)

Test case status (on 2019-12-22 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7636 (+1) | 7570 (+4) | 0 (0) | 66 (-3) |
| head/i386   | 7634 (+1) | 7560 (0)  | 0 (0) | 74 (+1) |
| 12-STABLE/amd64 | 7491 (+3) | 7443 (+3) | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7489 (+3) | 7434 (+6) | 0 (0) | 55 (-3) |
| 11-STABLE/amd64 | 6860 (+2) | 6810 (-1) | 0 (0) | 50 (+3) |
| 11-STABLE/i386  | 6858 (+2) | 6809 (+2) | 0 (0) | 49 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191222 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* FreeBSD Foundation 2019 in Review: CI and Testing Advancements
  
https://www.freebsdfoundation.org/blog/2019-in-review-ci-and-testing-advancements/

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/242689
  sys.geom.class.multipath.failloop.failloop fails due to too many CTF entries
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentr

FreeBSD CI Weekly Report 2019-12-29

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-29
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-23 to 2019-12-29.

During this period, we have:

* 1811 builds (95.1% (-3.4) passed, 4.9% (+3.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 197 test runs (88.9% (+2.3) passed, 2.5% (-4.5) unstable, 8.6% (+2.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% (0) passed)

Test case status (on 2019-12-29 23:59):
| Branch/Architecture | Total| Pass  | Fail  | Skipped |
| --- |  | - | - | --- |
| head/amd64  | 7636 (0) | 7567 (-3) | 0 (0) | 69 (+3) |
| head/i386   | 7634 (0) | 7563 (+3) | 0 (0) | 71 (-3) |
| 12-STABLE/amd64 | 7491 (0) | 7440 (-3) | 0 (0) | 51 (+3) |
| 12-STABLE/i386  | 7489 (0) | 7434 (0)  | 0 (0) | 55 (0)  |
| 11-STABLE/amd64 | 6860 (0) | 6813 (+3) | 0 (0) | 47 (-3) |
| 11-STABLE/i386  | 6858 (0) | 6806 (-3) | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191229 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* FreeBSD Foundation 2019 in Review: CI and Testing Advancements
  
https://www.freebsdfoundation.org/blog/2019-in-review-ci-and-testing-advancements/
  
## Failing build

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  There are some issues after PowerPC switch to llvm toolchain.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/242689
  sys.geom.class.multipath.failloop.failloop fails due to too many CTF entries
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.fre

FreeBSD CI Weekly Report 2020-01-05

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-05
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-12-30 to 2020-01-05.

During this period, we have:

* 2029 builds (91.5% (-3.6) passed, 8.5% (+3.6) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 258 test runs (89.9% (+1) passed, 2.7% (+0.2) unstable, 7.4% (-1.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 64 doc builds (100% (0) passed)

Test case status (on 2020-01-05 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7645 (+9) | 7575 (+8) | 0 (0) | 70 (+1) |
| head/i386   | 7643 (+9) | 7569 (+6) | 0 (0) | 74 (+3) |
| 12-STABLE/amd64 | 7495 (+4) | 7447 (+7) | 0 (0) | 48 (-3) |
| 12-STABLE/i386  | 7493 (+4) | 7438 (+4) | 0 (0) | 55 (0)  |
| 11-STABLE/amd64 | 6860 (0)  | 6813 (0)  | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6858 (0)  | 6809 (+3) | 0 (0) | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200105 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* LTP (Linux Test Project) for Linux compatibility layer job is added:
  https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
  More information is available at https://wiki.freebsd.org/linux-kernel/
  
## Failing build

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  There are some issues after PowerPC switch to llvm toolchain.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 2061 tests, 898 success, 441 failures , 722 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/242689
  sys.g

FreeBSD CI Weekly Report 2020-01-12

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-12
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-06 to 2020-01-12.

During this period, we have:

* 2218 builds (85.6% (-5.9) passed, 14.4% +5.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 297 test runs (82.5% (-7.4) passed, 16.5% (+13.8) unstable, 1.0% (-6.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 24 doc builds (100% (0) passed)

Test case status (on 2020-01-12 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped |
| --- | -- | -- | - | --- |
| head/amd64  | 7646 (+1)  | 7579 (+4)  | 0 (0) | 67 (-3) |
| head/i386   | 7644 (+1)  | 7573 (+4)  | 0 (0) | 71 (-3) |
| 12-STABLE/amd64 | 7520 (+25) | 7469 (+22) | 0 (0) | 51 (+3) |
| 12-STABLE/i386  | 7518 (+25) | 7462 (+24) | 0 (0) | 56 (+1) |
| 11-STABLE/amd64 | 6861 (+1)  | 6811 (-2)  | 0 (0) | 50 (+3) |
| 11-STABLE/i386  | 6859 (+1)  | 6807 (-2)  | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200112 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* All the -head jobs except sparc64 and mips/mips64 are switched to clang/lld
  toolchain (powerpc* are using GNU ld except powerpc64) for preparing the GCC
  4.2.1 removal. Now the official toolchain of mips* are mips*-gcc6 packages
  (devel/freebsd-gcc6 in ports with mips* FLAVOR)
  For more information, please check:
* ["Gcc 4.2.1 to be removed before FreeBSD 13, a firm timeline" on 
freebsd-arch@ mailing 
list](https://lists.freebsd.org/pipermail/freebsd-arch/2020-January/019823.html)
* "Default Tool Chain" section of arch(7)
* https://wiki.freebsd.org/ExternalGCC
  
## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  Broken after PowerPC switch to llvm toolchain, waiting for
  https://reviews.llvm.org/D72014 merged.

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+1609), 2274 success (+1376), 587 failures (+146), 809 
skipped (+87)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/te

FreeBSD CI Weekly Report 2020-01-19

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-19
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-13 to 2020-01-19.

During this period, we have:

* 2185 builds (85.3% (-0.3) passed, 14.7% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 340 test runs (82.0% (-0.5) passed, 12.1% (-4.4) unstable, 5.9% (+4.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 34 doc builds (100% (0) passed)

Test case status (on 2020-01-19 23:59):
| Branch/Architecture | Total| Pass  | Fail  | Skipped |
| --- |  | - | - | --- |
| head/amd64  | 7646 (0) | 7576 (-3) | 0 (0) | 70 (+3) |
| head/i386   | 7644 (0) | 7570 (-3) | 0 (0) | 74 (+3) |
| 12-STABLE/amd64 | 7520 (0) | 7472 (+3) | 0 (0) | 48 (-3) |
| 12-STABLE/i386  | 7518 (0) | 7462 (0)  | 0 (0) | 56 (0)  |
| 11-STABLE/amd64 | 6861 (0) | 6814 (+3) | 0 (0) | 47 (-3) |
| 11-STABLE/i386  | 6859 (0) | 6807 (0)  | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200119 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* All the -head jobs except sparc64 and mips/mips64 are switched to clang/lld
  toolchain (powerpc* are using GNU ld except powerpc64) for preparing the GCC
  4.2.1 removal. Now the official toolchain of mips* are mips*-gcc6 packages
  (devel/freebsd-gcc6 in ports with mips* FLAVOR)
  For more information, please check:
* ["Gcc 4.2.1 to be removed before FreeBSD 13, a firm timeline" on 
freebsd-arch@ mailing 
list](https://lists.freebsd.org/pipermail/freebsd-arch/2020-January/019823.html)
* "Default Tool Chain" section of arch(7)
* https://wiki.freebsd.org/ExternalGCC
  
## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  Broken after PowerPC switch to llvm toolchain, waiting for
  https://reviews.llvm.org/D72014 merged.

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+1609), 2278 success (+4), 583 failures (-4), 809 
skipped (+87)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.mu

FreeBSD CI Weekly Report 2020-01-26

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-26
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-20 to 2020-01-26.

During this period, we have:

* 2153 builds (89.4% (+4.1) passed, 10.6% (-4.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 356 test runs (64.6% (-17.4) passed, 26.4% (+14.3) unstable, 9.0% (+3.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 59 doc builds (98.3% (-1.7) passed, 1.7% (+1.7) failed)

Test case status (on 2020-01-26 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped |
| --- | -- | -- | - | --- |
| head/amd64  | 7662 (+16) | 7594 (+18) | 0 (0) | 68 (-2) |
| head/i386   | 7660 (+16) | 7588 (+18) | 0 (0) | 72 (-2) |
| 12-STABLE/amd64 | 7520 (0)   | 7472 (0)   | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7518 (0)   | 7462 (0)   | 0 (0) | 56 (0)  |
| 11-STABLE/amd64 | 6861 (0)   | 6814 (0)   | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6859 (0)   | 6807 (0)   | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200126 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2275 success (-3), 586 failures (+3), 809 skipped 
(+0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689
* sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child (new)
  https://bugs.freebsd.org/243605

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/23740

FreeBSD CI Weekly Report 2020-02-02

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-02
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-27 to 2020-02-02.

During this period, we have:

* 2188 builds (88.6% (-0.8) passed, 11.4% (+0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 347 test runs (70.3% (+5.7) passed, 17.0% (-9.4) unstable, 12.7% (+3.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 42 doc builds (95.2% (-3.1) passed, 4.8% (+3.1) failed)

Test case status (on 2020-02-02 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7673 (+11) | 7604 (+10) | 1 (+1) | 68 (0)  |
| head/i386   | 7671 (+11) | 7599 (+11) | 0 (0)  | 72 (0)  |
| 12-STABLE/amd64 | 7520 (0)   | 7472 (0)   | 0 (0)  | 48 (0)  |
| 12-STABLE/i386  | 7518 (0)   | 7459 (-3)  | 0 (0)  | 59 (+3) |
| 11-STABLE/amd64 | 6861 (0)   | 6811 (-3)  | 0 (0)  | 50 (+3) |
| 11-STABLE/i386  | 6859 (0)   | 6810 (+3)  | 0 (0)  | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200202 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failed and fixed tests

* i386 boot panics after r357314
  https://bugs.freebsd.org/243837
  Fixed in r357463

* sys.capsicum.capsicum-test.main fails after r357412
  https://bugs.freebsd.org/243839
  Fixed in r357461


## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2277 success (+2), 587 failures (+1), 806 skipped 
(-3)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689
* sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child
  https://bugs.freebsd.org/243605

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/2

FreeBSD CI Weekly Report 2020-02-09

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-09
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-03 to 2020-02-09.

During this period, we have:

* 2010 builds (87.3% (+) passed, 12.7% () failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 324 test runs (61.7% (+) passed, 28.1% (-) unstable, 10.2% ()
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (96% (0) passed, 4.0% () failed)

Test case status (on 2020-02-09 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7673 (0)   | 7597 (-7)  | 5 (+4) | 71 (+3) |
| head/i386   | 7671 (0)   | 7595 (-4)  | 4 (+4) | 72 (0)  |
| 12-STABLE/amd64 | 7520 (0)   | 7469 (-3)  | 0 (0)  | 51 (+3) |
| 12-STABLE/i386  | 7518 (0)   | 7462 (+3)  | 0 (0)  | 56 (-3) |
| 11-STABLE/amd64 | 6861 (0)   | 6811 (0)   | 0 (0)  | 50 (0)  |
| 11-STABLE/i386  | 6859 (0)   | 6810 (0)   | 0 (0)  | 49 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200209 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* https://ci.freebsd.org/job/FreeBSD-doc-head/ now includes building htdoc,
  the source of https://www.FreeBSD.org

## Failing builds and tests

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/

* sys.geom.class.multipath.failloop.failloop

## Failed and fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
  Workaround: disable GOOGLETEST:
  https://svnweb.freebsd.org/changeset/base/357703
  More information is available at https://reviews.freebsd.org/D23128

* i386 boot panics after r357314
  https://bugs.freebsd.org/243837
  Fixed in r357463

* sys.capsicum.capsicum-test.main fails after r357412
  https://bugs.freebsd.org/243839
  Fixed in r357461

* lib.libc.gen.setdomainname_test.setdomainname_basic
* sys.mac.portacl.nobody_test.main
* sys.mac.portacl.root_test.main
  Fixed in https://svnweb.freebsd.org/changeset/base/357745

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2290 success (+13), 574 failures (-13), 806 
skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/2

FreeBSD CI Weekly Report 2020-02-16

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-16
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-10 to 2020-02-16.

During this period, we have:

* 2180 builds (90.7% (+3.4) passed, 9.3% (-3.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 336 test runs (60.1% (-1.6) passed, 29.5% (+1.4) unstable, 10.4% (-0.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 33 doc and www builds (97% (+1.0) passed, 3.0% (-1.0) failed)

Test case status (on 2020-02-16 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7738 (+65) | 7646 (+49) | 0 (-5) | 92 (+21) |
| head/i386   | 7736 (+65) | 7640 (+45) | 0 (-4) | 96 (+24) |
| 12-STABLE/amd64 | 7543 (+23) | 7494 (+25) | 0 (0)  | 49 (-2)  |
| 12-STABLE/i386  | 7541 (+23) | 7484 (+22) | 0 (0)  | 57 (+1)  |
| 11-STABLE/amd64 | 6871 (+10) | 6824 (+13) | 0 (0)  | 47 (-3)  |
| 11-STABLE/i386  | 6869 (+10) | 6820 (+10) | 0 (0)  | 49 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200216 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Regression

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Fixed tests

* sys.netipsec.tunnel.aes_cbc_128_hmac_sha1.v4
  https://bugs.freebsd.org/244077

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2290 success (+13), 574 failures (-13), 806 
skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689
* sys.kern.ptrace_test.ptrace__procdesc_reparen

FreeBSD CI Weekly Report 2020-02-23

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-23
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-17 to 2020-02-23.

During this period, we have:

* 1969 builds (87.7% (-3.0) passed, 12.3% (+3.0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 307 test runs (66.8% (+6.7) passed, 30.3% (+0.8) unstable, 2.9% (-7.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (96% (-3.0) passed, 4.0% (+3.0) failed)

Test case status (on 2020-02-23 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7699 (-39) | 7601 (-45) | 6 (+6) | 92 (0)  |
| head/i386   | 7697 (-39) | 7593 (-47) | 6 (+6) | 98 (+2) |
| 12-STABLE/amd64 | 7501 (-42) | 7444 (-50) | 0 (0)  | 57 (+8) |
| 12-STABLE/i386  | 7499 (-42) | 7450 (-34) | 0 (0)  | 49 (-8) |
| 11-STABLE/amd64 | 6878 (+7)  | 6831 (+7)  | 0 (0)  | 47 (0)  |
| 11-STABLE/i386  | 6876 (+7)  | 6824 (+4)  | 0 (0)  | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200223 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* FreeBSD-head-sparc64-build has been disabled since 2020-02-20

* Default amd64 GCC build job has been swtich to
  https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build which uses 
devel/amd64-gcc6,
  https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build uses devel/amd64-gcc
  has been deprecated.

## Failed and Fixed tests

* sys.file.flock_test.main panics kernel after [r358153, r358170]
  https://bugs.freebsd.org/244250

## Regressions

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2290 success (0), 574 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarc

FreeBSD CI Weekly Report 2020-03-01

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-01
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-24 to 2020-03-01.

During this period, we have:

* 1930 builds (87.4% (-0.3) passed, 12.6% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 288 test runs (77.5% (+10.7) passed, 21.5% (-8.8) unstable, 1.0% (-1.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 17 doc and www builds (94.1% (-1.9) passed, 5.9% (+1.9) failed)

Test case status (on 2020-03-01 23:59):
| Branch/Architecture | Total| Pass  | Fail   | Skipped |
| --- |  | - | -- | --- |
| head/amd64  | 7699 (0) | 7598 (-3) | 9 (+3) | 92 (0)  |
| head/i386   | 7697 (0) | 7590 (-3) | 9 (+3) | 98 (0)  |
| 12-STABLE/amd64 | 7501 (0) | 7452 (+8) | 0 (0)  | 49 (-8) |
| 12-STABLE/i386  | 7499 (0) | 7442 (-8) | 0 (0)  | 57 (+8) |
| 11-STABLE/amd64 | 6878 (0) | 6828 (-3) | 0 (0)  | 50 (+3) |
| 11-STABLE/i386  | 6876 (0) | 6827 (+3) | 0 (0)  | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200301 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.


## Failed and Fixed tests

* sys.netpfil.pf.fragmentation.v6
  https://bugs.freebsd.org/244393

* 9 sys.audit. tests
  https://bugs.freebsd.org/244537

## Regressions

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.cl

FreeBSD CI Weekly Report 2020-03-08

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-08
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-02 to 2020-03-08.

During this period, we have:

* 2239 builds (48.2% (-39.2) passed, 51.8 (+39.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 120 test runs (87.5% (+10.0) passed, 4.2% (-17.3) unstable, 8.3% (+7.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 29 doc and www builds (82.8% (-11.3) passed, 17.2% (+11.3) failed)

Test case status (on 2020-03-08 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7709 (+10) | 7617 (+19) | 0 (-9) | 92 (0)  |
| head/i386   | 7707 (+10) | 7609 (+19) | 0 (-9) | 98 (0)  |
| 12-STABLE/amd64 | 7501 (0)   | 7452 (0)   | 0 (0)  | 49 (0)  |
| 12-STABLE/i386  | 7499 (0)   | 7442 (0)   | 0 (0)  | 57 (0)  |
| 11-STABLE/amd64 | 6878 (0)   | 6831 (+3)  | 0 (0)  | 47 (-3) |
| 11-STABLE/i386  | 6876 (0)   | 6824 (-3)  | 0 (0)  | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200308 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* Most of the build was failed due to pkg repository ABI mismatching. (Fixed)
  For more details: https://bugs.freebsd.org/244549

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build
  This job is using devel/gcc6@mips64 port (mips64-gcc6 pacakge)
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
   
  *** [mount.h] Error code 1
  
  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test
  Usually panics when executing sys.netpfil.pf.nat.exhaust
  For more details: https://bugs.freebsd.org/244703

## Regressions

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.l

FreeBSD CI Weekly Report 2020-03-15

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-15
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-09 to 2020-03-15.

During this period, we have:

* 1903 builds (90.1% (+41.9) passed, 9.9% (-41.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 293 test runs (75.1% (-12.4) passed, 17.1% (+12.9) unstable, 7.8% (-0.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 34 doc and www builds (88.2% (+5.4) passed, 11.8 (-5.4) failed)

Test case status (on 2020-03-15 23:59):
| Branch/Architecture | Total  | Pass  | Fail  | Skipped  |
| --- | -- | - | - |  |
| head/amd64  | 7721 (+12) | 7624 (+7) | 0 (0) | 97 (+5)  |
| head/i386   | 7719 (+12) | 7613 (+4) | 0 (0) | 106 (+8) |
| 12-STABLE/amd64 | 7506 (+5)  | 7453 (+1) | 0 (0) | 53 (+4)  |
| 12-STABLE/i386  | 7504 (+5)  | 7443 (+1) | 0 (0) | 61 (+4)  |
| 11-STABLE/amd64 | 6880 (+2)  | 6833 (+2) | 0 (0) | 47 (0)   |
| 11-STABLE/i386  | 6878 (+2)  | 6826 (+2) | 0 (0) | 52 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200315 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build
  This job is using devel/gcc6@mips64 port (mips64-gcc6 pacakge)
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
 
  *** [mount.h] Error code 1

  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test
  Usually panics when executing sys.netpfil.pf.nat.exhaust
  For more details: https://bugs.freebsd.org/244703

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/

FreeBSD CI Weekly Report 2020-03-22

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)a

FreeBSD CI Weekly Report 2020-03-22
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-16 to 2020-03-22.

During this period, we have:

* 1907 builds (90.7% (+0.6) passed, 9.3% (-0.6) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 307 test runs (95.4% (+20.3) passed, 3.3% (-13.8) unstable, 1.3% (-6.5
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 33 doc and www builds (78.8% (-9.4) passed, 21.2 (+9.4) failed)

Test case status (on 2020-03-22 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7722 (+1) | 7625 (+1) | 0 (0) | 97 (0)  |
| head/i386   | 7720 (+1) | 7614 (+1) | 0 (0) | 106 (0) |
| 12-STABLE/amd64 | 7506 (0)  | 7453 (0)  | 0 (0) | 53 (0)  |
| 12-STABLE/i386  | 7504 (0)  | 7440 (-3) | 0 (0) | 64 (+3) |
| 11-STABLE/amd64 | 6880 (0)  | 6833 (0)  | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6878 (0)  | 6826 (0)  | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200322 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build
  This error was encountered when this job was using devel/gcc6@mips64 port 
(mips64-gcc6 pacakge)
  This job was switched to use clang/lld on 2020-03-24. Gcc job will be added 
later.
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
 
  *** [mount.h] Error code 1

  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 80

FreeBSD CI Weekly Report 2020-03-29

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-29
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-23 to 2020-03-29.

During this period, we have:

* 1811 builds (93.5% (+2.8) passed, 6.5% () failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 293 test runs (54.3% (-41.1) passed, 43.7% (+40.4) unstable, 2.0% (+0.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 21 doc and www builds (95.2% (+16.4) passed, 4.8 (-16.4) failed)

Test case status (on 2020-03-29 23:59):
| Branch/Architecture | Total  | Pass  | Fail   | Skipped  |
| --- | -- | - | -- |  |
| head/amd64  | 7736 (+14) | 7625 (0)  | 5 (+5) | 106 (+9) |
| head/i386   | 7734 (+14) | 7617 (+3) | 5 (+5) | 112 (+6) |
| 12-STABLE/amd64 | 7506 (0)   | 7450 (-3) | 0 (0)  | 56 (+3)  |
| 12-STABLE/i386  | 7504 (0)   | 7443 (+3) | 0 (0)  | 61 (-3)  |
| 11-STABLE/amd64 | 6880 (0)   | 6830 (-3) | 0 (0)  | 50 (+3)  |
| 11-STABLE/i386  | 6878 (0)   | 6826 (0)  | 0 (0)  | 52 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200329 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* After [r359233](https://svnweb.freebsd.org/changeset/base/359233),
  all the supported architectures are using clang/lld as default toolchain,
  and [CI.FreeBSD.org 
follows](https://github.com/freebsd/freebsd-ci/commit/5e8704617365488891576e27d4325e0474bc90de).
  Now FreeBSD-head-mips64-build job is fine but please note that using
  mips64-gcc6 as external toolchain still fails.

* Two powerpc64 jobs are added:
  * FreeBSD-head-powerpc64-images
  * FreeBSD-head-powerpc64-testvm
  The images are available at https://artifact.ci.freebsd.org

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build (now switched to 
clang/lld, gcc6 build will be moved to FreeBSD-head-mips64-gcc6_build)
  This error was encountered when this job was using devel/gcc6@mips64 port 
(mips64-gcc6 pacakge)
  This job was switched to use clang/lld on 2020-03-24. Gcc job will be added 
later.
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
 
  *** [mount.h] Error code 1

  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test

FreeBSD CI Weekly Report 2020-04-05

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-05
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-30 to 2020-04-05.

During this period, we have:

* 1715 builds (93.6% (+0.1) passed, 6.4% (-0.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 274 test runs (49.7% (-4.6) passed, 19.3% (-24.4) unstable, 31.0% (+29.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (84.6 (-10.6) passed, 15.4% (+10.6) failed)

Test case status (on 2020-04-05 23:59):
| Branch/Architecture | Total | Pass  | Fail| Skipped  |
| --- | - | - | --- |  |
| head/amd64  | 7740 (+4) | 7619 (-6) | 9 (+4)  | 112 (+6) |
| head/i386   | 7738 (+4) | 7613 (-4) | 11 (+6) | 114 (+2) |
| 12-STABLE/amd64 | 7508 (+2) | 7452 (+2) | 0 (0)   | 56 (0)   |
| 12-STABLE/i386  | 7506 (+2) | 7442 (-1) | 0 (0)   | 64 (+3)  |
| 11-STABLE/amd64 | 6882 (+2) | 6835 (+5) | 0 (0)   | 47 (-3)  |
| 11-STABLE/i386  | 6880 (+2) | 6831 (+5) | 0 (0)   | 49 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200405 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* New armv6 job is added:
  * FreeBSD-head-armv6-testvm
  The images are available at https://artifact.ci.freebsd.org

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  * See console log for the error details.

## Failing tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
  Some test cases not correctly skipped because test env loads the
  wrong kyua.conf after kyua imported to the base.
  * lib.libproc.proc_test.symbol_lookup
  * lib.msun.ctrig_test.test_inf_inputs
  * local.kyua.integration.cmd_about_test.topic__authors__installed
  * sys.kern.ptrace_test.ptrace__parent_wait_after_attach
  * sys.netipsec.tunnel.empty.v4
  * sys.netipsec.tunnel.empty.v6
  * sys.opencrypto.blake2_test.blake2b_vectors_x86
  * sys.opencrypto.blake2_test.blake2s_vectors_x86
  * usr.bin.calendar.legacy_test.main

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
  All amd64 failures and:
  * sys.kern.ptrace_test.ptrace__parent_exits_before_child
  * sys.net.if_lagg_test.witness

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_b

FreeBSD CI Weekly Report 2020-04-12

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-12
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-06 to 2020-04-12.

During this period, we have:

* 1801 builds (94.0% (+0.4) passed, 6.0% (-0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 288 test runs (25.1% (-24.6) passed, 29.9% (+10.6) unstable, 45.1% (+14.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc and www builds (83.3% (-1.3) passed, 16.7% (+1.3) failed)

Test case status (on 2020-04-12 23:59):
| Branch/Architecture | Total | Pass   | Fail | Skipped  |
| --- | - | -- |  |  |
| head/amd64  | 7744 (+4) | 7638 (+19) | 14 (+5)  | 92 (-20) |
| head/i386   | 7742 (+4) | 7628 (+15) | 16 (+5)  | 98 (-16) |
| 12-STABLE/amd64 | 7508 (0)  | 7449 (-3)  | 1 (+1)   | 58 (+2)  |
| 12-STABLE/i386  | 7506 (0)  | 7425 (-17) | 2 (+2)   | 79 (+15) |
| 11-STABLE/amd64 | 6882 (0)  | 6829 (-6)  | 1 (+1)   | 52 (+5)  |
| 11-STABLE/i386  | 6880 (0)  | 6749 (-82) | 80 (+80) | 51 (+2)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200412 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* The test env now loads the required module for firewall tests.

* New armv7 job is added (to replace armv6 one):
  * FreeBSD-head-armv7-testvm
  The images are available at https://artifact.ci.freebsd.org
  FreeBSD-head-armv7-test is ready but needs test env update.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  * See console log for the error details.

## Failing tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
  * local.kyua.integration.cmd_about_test.topic__authors__installed
  * sys.netipsec.tunnel.empty.v4
  * sys.netipsec.tunnel.empty.v6
  * sys.netpfil.common.forward.ipf_v4
  * sys.netpfil.common.forward.ipfw_v4
  * sys.netpfil.common.forward.pf_v4
  * sys.netpfil.common.tos.ipfw_tos
  * sys.netpfil.common.tos.pf_tos
  * sys.netpfil.pf.forward.v4
  * sys.netpfil.pf.set_tos.v4
  * sys.opencrypto.blake2_test.blake2b_vectors_x86
  * sys.opencrypto.blake2_test.blake2s_vectors_x86

  * sbin.nvmecontrol.basic.__test_cases_list__
Fixed in r359903
  * usr.bin.calendar.legacy_test.main
Fixed in r359862

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
  All amd64 failures and:
  * sys.netinet.divert.ipdivert_ip_input_local_success
  * sys.netinet.divert.ipdivert_ip_output_remote_success

* https://ci.freebsd.org/job/FreeBSD-stable-12-amd64-test/
  * usr.bin.calendar.legacy_test.main
Fixed in r359863
  * sbin.nvmecontrol.basic.__test_cases_list__
Fixed in r359904

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
  * usr.bin.calendar.legacy_test.main
Fixed in r359863

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
  * usr.bin.calendar.legacy_test.main
Fixed in r359864

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
  Many failure all due to kyua.conf issue.  Already fixed on 2020-04-13.

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freeb

FreeBSD CI Weekly Report 2020-04-19

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-19
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-13 to 2020-04-19.

During this period, we have:

* 2136 builds (89.3% (-4.7) passed, 10.7% (+4.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 333 test runs (42.0% (+17.0) passed, 55.9% (+26.0) unstable, 2.1% (-43.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 20 doc and www builds (95.0% (+11.7) passed, 5.0% (-11.7) failed)

Test case status (on 2020-04-19 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7756 (+12) | 7657 (+19) | 5 (-9)  | 94 (+2)  |
| head/i386   | 7754 (+12) | 7646 (+18) | 8 (-8)  | 100 (+2) |
| 12-STABLE/amd64 | 7518 (+10) | 7462 (+13) | 0 (-1)  | 56 (-2)  |
| 12-STABLE/i386  | 7516 (+10) | 7452 (+27) | 0 (-2)  | 64 (-15) |
| 11-STABLE/amd64 | 6882 (0)   | 6830 (+1)  | 0 (-1)  | 52 (0)   |
| 11-STABLE/i386  | 6880 (0)   | 6826 (+77) | 0 (-80) | 54 (+3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200419 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Failing tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
  * local.kyua.integration.cmd_about_test.topic__authors__installed
  * sys.netipsec.tunnel.empty.v4
  * sys.netipsec.tunnel.empty.v6
  * sys.opencrypto.blake2_test.blake2b_vectors_x86
  * sys.opencrypto.blake2_test.blake2s_vectors_x86

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
  All amd64 failures and:
  * sys.kqueue.libkqueue.kqueue_test.main
  * sys.netinet.divert.ipdivert_ip_input_local_success
  * sys.netinet.divert.ipdivert_ip_output_remote_success

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebs

FreeBSD CI Weekly Report 2020-04-26

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-26
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-20 to 2020-04-26.

During this period, we have:

* 2503 builds (94.4% (+5.1) passed, 5.6% (-5.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 402 test runs (62.5% (+20.5) passed, 34.8% (-21.1) unstable, 2.7% (+0.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 19 doc and www builds (84.2% (-10.8) passed, 15.8% (+10.8) failed)

Test case status (on 2020-04-26 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7768 (+12) | 7675 (+18) | 0 (-5) | 93 (-1)  |
| head/i386   | 7766 (+12) | 7665 (+19) | 0 (-8) | 101 (+1) |
| 12-STABLE/amd64 | 7518 (0)   | 7462 (0)   | 0 (0)  | 56 (0)   |
| 12-STABLE/i386  | 7516 (0)   | 7452 (0)   | 0 (0)  | 64 (0)   |
| 11-STABLE/amd64 | 6883 (+1)  | 6834 (+4)  | 0 (0)  | 49 (-3)  |
| 11-STABLE/i386  | 6881 (+1)  | 6830 (+4)  | 0 (0)  | 51 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200426 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Fixed tests

* sys.netpfil.common.*
  Fixed by patching scapy, more details:
  https://lists.freebsd.org/pipermail/freebsd-testing/2020-April/002278.html

* timer tests of sys.kqueue.libkqueue.kqueue_test.main failing on i386
  https://bugs.freebsd.org/245768
  This is fixed in r360108 and r360140, and the case found another issue in 
compat32, which is fixed in r360155.

* sys.opencrypto.blake2_test.blake2{b,s}_vectors_x86 failed after r359374
  https://bugs.freebsd.org/245825
  test cases are fixed in r360203

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158
  
* sys.netipsec.tunnel.empty.v{4,6} fail after r359374
  https://bugs.freebsd.org/245832
  This is probably some sort of regression (of null cipher) in r359374

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212

FreeBSD CI Weekly Report 2020-05-03

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-03
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-27 to 2020-05-03.

During this period, we have:

* 2099 builds (93.6% (-0.8) passed, 6.4% (+0.8) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 327 test runs (68.2% (+5.7) passed, 28.1% (-6.7) unstable, 3.7% (+1.0)
  exception) were executed on amd64, i386, riq scv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (84.6% (+0.4) passed, 15.4% (-0.4) failed)

Test case status (on 2020-05-03 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7778 (+10) | 7685 (+10) | 0 (0)  | 93 (0)   |
| head/i386   | 7776 (+10) | 7676 (+11) | 0 (0)  | 100 (-1) |
| 12-STABLE/amd64 | 7521 (+3)  | 7463 (+1)  | 2 (+2) | 56 (0)   |
| 12-STABLE/i386  | 7519 (+3)  | 7453 (+1)  | 2 (+2) | 64 (0)   |
| 11-STABLE/amd64 | 6883 (0)   | 6834 (0)   | 0 (0)  | 49 (0)   |
| 11-STABLE/i386  | 6881 (0)   | 6830 (0)   | 0 (0)  | 51 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200503 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Fixed tests

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229
  Fixed in r360567

* sys.netipsec.tunnel.empty.v{4,6} fail after r359374
  https://bugs.freebsd.org/245832
  Fixed in r360560

## Failing (and fixed) jobs

* https://ci.freebsd.org/job/FreeBSD-head-powerpc-build/
  https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  Failing after r360569 and fixed in r360788

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* (head, stable/12) 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afin

FreeBSD CI Weekly Report 2020-05-10

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-10
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-04 to 2020-05-10.

During this period, we have:

* 2003 builds (92.1% (-1.5) passed, 7.9% (+1.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (23.7% (-44.5) passed, 35.0% (+6.9) unstable, 41.3% (+37.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 68 doc and www builds (79.4% (-5.2) passed, 20.6% (+5.2) failed)

Test case status (on 2020-05-10 23:59):
| Branch/Architecture | Total | Pass   | Fail | Skipped |
| --- | - | -- |  | --- |
| head/amd64  | 7782 (+4) | 7692 (+7)  | 0 (0)| 90 (-3) |
| head/i386   | 7780 (+4) | 7682 (+6)  | 0 (0)| 98 (-2) |
| 12-STABLE/amd64 | 7521 (0)  | 7460 (-3)  | 0 (-2)   | 61 (+5) |
| 12-STABLE/i386  | 7519 (0)  | 7453 (0)   | 0 (-2)   | 66 (+2) |
| 11-STABLE/amd64 | 6883 (0)  | 6833 (-1)  | 1 (+1)   | 49 (0)  |
| 11-STABLE/i386  | 6881 (0)  | 6816 (-14) | 14 (+14) | 51 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200510 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* Several non-x86 jobs for -head are added:
  * https://ci.freebsd.org/job/FreeBSD-head-aarch64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-armv7-test/
  * https://ci.freebsd.org/job/FreeBSD-head-mips64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-powerpc64-test/
  Most of the work are done by trasz@
  These jobs will be scheduled to run at least once a day after the dedicated 
VM host has been setup.

## Fixed test cases

* lib.libproc.proc_test.symbol_lookup
  Fixed in https://svnweb.freebsd.org/changeset/base/360979

## Fixed and fixed test cases

* lib.atf.* and libexec.atf.* on stable/11
  Failed after llvm9 merged, fixed after build 
https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2662/ with fixeds merged.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* (head, stable/12, stable/11) 3 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158
  Will be fixed after r360807 merged to stable/12.

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main

FreeBSD CI Weekly Report 2020-05-17

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-17
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-11 to 2020-05-17.

During this period, we have:

* 1977 builds (94.6% (+2.5) passed, 5.4% (-2.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 236 test runs (41.1% (+17.4) passed, 33.9% (-1.1) unstable, 25.0% (-16.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 33 doc and www builds (97.0% (+17.6) passed, 3.0% (-17.6) failed)

Test case status (on 2020-05-17 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7828 (+46) | 7737 (+45) | 1 (+1)  | 90 (0)   |
| head/i386   | 7826 (+46) | 7725 (+43) | 0 (0)   | 101 (+3) |
| 12-STABLE/amd64 | 7542 (+21) | 7484 (+24) | 0 (0)   | 58 (-3)  |
| 12-STABLE/i386  | 7540 (+21) | 7471 (+18) | 0 (0)   | 69 (+3)  |
| 11-STABLE/amd64 | 6883 (0)   | 6830 (-3)  | 0 (-1)  | 53 (+4)  |
| 11-STABLE/i386  | 6881 (0)   | 6829 (+13) | 0 (-14) | 52 (+1)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200517 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* (new) lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on 
amd64 after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158
  Will be fixed after r360807 merged to stable/12.

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.f

FreeBSD CI Weekly Report 2020-05-24

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-24
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-18 to 2020-05-24.

During this period, we have:

* 2064 builds (94.6% (0) passed, 5.4% (0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 232 test runs (59.9% (+18.8) passed, 27.6% (-6.3) unstable, 12.5% (-12.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 40 doc and www builds (100% (+3.0) passed)

Test case status (on 2020-05-24 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7829 (+1)  | 7736 (-1)  | 0 (-1) | 93 (+3) |
| head/i386   | 7827 (+1)  | 7730 (+5)  | 0 (0)  | 97 (-4) |
| 12-STABLE/amd64 | 7583 (+41) | 7526 (+42) | 0 (0)  | 57 (-1) |
| 12-STABLE/i386  | 7581 (+41) | 7516 (+45) | 0 (0)  | 65 (-4) |
| 11-STABLE/amd64 | 6883 (0)   | 6830 (0)   | 0 (0)  | 53 (0)  |
| 11-STABLE/i386  | 6881 (0)   | 6829 (0)   | 0 (0)  | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200524 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* Compression algorithm of disk images at https://artifacts.ci.freebsd.org has 
been changed to zstd.

## Fixed test cases

* sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 

FreeBSD CI Weekly Report 2020-05-31

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-31
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-25 to 2020-05-31.

During this period, we have:

* 1877 builds (87.3% (-7.3) passed, 12.7% (+7.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 217 test runs (78.8% (+18.9) passed, 20.3% (-11.6) unstable, 0.9% (-7.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 12 doc and www builds (100% (+0) passed)

Test case status (on 2020-05-31 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped |
| --- | - | - | -- | --- |
| head/amd64  | 7830 (+1) | 7740 (+4) | 0 (+0) | 90 (-3) |
| head/i386   | 7828 (+1) | 7731 (+1) | 0 (+0) | 97 (+0) |
| 12-STABLE/amd64 | 7586 (+3) | 7530 (+4) | 0 (+0) | 56 (-1) |
| 12-STABLE/i386  | 7584 (+3) | 7520 (+4) | 0 (+0) | 64 (-1) |
| 11-STABLE/amd64 | 6883 (+0) | 6833 (+3) | 0 (+0) | 50 (-3) |
| 11-STABLE/i386  | 6881 (+0) | 6826 (-3) | 0 (+0) | 55 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200531 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebs

FreeBSD CI Weekly Report 2020-06-07

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-07
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-31 to 2020-06-07.

During this period, we have:

* 2077 builds (88.6% (+1.3) passed, 11.4% (-1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 241 test runs (76.8% (-10.5) passed, 20.7% (+20.7) unstable, 2.5% (-10.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 52 doc and www builds (100% (+0) passed)

Test case status (on 2020-06-07 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped |
| --- | - | - | -- | --- |
| head/amd64  | 7833 (+3) | 7741 (+1) | 0 (+0) | 92 (+2) |
| head/i386   | 7831 (+3) | 7735 (+4) | 0 (+0) | 96 (-1) |
| 12-STABLE/amd64 | 7586 (+0) | 7527 (-3) | 0 (+0) | 59 (+3) |
| 12-STABLE/i386  | 7584 (+0) | 7517 (-3) | 0 (+0) | 67 (+3) |
| 11-STABLE/amd64 | 6883 (+0) | 6830 (-3) | 0 (+0) | 53 (+3) |
| 11-STABLE/i386  | 6881 (+0) | 6829 (+3) | 0 (+0) | 52 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200607 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freeb

FreeBSD CI Weekly Report 2020-06-14

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-14
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-08 to 2020-06-14.

During this period, we have:

* 1798 builds (90.0% (+1.4) passed, 10.0% (-1.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 199 test runs (77.9% (+1.1) passed, 20.6% (-0.1) unstable, 1.5% (-1.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 29 doc and www builds (96.6% (-3.4) passed, 3.4% (+3.4) failed)

Test case status (on 2020-06-14 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7863 (+30) | 7773 (+32) | 0 (+0) | 90 (-2) |
| head/i386   | 7861 (+30) | 7762 (+27) | 0 (+0) | 99 (+3) |
| 12-STABLE/amd64 | 7587 (+1)  | 7528 (+1)  | 0 (+0) | 59 (+0) |
| 12-STABLE/i386  | 7585 (+1)  | 7521 (+4)  | 0 (+0) | 64 (-3) |
| 11-STABLE/amd64 | 6885 (+2)  | 6835 (+5)  | 0 (+0) | 50 (-3) |
| 11-STABLE/i386  | 6883 (+2)  | 6831 (+2)  | 0 (+0) | 52 (+0) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200614 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 646 failures, 826 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptr

FreeBSD CI Weekly Report 2020-06-21

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-21
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-15 to 2020-06-21.

During this period, we have:

* 2272 builds (93.9% (+3.9) passed, 6.1% (-3.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 268 test runs (79.8% (+1.9) passed, 13.1% (-7.5) unstable, 7.1% (+5.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 100.0 doc and www builds (100% (+3.4) passed)

Test case status (on 2020-06-21 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7863 (0)  | 7764 (-9) | 0 (0)  | 99 (+9)  |
| head/i386   | 7861 (0)  | 7756 (-6) | 0 (0)  | 105 (+6) |
| 12-STABLE/amd64 | 7591 (+4) | 7532 (+4) | 0 (0)  | 59 (0)   |
| 12-STABLE/i386  | 7589 (+4) | 7525 (+4) | 0 (0)  | 64 (0)   |
| 11-STABLE/amd64 | 6887 (+2) | 6834 (0)  | 0 (-1) | 53 (+3)  |
| 11-STABLE/i386  | 6885 (+2) | 6833 (+3) | 0 (-1) | 52 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200621 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 646 failures, 826 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_det

Re: BerkeleyDB Hash vs Btree on FreeBSD and Linux

[Li-Wen Hsu]

On Wed, Jul 1, 2020 at 6:07 PM Nick Kostirya via freebsd-stable
 wrote:
>
> Hello.
>
> I noticed that BerkeleyDB Hash is VERY slow compared to BerkeleyDB Btree on 
> FreeBSD (UFS or ZFS).
> But they (Hash and Btree) have roughly the same performance on Linux.
>
> Why?

It's not an easy question, do you have more information about the test
environment setup, and the statistics of the results?

I'd recommend using some analysis tools like DTrace to check what it's busy for.

Li-Wen
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

Re: BerkeleyDB Hash vs Btree on FreeBSD and Linux

[Li-Wen Hsu]

On Wed, Jul 1, 2020 at 8:07 PM Nick Kostirya via freebsd-stable
 wrote:
>
> On Wed, 1 Jul 2020 18:20:19 +0800
> Li-Wen Hsu  wrote:
>
> > On Wed, Jul 1, 2020 at 6:07 PM Nick Kostirya via freebsd-stable
> >  wrote:
> > >
> > > Hello.
> > >
> > > I noticed that BerkeleyDB Hash is VERY slow compared to BerkeleyDB Btree 
> > > on FreeBSD (UFS or ZFS).
> > > But they (Hash and Btree) have roughly the same performance on Linux.
> > >
> > > Why?
> >
> > It's not an easy question, do you have more information about the test
> > environment setup, and the statistics of the results?

Any information about this?

> > I'd recommend using some analysis tools like DTrace to check what it's busy 
> > for.
>
>
> The top show getblk status often.
>
> Please tell me what you can and how to look with DTrace.
>
> I use
>   dtrace -n '::: /execname == "a.out"/ { @[probefunc] = count(); }'
>
> but I do not see the difference between Hash and Btree.

I would say check the flame graph:
http://www.brendangregg.com/blog/2015-03-10/freebsd-flame-graphs.html
There is benchmarks/flamegraph port but I haven't used it for a while.

Li-Wen
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2020-06-28

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-28
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-22 to 2020-06-28.

During this period, we have:

* 2388 builds (94.4% (+0.5) passed, 5.6% (-0.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (89.1% (+9.3) passed, 10.2% (-2.9) unstable, 0.7% (-6.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 96.0 doc and www builds (96.0% (-4.0) passed, 4.0% (+4.0) failed)

Test case status (on 2020-xx-xx 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped  |
| --- | - | - | - |  |
| head/amd64  | 7857 (-6) | 7766 (+2) | 0 (0) | 91 (-8)  |
| head/i386   | 7855 (-6) | 7754 (-2) | 0 (0) | 101 (-4) |
| 12-STABLE/amd64 | 7593 (+2) | 7535 (+3) | 0 (0) | 58 (-1)  |
| 12-STABLE/i386  | 7591 (+2) | 7525 (0)  | 0 (0) | 66 (+2)  |
| 11-STABLE/amd64 | 6888 (+1) | 6837 (+3) | 0 (0) | 51 (-2)  |
| 11-STABLE/i386  | 6886 (+1) | 6833 (0)  | 0 (0) | 53 (+1)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200628 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Fixed test cases

* bin.sh.execution.functional_test.bg12
  https://bugs.freebsd.org/247559

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 646 failures, 826 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_afte

FreeBSD CI Weekly Report 2020-07-05

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-07-05
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-29 to 2020-07-05.

During this period, we have:

* 1899 builds (95.7% (+1.3) passed, 4.3% (-1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 221 test runs (91.4% (+2.3) passed, 7.2% (-3.0) unstable, 1.4% (+0.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 23 doc and www builds (95.7% (-0.3) passed, 4.3% (+0.3) failed)

Test case status (on 2020-07-05 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped  |
| --- | -- | -- | - |  |
| head/amd64  | 7857 (0)   | 7762 (-4)  | 0 (0) | 95 (+4)  |
| head/i386   | 7855 (0)   | 7753 (-1)  | 0 (0) | 102 (+1) |
| 12-STABLE/amd64 | 7617 (+24) | 7556 (+21) | 0 (0) | 61 (+3)  |
| 12-STABLE/i386  | 7615 (+24) | 7546 (+21) | 0 (0) | 69 (+3)  |
| 11-STABLE/amd64 | 6912 (+24) | 6861 (+24) | 0 (0) | 51 (0)   |
| 11-STABLE/i386  | 6910 (+24) | 6857 (+24) | 0 (0) | 53 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200705 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is 
welcome.https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https

FreeBSD CI Weekly Report 2020-07-12

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-07-12
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-06 to 2020-07-12.

During this period, we have:

* 1964 builds (95.7% (+0.0) passed, 4.3% (+0.0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 225 test runs (86.7% (-4.7) passed, 13.3% (+6.1) unstable, 0.0% (-1.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 36 doc and www builds (100% (+4.3) passed)

Test case status (on 2020-07-12 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7859 (+2) | 7767 (+5) | 0 (0) | 92 (-3) |
| head/i386   | 7857 (+2) | 7758 (+5) | 0 (0) | 99 (-3) |
| 12-STABLE/amd64 | 7617 (0)  | 7557 (+1) | 0 (0) | 60 (-1) |
| 12-STABLE/i386  | 7615 (0)  | 7547 (+1) | 0 (0) | 68 (-1) |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0) | 51 (0)  |
| 11-STABLE/i386  | 6910 (0)  | 6854 (-3) | 0 (0) | 56 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200712 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib

FreeBSD CI Weekly Report 2020-07-19

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-07-19
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-13 to 2020-07-19.

During this period, we have:

* 1699 builds (93.3% (-2.4) passed, 6.7% (+2.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 191 test runs (88.0% (+1.3) passed, 12.0% (+0) unstable, 0% (-1.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 36 doc and www builds (100% (+0) passed)

Test case status (on 2020-07-19 23:59):
| Branch/Architecture | Total| Pass  | Fail  | Skipped |
| --- |  | - | - | --- |
| head/amd64  | 7859 (0) | 7768 (+1) | 0 (0) | 91 (-1) |
| head/i386   | 7857 (0) | 7759 (+1) | 0 (0) | 98 (-1) |
| 12-STABLE/amd64 | 7617 (0) | 7557 (0)  | 0 (0) | 60 (0)  |
| 12-STABLE/i386  | 7615 (0) | 7550 (+3) | 0 (0) | 65 (-3) |
| 11-STABLE/amd64 | 6912 (0) | 6861 (0)  | 0 (0) | 51 (0)  |
| 11-STABLE/i386  | 6910 (0) | 6854 (0)  | 0 (0) | 56 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200719 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.


## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

  From kevans@:
  one of ncurses' scripts that generates box and a bunch of other symbols is 
shooting blanks with gcc6, however it seems fine on gcc9.

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.pt

FreeBSD CI Weekly Report 2020-07-26

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-07-26
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-20 to 2020-07-26.

During this period, we have:

* 2211 builds (95.7% (+2.4) passed, 4.3% (-2.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 261 test runs (90.8% (+2.8) passed, 8.8% (-3.2) unstable, 0.4% (+0.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc and www builds (100% (+0) passed)

Test case status (on 2020-07-26 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped  |
| --- | -- | -- | - |  |
| head/amd64  | 7872 (+13) | 7782 (+14) | 0 (0) | 90 (-1)  |
| head/i386   | 7870 (+13) | 7770 (+11) | 0 (0) | 100 (+2) |
| 12-STABLE/amd64 | 7619 (+2)  | 7562 (+5)  | 0 (0) | 57 (-3)  |
| 12-STABLE/i386  | 7617 (+2)  | 7549 (-1)  | 0 (0) | 68 (+3)  |
| 11-STABLE/amd64 | 6912 (0)   | 6858 (-3)  | 0 (0) | 54 (+3)  |
| 11-STABLE/i386  | 6910 (0)   | 6857 (+3)  | 0 (0) | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200726 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

  From kevans@:
  one of ncurses' scripts that generates box and a bunch of other symbols is 
shooting blanks with gcc6, however it seems fine on gcc9.

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.or

FreeBSD CI Weekly Report 2020-08-02

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-02
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-27 to 2020-08-02.

During this period, we have:

* 1744 builds (95.4% (-0.3) passed, 4.6% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 207 test runs (69.0% (-21.8) passed, 30.0% (+21.2) unstable, 1.0% (+0.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (100% (+0.0) passed)

Test case status (on 2020-08-02 23:59):
| Branch/Architecture | Total| Pass  | Fail   | Skipped |
| --- |  | - | -- | --- |
| head/amd64  | 7872 (0) | 7781 (-1) | 1 (+1) | 90 (0)  |
| head/i386   | 7870 (0) | 7772 (+2) | 1 (+1) | 97 (-3) |
| 12-STABLE/amd64 | 7619 (0) | 7562 (0)  | 0 (0)  | 57 (0)  |
| 12-STABLE/i386  | 7617 (0) | 7552 (+3) | 0 (0)  | 65 (-3) |
| 11-STABLE/amd64 | 6912 (0) | 6861 (+3) | 0 (0)  | 51 (-3) |
| 11-STABLE/i386  | 6910 (0) | 6854 (-3) | 0 (0)  | 56 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200802 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

  From kevans@:
  one of ncurses' scripts that generates box and a bunch of other symbols is 
shooting blanks with gcc6, however it seems fine on gcc9.
  
  Patch by jhb@: https://reviews.freebsd.org/D25731

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/
  
* lib.googletest.gtest_main.googletest-port-test.main
  https://bugs.freebsd.org/248452

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_paren

FreeBSD CI Weekly Report 2020-08-09

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-09
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-02 to 2020-08-09.

During this period, we have:

* 1823 builds (94.0% (-1.4) passed, 6.0% (+1.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 193 test runs (96.4% (+27.4) passed, 3.1% (-26.9) unstable, 0.5% (-0.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 28 doc and www builds (100% (+0.0) passed)

Test case status (on 2020-08-09 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7874 (+2) | 7784 (+3) | 0 (-1) | 90 (0)   |
| head/i386   | 7872 (+2) | 7772 (0)  | 0 (-1) | 100 (+3) |
| 12-STABLE/amd64 | 7620 (+1) | 7560 (-2) | 0 (0)  | 60 (+3)  |
| 12-STABLE/i386  | 7618 (+1) | 7550 (-2) | 0 (0)  | 68 (+3)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0)  | 51 (0)   |
| 11-STABLE/i386  | 6910 (0)  | 6854 (0)  | 0 (0)  | 56 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200809 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/ 
  Patches to fix (partially):
  https://reviews.freebsd.org/D25953
  https://reviews.freebsd.org/D25954
  
## Fixed cases

* lib.googletest.gtest_main.googletest-port-test.main
  https://svnweb.freebsd.org/changeset/base/363821

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
*

FreeBSD CI Weekly Report 2020-08-16

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-16
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-10 to 2020-08-16.

During this period, we have:

* 2008 builds (93.7% (-0.3) passed, 6.3% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 229 test runs (87.8% (-8.6) passed, 11.8% (+8.7) unstable, 0.4% (-0.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 100 doc and www builds (100% (+0) passed)

Test case status (on 2020-08-16 23:59):
| Branch/Architecture | Total  | Pass  | Fail | Skipped |
| --- | -- | - |  | --- |
| head/amd64  | 7894 (+20) | 7786 (+2) | 18 (+18) | 90 (0)  |
| head/i386   | 7892 (+20) |  (+5) | 18 (+18) | 97 (-3) |
| 12-STABLE/amd64 | 7620 (0)   | 7563 (+3) | 0 (0)| 57 (-3) |
| 12-STABLE/i386  | 7618 (0)   | 7550 (0)  | 0 (0)| 68 (0)  |
| 11-STABLE/amd64 | 6912 (0)   | 6858 (-3) | 0 (0)| 54 (+3) |
| 11-STABLE/i386  | 6910 (0)   | 6854 (0)  | 0 (0)| 56 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200816 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress
* Work on running these tests over OpenZFS is in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  lib.libcasper.services.cap_net.net_test.*
  https://bugs.

FreeBSD CI Weekly Report 2020-08-23

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-23
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-17 to 2020-08-23.

During this period, we have:

* 2124 builds (87.9% (-5.8) passed, 12.1% (+5.8) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 238 test runs (53.4% (-34.4) passed, 35.7% (+23.9) unstable, 10.9% (+10.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 100 doc and www builds (100% (+0) passed)

Test case status (on 2020-08-23 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7875 (-19) | 7784 (-2)  | 1 (-17) | 90 (0)   |
| head/i386   | 7873 (-19) | 7776 (-1)  | 0 (-18) | 97 (0)   |
| 12-STABLE/amd64 | 7626 (+6)  | 7569 (+6)  | 0 (0)   | 57 (0)   |
| 12-STABLE/i386  | 7624 (+6)  | 7556 (+6)  | 0 (0)   | 68 (0)   |
| 11-STABLE/amd64 | 6912 (0)   | 6891 (+33) | 0 (0)   | 21 (-33) |
| 11-STABLE/i386  | 6910 (0)   | 6857 (+3)  | 0 (0)   | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200823 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* lib.libcasper.services.cap_net.net_test.* tests are temporarily disabled
  in CI env due to require to access public Internet, which is currently
  unavailable in the test VM execution environment. Safe internet access
  of the test VM is WIP but it is suggested writing tests without external
  dependenies.  This is why the total case number dropped.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  
## Failing test cases

* sys.kern.kern_copyin.kern_copyin
  Fails after somewhere in (r364509, r364542]
  https://bugs.freebsd.org/248933
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* sys.kern.kern_copyin.kern_copyin
  https://bugs.freebsd.org/248933

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress
* Work on running these tests over OpenZFS is in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_

FreeBSD CI Weekly Report 2020-08-30

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-30
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-24 to 2020-08-30.

During this period, we have:

* 2429 builds (88.3% (+0.4) passed, 11.7% (-0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 274 test runs (45.3% (-8.1) passed, 27.7% (-8.0) unstable, 27.0% (+16.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 24 doc and www builds (100% (0) passed)

Test case status (on 2020-08-30 23:59):
| Branch/Architecture | Total | Pass   | Fail  | Skipped  |
| --- | - | -- | - |  |
| head/amd64  | 7876 (+1) | 7785 (+1)  | 1 (0) | 90 (0)   |
| head/i386   | 7873 (0)  | 7773 (-3)  | 0 (0) | 100 (+3) |
| 12-STABLE/amd64 | 7626 (0)  | 7569 (0)   | 0 (0) | 57 (0)   |
| 12-STABLE/i386  | 7624 (0)  | 7559 (+3)  | 0 (0) | 65 (-3)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (-30) | 0 (0) | 51 (+30) |
| 11-STABLE/i386  | 6910 (0)  | 6854 (-3)  | 0 (0) | 56 (+3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200830 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* Numbers of FreeBSD-head-amd64-test_zfs are changed after OpenZFS importing,
  we encouage everyone check and fix the failing and skipped test cases.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Failing test cases

* sys.kern.kern_copyin.kern_copyin
  Fails after somewhere in (r364509, r364542]
  https://bugs.freebsd.org/248933
  
* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* sys.kern.kern_copyin.kern_copyin
  https://bugs.freebsd.org/248933

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 525 success, 46 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2292 success, 644 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.s

FreeBSD CI Weekly Report 2020-09-06

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-09-06
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-31 to 2020-09-06.

During this period, we have:

* 2089 builds (92.0% (+3.7) passed, 8.0% (-3.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 237 test runs (42.6% (-2.7) passed, 24.5% (-3.2) unstable, 32.9% (+5.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc and www builds (100% passed)

Test case status (on 2020-09-06 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7879 (+3) | 7789 (+4) | 0 (-1) | 90 (0)   |
| head/i386   | 7877 (+4) | 7769 (-4) | 0 (0)  | 108 (+8) |
| 12-STABLE/amd64 | 7626 (0)  | 7566 (-3) | 0 (0)  | 60 (+3)  |
| 12-STABLE/i386  | 7624 (0)  | 7556 (-3) | 0 (0)  | 68 (+3)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0)  | 51 (0)   |
| 11-STABLE/i386  | 6910 (0)  | 6857 (+3) | 0 (0)  | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200906 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Fixed test cases

* sys.kern.kern_copyin.kern_copyin
  Fails after somewhere in (r364509, r364542]
  https://bugs.freebsd.org/248933
  Fixed in r365327 and r365337

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055
  Loading zfs.ko hangs i386 kernel
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2291 success, 645 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys

FreeBSD CI Weekly Report 2020-09-13

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-09-13
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-07 to 2020-09-13.

During this period, we have:

* 2533 builds (94.0% (+2.0) passed, 6.0% (-2.0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 296 test runs (87.8% (+45.2) passed, 9.8% (-14.7) unstable, 2.4% (-30.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (100% passed)

Test case status (on 2020-09-13 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7881 (+2) | 7791 (+2) | 0 (0) | 90 (0)  |
| head/i386   | 7879 (+2) | 7771 (+2) | 0 (0) | 108 (0) |
| 12-STABLE/amd64 | 7626 (0)  | 7569 (+3) | 0 (0) | 57 (-3) |
| 12-STABLE/i386  | 7624 (0)  | 7556 (0)  | 0 (0) | 68 (0)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0) | 51 (0)  |
| 11-STABLE/i386  | 6910 (0)  | 6857 (0)  | 0 (0) | 53 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200913 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  Workaround committed and need to verify.
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.fu

FreeBSD CI Weekly Report 2020-09-20

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-09-20
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-14 to 2020-09-20.

During this period, we have:

* 2056 builds (95.5% (+1.5) passed, 4.5% (-1.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 246 test runs (62.6% (-25.2) passed, 37.0% (+27.2) unstable, 0.4% (-2.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (100% passed)

Test case status (on 2020-09-20 23:59):
| Branch/Architecture | Total  | Pass  | Fail   | Skipped   |
| --- | -- | - | -- | - |
| head/amd64  | 7894 (+13) | 7789 (-2) | 6 (+6) | 99 (+9)   |
| head/i386   | 7892 (+13) | 7767 (-4) | 6 (+6) | 119 (+11) |
| 12-STABLE/amd64 | 7628 (+2)  | 7570 (+1) | 1 (+1) | 57 (0)|
| 12-STABLE/i386  | 7626 (+2)  | 7560 (+4) | 1 (+1) | 65 (-3)   |
| 11-STABLE/amd64 | 6912 (0)   | 6861 (0)  | 0 (0)  | 51 (0)|
| 11-STABLE/i386  | 6910 (0)   | 6857 (0)  | 0 (0)  | 53 (0)|

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200920 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failed and fixed test cases

* sys.fs.tmpfs.times_test.{empty,non_empty}
  https://bugs.freebsd.org/249362
* sys.posixshm.posixshm_test.*
  https://bugs.freebsd.org/249417

## Failing test cases

### HEAD
* sys.kern.coredump_phnum_test.coredump_phnum
* usr.bin.procstat.procstat_test.binary_info
* usr.bin.procstat.procstat_test.command_line_arguments
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.file_descriptor
* usr.bin.procstat.procstat_test.kernel_stacks

(Fixed in https://svnweb.freebsd.org/changeset/base/366237 on 2020-09-29)

### 12-STABLE
* sys.opencrypto.runtests.main
  Not fully migrated to python3
  https://bugs.freebsd.org/237403

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  

FreeBSD CI Weekly Report 2020-09-27

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-09-27
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-21 to 2020-09-27.

During this period, we have:

* 2211 builds (93.7% (-1.8) passed, 6.3% (+1.8) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 268 test runs (20.1% (-42.5) passed, 78.8% (+41.8) unstable, 1.1% (+0.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (100% passed)

Test case status (on 2020-09-27 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7896 (+2) | 7787 (-2) | 7 (+1) | 102 (+3) |
| head/i386   | 7894 (+2) | 7768 (+1) | 7 (+1) | 119 (0)  |
| 12-STABLE/amd64 | 7628 (0)  | 7562 (-8) | 6 (+5) | 60 (+3)  |
| 12-STABLE/i386  | 7626 (0)  | 7555 (-5) | 6 (+5) | 65 (0)   |
| 11-STABLE/amd64 | 6912 (0)  | 6858 (-3) | 0 (0)  | 54 (+3)  |
| 11-STABLE/i386  | 6910 (0)  | 6857 (0)  | 0 (0)  | 53 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200927 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* !x86 tests running in QEMU are configured to run once a day:
  * https://ci.freebsd.org/job/FreeBSD-head-aarch64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-armv7-test/
  * https://ci.freebsd.org/job/FreeBSD-head-mips64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-powerpc64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-riscv64-test/

## Fixed test cases

### 12-STABLE
* sys.opencrypto.runtests.main
  Fixed in r366010 and r366073
  https://bugs.freebsd.org/237403

## Failing test cases

### HEAD

* sys.capsicum.capsicum-test.main
  https://bugs.freebsd.org/249960
  * OpenatTest.WithFlag
  * ForkedOpenatTest_WithFlagInCapabilityMode._

### HEAD / 12-STABLE
* sys.kern.coredump_phnum_test.coredump_phnum
* usr.bin.procstat.procstat_test.binary_info
* usr.bin.procstat.procstat_test.command_line_arguments
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.file_descriptor
* usr.bin.procstat.procstat_test.kernel_stacks

(Fixed in https://svnweb.freebsd.org/changeset/base/366237 on 2020-09-29)

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.pt

FreeBSD CI Weekly Report 2020-10-04

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-10-04
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-28 to 2020-10-04.

During this period, we have:

* 1983 builds (93.9% (+0.2) passed, 6.1% (-0.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 236 test runs (18.6% (-1.5) passed, 81.4% (+2.6) unstable, 0.0% (-1.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 52 doc and www builds (100% passed)

Test case status (on 2020-10-04 23:59):
| Branch/Architecture | Total | Pass   | Fail   | Skipped |
| --- | - | -- | -- | --- |
| head/amd64  | 7899 (+3) | 7798 (+11) | 2 (-5) | 99 (-3) |
| head/i386   | 7897 (+3) | 7776 (+8)  | 2 (-5) | 119 (0) |
| 12-STABLE/amd64 | 7630 (+2) | 7570 (+8)  | 0 (-6) | 60 (0)  |
| 12-STABLE/i386  | 7628 (+2) | 7563 (+8)  | 0 (-6) | 65 (0)  |
| 11-STABLE/amd64 | 6912 (0)  | 6858 (0)   | 0 (0)  | 54 (0)  |
| 11-STABLE/i386  | 6910 (0)  | 6854 (-3)  | 0 (0)  | 56 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20201004 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed

## Fixed test cases

### HEAD
* sys.kern.sonewconn_overflow.sonewconn_overflow_01
  Workarounded in r366469

### HEAD / 12-STABLE
* sys.kern.coredump_phnum_test.coredump_phnum
* usr.bin.procstat.procstat_test.binary_info
* usr.bin.procstat.procstat_test.command_line_arguments
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.file_descriptor
* usr.bin.procstat.procstat_test.kernel_stacks
  Fixed in https://svnweb.freebsd.org/changeset/base/366237

## Failing test cases

### HEAD

* sys.capsicum.functional.ForkedOpenatTest_WithFlagInCapabilityMode___
* sys.capsicum.functional.OpenatTest__WithFlag
  https://bugs.freebsd.org/249960

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  Workaround committed and need to verif

FreeBSD CI Weekly Report 2020-10-11

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-10-11
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-10-05 to 2020-10-11.

During this period, we have:

* 1809 builds (94.6% (+0.7) passed, 5.4% (-0.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 213 test runs (70.5% (+51.9) passed, 28.6% (-52.8) unstable, 0.9% (+0.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 34 doc and www builds (100% passed)

Test case status (on 2020-10-11 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7995 (+96) | 7891 (+93) | 0 (-2) | 104 (+5) |
| head/i386   | 7993 (+96) | 7869 (+93) | 0 (-2) | 124 (+5) |
| 12-STABLE/amd64 | 7630 (0)   | 7570 (0)   | 0 (0)  | 60 (0)   |
| 12-STABLE/i386  | 7628 (0)   | 7563 (0)   | 0 (0)  | 65 (0)   |
| 11-STABLE/amd64 | 6912 (0)   | 6858 (0)   | 0 (0)  | 54 (0)   |
| 11-STABLE/i386  | 6910 (0)   | 6857 (+3)  | 0 (0)  | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20201011 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* Capsicum tests have been turned fine grained results. Now each test case 
reports individually:
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/lastCompletedBuild/testReport/junit/sys.capsicum/functional/
  The test are executed with root by default now and some previously skipped 
test cases are being executed now.

## Failing test cases

### HEAD

* sys.capsicum.functional.Capability__NoBypassDAC
  https://bugs.freebsd.org/250178
* sys.capsicum.functional.Pdfork__OtherUserForked
  https://bugs.freebsd.org/250179

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  Workaround committed and need to verify.
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/

Re: FreeBSD_STABLE_10-i386 - Build #661 - Still Failing

[Li-Wen Hsu]

On Mon, Nov 23, 2015 at 17:20:36 +0100, Baptiste Daroussin wrote:
> On Mon, Nov 23, 2015 at 04:10:33PM +, jenkins-ad...@freebsd.org wrote:
> > FreeBSD_STABLE_10-i386 - Build #661 - Still Failing:
> > 
> > Build information: 
> > https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/661/
> > Full change log: 
> > https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/661/changes
> > Full build log: 
> > https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/661/console
> 
> Someone needs to update the jenkins to the latest head.

The build happens in a jail built every time the job starts, by fetching
the latest snapshot from:

http://ftp.freebsd.org/pub/FreeBSD/snapshots/i386/i386/11.0-CURRENT/base.txz

It looks there is no /usr/bin/colldef.  I haven't looked into what's
going on here.

Li-Wen

-- 
Li-Wen Hsu 
http://lwhsu.org


pgp9HlXG_2vzV.pgp
Description: PGP signature