Source: bind9 Version: 1:9.11.5.P4+dfsg-5.1+deb10u2 Severity: serious X-Debbugs-CC: [email protected] User: [email protected] Usertags: flaky Control: found -1 1:9.16.8-1
Dear maintainer(s), bind9 has an autopkgtest, great. However, your test (correctly) has the restriction needs-internet, but it doesn't retry the part where it uses the internet. On ci.debian.net, we're seeing (e.g. [1]) regular failures in the internet based test. Can you please make the test more robust against network issues? E.g. a couple of retries with some time in between before failing? Because the unstable-to-testing migration software now blocks on regressions in testing, flaky tests, i.e. tests that flip between passing and failing without changes to the list of installed packages, are causing people unrelated to your package to spend time on these tests. I copied the output at the bottom of this report. Please do get in touch if we need to dive into this together. Paul [1] https://ci.debian.net/packages/b/bind9/testing/amd64/ https://ci.debian.net/data/autopkgtest/stable/armhf/b/bind9/8471318/log.gz autopkgtest [21:59:15]: test simpletest: [----------------------- ; <<>> DiG 9.11.5-P4-5.1+deb10u2-Debian <<>> -x 127.0.0.1 @127.0.0.1 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 53032 ;; flags: qr aa rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 1, ADDITIONAL: 3 ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 4096 ; COOKIE: 20d019dc324ffa05fbfc9b425fc176b5e6f0b962dccc8e3c (good) ;; QUESTION SECTION: ;1.0.0.127.in-addr.arpa. IN PTR ;; ANSWER SECTION: 1.0.0.127.in-addr.arpa. 604800 IN PTR localhost. ;; AUTHORITY SECTION: 127.in-addr.arpa. 604800 IN NS localhost. ;; ADDITIONAL SECTION: localhost. 604800 IN A 127.0.0.1 localhost. 604800 IN AAAA ::1 ;; Query time: 0 msec ;; SERVER: 127.0.0.1#53(127.0.0.1) ;; WHEN: Fri Nov 27 21:59:17 UTC 2020 ;; MSG SIZE rcvd: 160 Checking for DNSSEC validation status of internetsociety.org autopkgtest [21:59:17]: test simpletest: -----------------------]
