Bug#976045: bind9: flaky autopkgtest on ci.debian.net
Source: bind9
Version: 1:9.11.5.P4+dfsg-5.1+deb10u2
Severity: serious
X-Debbugs-CC: debian-ci@lists.debian.org
User: debian-ci@lists.debian.org
Usertags: flaky
Control: found -1 1:9.16.8-1
Dear maintainer(s),
bind9 has an autopkgtest, great. However, your test (correctly) has the
restriction needs-internet, but it doesn't retry the part where it uses
the internet. On ci.debian.net, we're seeing (e.g. [1]) regular
failures in the internet based test. Can you please make the test more
robust against network issues? E.g. a couple of retries with some time
in between before failing?
Because the unstable-to-testing migration software now blocks on
regressions in testing, flaky tests, i.e. tests that flip between
passing and failing without changes to the list of installed packages,
are causing people unrelated to your package to spend time on these
tests.
I copied the output at the bottom of this report.
Please do get in touch if we need to dive into this together.
Paul
[1] https://ci.debian.net/packages/b/bind9/testing/amd64/
https://ci.debian.net/data/autopkgtest/stable/armhf/b/bind9/8471318/log.gz
autopkgtest [21:59:15]: test simpletest: [-----------------------
; <<>> DiG 9.11.5-P4-5.1+deb10u2-Debian <<>> -x 127.0.0.1 @127.0.0.1
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 53032
;; flags: qr aa rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 1, ADDITIONAL: 3
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4096
; COOKIE: 20d019dc324ffa05fbfc9b425fc176b5e6f0b962dccc8e3c (good)
;; QUESTION SECTION:
;1.0.0.127.in-addr.arpa. IN PTR
;; ANSWER SECTION:
1.0.0.127.in-addr.arpa. 604800 IN PTR localhost.
;; AUTHORITY SECTION:
127.in-addr.arpa. 604800 IN NS localhost.
;; ADDITIONAL SECTION:
localhost. 604800 IN A 127.0.0.1
localhost. 604800 IN AAAA ::1
;; Query time: 0 msec
;; SERVER: 127.0.0.1#53(127.0.0.1)
;; WHEN: Fri Nov 27 21:59:17 UTC 2020
;; MSG SIZE rcvd: 160
Checking for DNSSEC validation status of internetsociety.org
autopkgtest [21:59:17]: test simpletest: -----------------------]
Reply to: