[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#970947: marked as done (bmf: autopkgtest must be marked superficial)



Your message dated Tue, 11 Oct 2022 19:34:19 +0000
with message-id <E1oiL19-00HZW0-6a@fasolo.debian.org>
and subject line Bug#970947: fixed in bmf 0.9.4-13
has caused the Debian Bug report #970947,
regarding bmf: autopkgtest must be marked superficial
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
970947: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=970947
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems
--- Begin Message ---
Source: bmf
Severity: important
Usertags: superficialtest
X-Debbugs-CC: elbrus@debian.org

Dear Maintainer,

It has been noticed that the autopkgtest in bmf is running a
trivial command that does not provide significant test coverage:

	-Test-Command: bmf -V 2>&1 | grep version 
	-Test-Command: bmf -h 2>&1 | grep Usage

Executing that command is considered to be a trivial test, which
does not provide significant coverage for a package as a whole.
But these tests are a useful way to detect regressions in dependencies
and prevent them from breaking your package.

However, it is important that we are realistic about the level of
test coverage provided by these commands: most regressions cannot be
detected in this way. So it is not appropriate for packages with only
superficial tests to have the reduced migration time to migrate from
unstable to testing as that means less opportunity for testing by users
compared to the package with no tests.

To support this, the keyword "Restrictions: superficial" has been
defined [1]. Packages where all tests are marked with this keyword are not
considered for the reduced migration age from unstable to testing, and
will not be allowed to migrate automatically in later stages of the
freeze [2].

Its always better to have more extensive testing than having
superficial testing, which again is better than having no test.

Please consider i) Adding a non-trivial test, and/or ii) Mark the
trivial test with "Restrictions: superficial", similar to
[3] or [4].

The Release Team has listed this issue in the list of Release Critical
Issues for bullseye [5] and has mentioned that the test must be marked
superficial if it is not testing one of its own installed binary
packages in some way. As a result, the severity of this bug report might
be increased to serious in future.

[1] https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README.package-tests.rst#defined-restrictions
[2] https://release.debian.org/bullseye/freeze_policy.html
[3] https://salsa.debian.org/utopia-team/dbus/-/commit/a80908df7d119b181eec5eb0542634a30c2ad468
[4] https://salsa.debian.org/apparmor-team/apparmor/-/commit/580667513a097088ebe579884b38ac8d8666d3b3
[5] https://release.debian.org/bullseye/rc_policy.txt


--
Regards
Sudip

--- End Message ---
--- Begin Message ---
Source: bmf
Source-Version: 0.9.4-13
Done: Boyuan Yang <byang@debian.org>

We believe that the bug you reported is fixed in the latest version of
bmf, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 970947@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Boyuan Yang <byang@debian.org> (supplier of updated bmf package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Tue, 11 Oct 2022 15:06:53 -0400
Source: bmf
Architecture: source
Version: 0.9.4-13
Distribution: unstable
Urgency: medium
Maintainer: Debian QA Group <packages@qa.debian.org>
Changed-By: Boyuan Yang <byang@debian.org>
Closes: 970947
Changes:
 bmf (0.9.4-13) unstable; urgency=medium
 .
   * QA upload.
   * debian/: Apply "wrap-and-sort -abst".
   * debian/control:
     + Bump Standards-Version to 4.6.1.
     + Migrate packaging repo from alioth to salsa.
   * debian/rules: Correctly export buildflags.
   * debian/tests/control: Mark tests as superficial. (Closes: #970947)
   * debian/upstream/metadata: Dropped, not useful at all.
Checksums-Sha1:
 046f20c891a4a6cc5cf1409c44159e283b671c89 1818 bmf_0.9.4-13.dsc
 d0b7ab253a531a533fefc6bc0691cc7af7ccea79 36740 bmf_0.9.4.orig.tar.gz
 52e51c99a7560a62aa6ecb14d1a193cfe3b04a74 5964 bmf_0.9.4-13.debian.tar.xz
 46b6a1aaf3c8864d0b25bec56c188bae6092a2c1 6136 bmf_0.9.4-13_amd64.buildinfo
Checksums-Sha256:
 19022fbaeb3f66638c9111ab9458e715a88834ea0a6b84a96bffaf6e305b0244 1818 bmf_0.9.4-13.dsc
 7eed21802f95df2321ac4c958f99e14d2809852a5708700b633e1abb032c9ce1 36740 bmf_0.9.4.orig.tar.gz
 85ab6fbc18ea21860840abde4aa244ea312744d985e713234cdcb092c0db3bdb 5964 bmf_0.9.4-13.debian.tar.xz
 121975a94be3c8c2bb109db3b14ea7bcf0b8a46aa219d21aa9a5e442ef823da1 6136 bmf_0.9.4-13_amd64.buildinfo
Files:
 fd0cae7dd7ea323c078ecb9d50af76ff 1818 mail optional bmf_0.9.4-13.dsc
 9cf55df2fa3a05bdc55ba7b0a129591e 36740 mail optional bmf_0.9.4.orig.tar.gz
 9b8bd374ad8f93c3df6ddff0c8d52ece 5964 mail optional bmf_0.9.4-13.debian.tar.xz
 1943ea1e5cfe742feb69785fd7feea84 6136 mail optional bmf_0.9.4-13_amd64.buildinfo

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEEfncpR22H1vEdkazLwpPntGGCWs4FAmNFwBcACgkQwpPntGGC
Ws4GHhAAmnh+mq78klZHamFXxZAQnyI2ODkl7xw57eiqGGn2fpZ7/KMexVxT107x
CilFvC6TTa9SgN6uem9reXW8kBQG/y0+ttOlxFq04MyyRe4eMrD/sjP6KAG4588P
ocPl1JmG7qusIO3PVC5YVkt3aUlKlP5FOffYH0yMqIOF7OsEcAoQBTRSU5uWY65z
lhkeZ4QJ2GdjyYqroADLEyh2pnJnf+7FNdf1rwWcyTeo2dn6GGEYHM2k9IWVBVmY
ZJRyDYQuvrgCDUdTADMt9pZ6OkSupTJDRmrdhStAwjbVxpLYHkR/rB+HKB0c94/j
AHUaEK+q0qUgLvxV1/HSRNskLgC41n+snp4ltzNVmVBUQXNDvVbgkBNXLfwXkPqq
XYiPlVrBSvma5JLORw40C36MEFoJN2VNnEc9eakgzOpxsDb362ZmiCnmmsVKPFoZ
O7wD5PKjDEJxFvHKy2Cip0knm47jAE75IybfZ0Q1lHjTD4xGK1QQliygUPE6LNLz
owtCZYkgOrvw2RpM73KTvV9uyzGnmsVEZZXeuyNCyD1QSVquduyiTQaXQgORf6qU
6WKUqyhwLFt82yA3U+y3n93l16aBqLOgxXK/ZR5Ht0wdjuQZ0f1OWLHYc8SDaaxh
iIczN/EQ4BFYUR/0TNSRrhmgYzps0TTXwam44FzfCfevFPalsbI=
=8RIs
-----END PGP SIGNATURE-----

--- End Message ---

Reply to: