[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#970962: marked as done (procinfo: autopkgtest must be marked superficial)



Your message dated Thu, 11 Nov 2021 13:34:10 +0000
with message-id <E1mlADS-000HJJ-Jc@fasolo.debian.org>
and subject line Bug#970962: fixed in procinfo 1:2.0.304-6
has caused the Debian Bug report #970962,
regarding procinfo: autopkgtest must be marked superficial
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
970962: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=970962
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems
--- Begin Message ---
Source: procinfo
Severity: important
Usertags: superficialtest
X-Debbugs-CC: elbrus@debian.org

Dear Maintainer,

It has been noticed that the autopkgtest in procinfo is running a
trivial command that does not provide significant test coverage:

	-Test-Command: procinfo -h 
	-Test-Command: procinfo -v

Executing that command is considered to be a trivial test, which
does not provide significant coverage for a package as a whole.
But these tests are a useful way to detect regressions in dependencies
and prevent them from breaking your package.

However, it is important that we are realistic about the level of
test coverage provided by these commands: most regressions cannot be
detected in this way. So it is not appropriate for packages with only
superficial tests to have the reduced migration time to migrate from
unstable to testing as that means less opportunity for testing by users
compared to the package with no tests.

To support this, the keyword "Restrictions: superficial" has been
defined [1]. Packages where all tests are marked with this keyword are not
considered for the reduced migration age from unstable to testing, and
will not be allowed to migrate automatically in later stages of the
freeze [2].

Its always better to have more extensive testing than having
superficial testing, which again is better than having no test.

Please consider i) Adding a non-trivial test, and/or ii) Mark the
trivial test with "Restrictions: superficial", similar to
[3] or [4].

The Release Team has listed this issue in the list of Release Critical
Issues for bullseye [5] and has mentioned that the test must be marked
superficial if it is not testing one of its own installed binary
packages in some way. As a result, the severity of this bug report might
be increased to serious in future.

[1] https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README.package-tests.rst#defined-restrictions
[2] https://release.debian.org/bullseye/freeze_policy.html
[3] https://salsa.debian.org/utopia-team/dbus/-/commit/a80908df7d119b181eec5eb0542634a30c2ad468
[4] https://salsa.debian.org/apparmor-team/apparmor/-/commit/580667513a097088ebe579884b38ac8d8666d3b3
[5] https://release.debian.org/bullseye/rc_policy.txt


--
Regards
Sudip

--- End Message ---
--- Begin Message ---
Source: procinfo
Source-Version: 1:2.0.304-6
Done: Stephen Kitt <skitt@debian.org>

We believe that the bug you reported is fixed in the latest version of
procinfo, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 970962@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Stephen Kitt <skitt@debian.org> (supplier of updated procinfo package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Thu, 11 Nov 2021 14:17:27 +0100
Source: procinfo
Architecture: source
Version: 1:2.0.304-6
Distribution: unstable
Urgency: medium
Maintainer: Debian QA Group <packages@qa.debian.org>
Changed-By: Stephen Kitt <skitt@debian.org>
Closes: 970962 997173
Changes:
 procinfo (1:2.0.304-6) unstable; urgency=medium
 .
   * QA upload.
   * Ensure format strings are literals. Closes: #997173.
   * Mark autopkgtests as superficial. Closes: #970962.
   * Fix debian/copyright license declarations.
   * Standards-Version 4.6.0, no change required.
Checksums-Sha1:
 da924b64dfd2034a951bf201b5b68a5b7bff7d8d 1881 procinfo_2.0.304-6.dsc
 d3cd7ab7bc4403610588bcbcae5f2f2b536b0fab 9780 procinfo_2.0.304-6.debian.tar.xz
 b23a90f9ec70a70a3da94fc1db12ccb4040da7a4 6326 procinfo_2.0.304-6_source.buildinfo
Checksums-Sha256:
 c6325b832c84aa9aae7a4c110181b203948887d3c16a47581caf07e919af5783 1881 procinfo_2.0.304-6.dsc
 f3916c3dc5fe5a54c834dafea221aea66e367ce55eaf725325d60252b4585bd1 9780 procinfo_2.0.304-6.debian.tar.xz
 a6712f8748d3ac2565b6c3dd3263a1fdf31453804abf4ac8ea40d6885871a5c8 6326 procinfo_2.0.304-6_source.buildinfo
Files:
 11743f7e9ac0a1239a3ed7abd9ac12fd 1881 utils optional procinfo_2.0.304-6.dsc
 40586f143e9eac3f1a25d74c8697c744 9780 utils optional procinfo_2.0.304-6.debian.tar.xz
 430abcf65a8d3ab3039be47852b608a6 6326 utils optional procinfo_2.0.304-6_source.buildinfo

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEEnPVX/hPLkMoq7x0ggNMC9Yhtg5wFAmGNF+8ACgkQgNMC9Yht
g5xJJQ/9EAJ25gyS8cGsXF7+NCb7R5b/gqC2ozYEZgQpe6kfzTSPxW10kzlVSwBv
C6dxrOedsj3tdIoxXsgH3na+yxHH1SSlsOD10kaSt+qIUFhaYrYs1zFLbWlRmNVU
0KyjDFlZ4zZO12rM3BmFQFMBaYCovtEjvlpxbY/bX5DUVPAzDDuwUcyS1BEa6de6
mxb8r5apq/TLVw2rhRqrg/fj498Fw1PnBk+jzilPGMVq0s9X+eLI/Mhf16pkolHr
bug+XwYfpwU5DfT/zimX1iNwdsyket006+1h6MwUrJunMYVQQyCtRuSDEqIicRuA
ZXOUWz+NKKOmz2aJFBqzdRmFQRAaVexiraTqLLkk6lPhwoJKFkdeuLJMW0uwj9uJ
jeis1h795k374q3ISwO/3AHmRyJplcoqlN4SvFXWdUMhQgoYTmTGRK9KdDfT2b3D
PFJxhM3AQpd1aBEmWnZ8+w85jAgFkRIDDCUPndb5MNiFRuuTqmDaZdjZms/1ing9
23YcrB78uAvHV3dg6KmIYJWkvnMXrJu39EMSlFWsaWl+/DxKxBCcgl0erEuqnptn
5gIN6Cf/vsowrWY8IMQCCRUUYtauU8quV4X812nqk4TJlKyqR+Zwdvz5WvrcS1R9
7HyZGoVMYQIIpnz+6AniNmj69EPqSAR36cnClipnIEOs3vvgmDg=
=wImK
-----END PGP SIGNATURE-----

--- End Message ---

Reply to: