MBF: packages with autopkgtest tests but no XS-Testsuite
On Sun, Nov 04, 2012 at 07:01:12PM +0100, Stefano Zacchiroli wrote:
> It looks like we have already 68 packages in the Debian archive shipping
> autopkgtest [1] tests, which is great! But unfortunately only 3 of them
> declare the presence of the testsuite adding the recommended [2]
> "XS-Testsuite: autopkgtest" header to their source stanza in
> debian/control.
>
> The dd-list of packages shipping autopkgtest tests but lacking the
> header is attached. Please let me know if you notice any false positive.
>
> I'd like to go ahead with a "Severity: wishlist" mass bug filing to
> kindly ask maintainers to add the missing header. The proposed mail
> template for mass-bug is attached.
I think this sounds like a great idea, +1 to that.
>
> To avoid new instances of the problem in the future, I've also requested
> a new lintian check [3]. In the meantime it'd be useful to ask
> maintainers to add XS-Testsuite where needed.
>
>
> Many thanks to Holger Levsen for setting up http://jenkins.debian.net/
> and initiating this discussion on -qa [4], and to Jakub Wilk for making
> me realize how many autopkgtest-enabled packages we already have in the
> archive.
>
> Cheers.
>
> [1]: http://packages.qa.debian.org/a/autopkgtest.html
> [2]: http://anonscm.debian.org/gitweb/?p=autopkgtest/autopkgtest.git;a=blob_plain;f=doc/README.package-tests;hb=HEAD
> [3]: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=692282
> [4]: https://lists.debian.org/debian-qa/2012/11/msg00009.html
> --
> Stefano Zacchiroli . . . . . . . zack at upsilon.cc . . . . o . . . o . o
> Ma?tre de conf?rences . . . . . http://upsilon.cc/zack . . . o . . . o o
> Debian Project Leader . . . . . . @zack on identi.ca . . o o o . . . o .
> ? the first rule of tautology club is the first rule of tautology club ?
> [ This is an automated bug report, submitted as part of the mass bug
> filing discussed at TODO-ADD-URL-TO-DEVEL-THREAD-HERE ]
>
> According to the Contents file, #PACKAGE# ships a test suite for the
> autopkgtest testing framework [1]. Thanks a bunch for that, those test
> suites are a great way to improve the overall quality of the Debian
> archive!
>
> However, the presence of test suites in packages should be easily
> discoverable, to allow test runners to pick suitable packages and run
> their test suites. According to the autopkgtest specification [2], if
> you ship an autopkgtest test suite you should add the following header
> to the *source stanza* of your debian/control file:
>
> XS-Testsuite: autopkgtest
>
> It seems that #PACKAGE# lacks such a header.
> Can you please add it?
>
> Thanks for considering,
> Cheers.
>
>
> [1]: http://packages.qa.debian.org/a/autopkgtest.html
> [2]: http://anonscm.debian.org/gitweb/?p=autopkgtest/autopkgtest.git;a=blob_plain;f=doc/README.package-tests;hb=HEAD
Content of the bug looks great to me too. Love the idea.
Cheers,
Paul
--
.''`. Paul Tagliamonte <paultag at debian.org>
: :' : Proud Debian Developer
`. `'` 4096R / 8F04 9AD8 2C92 066C 7352 D28A 7B58 5B30 807C 2A87
`- http://people.debian.org/~paultag
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 836 bytes
Desc: Digital signature
URL: <http://lists.alioth.debian.org/pipermail/autopkgtest-devel/attachments/20121104/78c1496f/attachment.pgp>
Reply to: