[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: MBF: packages with autopkgtest tests but no XS-Testsuite



On Sun, Nov 04, 2012 at 07:01:12PM +0100, Stefano Zacchiroli wrote:
> It looks like we have already 68 packages in the Debian archive shipping
> autopkgtest [1] tests, which is great!  But unfortunately only 3 of them
> declare the presence of the testsuite adding the recommended [2]
> "XS-Testsuite: autopkgtest" header to their source stanza in
> debian/control.
> 
> The dd-list of packages shipping autopkgtest tests but lacking the
> header is attached. Please let me know if you notice any false positive.
> 
> I'd like to go ahead with a "Severity: wishlist" mass bug filing to
> kindly ask maintainers to add the missing header.  The proposed mail
> template for mass-bug is attached.

I think this sounds like a great idea, +1 to that.

> 
> To avoid new instances of the problem in the future, I've also requested
> a new lintian check [3]. In the meantime it'd be useful to ask
> maintainers to add XS-Testsuite where needed.
> 
> 
> Many thanks to Holger Levsen for setting up http://jenkins.debian.net/
> and initiating this discussion on -qa [4], and to Jakub Wilk for making
> me realize how many autopkgtest-enabled packages we already have in the
> archive.
> 
> Cheers.
> 
> [1]: http://packages.qa.debian.org/a/autopkgtest.html
> [2]: http://anonscm.debian.org/gitweb/?p=autopkgtest/autopkgtest.git;a=blob_plain;f=doc/README.package-tests;hb=HEAD
> [3]: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=692282
> [4]: https://lists.debian.org/debian-qa/2012/11/msg00009.html
> -- 
> Stefano Zacchiroli  . . . . . . .  zack@upsilon.cc . . . . o . . . o . o
> Maître de conférences . . . . . http://upsilon.cc/zack . . . o . . . o o
> Debian Project Leader . . . . . . @zack on identi.ca . . o o o . . . o .
> « the first rule of tautology club is the first rule of tautology club »


> [ This is an automated bug report, submitted as part of the mass bug
>   filing discussed at TODO-ADD-URL-TO-DEVEL-THREAD-HERE ]
> 
> According to the Contents file, #PACKAGE# ships a test suite for the
> autopkgtest testing framework [1]. Thanks a bunch for that, those test
> suites are a great way to improve the overall quality of the Debian
> archive!
> 
> However, the presence of test suites in packages should be easily
> discoverable, to allow test runners to pick suitable packages and run
> their test suites.  According to the autopkgtest specification [2], if
> you ship an autopkgtest test suite you should add the following header
> to the *source stanza* of your debian/control file:
> 
>   XS-Testsuite: autopkgtest
> 
> It seems that #PACKAGE# lacks such a header.
> Can you please add it?
> 
> Thanks for considering,
> Cheers.
> 
> 
> [1]: http://packages.qa.debian.org/a/autopkgtest.html
> [2]: http://anonscm.debian.org/gitweb/?p=autopkgtest/autopkgtest.git;a=blob_plain;f=doc/README.package-tests;hb=HEAD

Content of the bug looks great to me too. Love the idea.

Cheers,
  Paul

-- 
 .''`.  Paul Tagliamonte <paultag@debian.org>
: :'  : Proud Debian Developer
`. `'`  4096R / 8F04 9AD8 2C92 066C 7352  D28A 7B58 5B30 807C 2A87
 `-     http://people.debian.org/~paultag

Attachment: signature.asc
Description: Digital signature


Reply to: