I've been looking into QA for the images I generate with Debian-Live.
Webconverger.com generates several new ISOs on an update and I am
worried sick something might have gone wrong. ;)
What usually goes wrong for me is that sometimes the package(s)
live-helper needs is misplaced (my fault) or perhaps failed to be
fetched (network fault). I need to also probably come up with a couple
of "fault finding" greps of the debian-live log output.
Brendan Sleight (see mail below) from the morphix project does video
stuff. I think it could be useful to quickly watch a movie in fast
forward if it looks right. (black box testing?)
Also Martin Ferrari tells me he is working on a lintian "fully
automated" style testing of images. (white box testing?)
Other elements of testing I would like to pursue (if I had more time) is
the "PC World test". I would like to plug a USB stick of my image and
test it on all the machines on demo in the store. I probably just need
to create a persistent USB image for the live.log and where perhaps a
`hwinfo` dump could live. This was talked about during Debconf7 as
perhaps being also part of Debian popcon stuff.
Anyone have some QA tips or thoughts, please share. Best wishes,
----- Forwarded message from Brendan Sleight <bms at barwap.com> -----
From: Brendan Sleight <bms at barwap.com>
To: hendry at iki.fi
Subject: Re: iceweasel-webconverger
Date: Thu, 28 Jun 2007 23:58:18 +0100
X-Original-To: hendry at dabase.com
Delivered-To: hendry at spunkymail-mx7.g.dreamhost.com
X-Forwarded-To: hendry at dabase.com
X-Forwarded-For: kai.hendry at gmail.com hendry at dabase.com
Delivered-To: kai.hendry at gmail.com
X-Spam-Checker-Version: SpamAssassin 3.0.3 (2005-04-27) on
>On 28/06/07, Kai Hendry <kai.hendry at gmail.com> wrote:
>> think up a good way of testing all these ISOs I am creating at
I wrote a very ugly script to AutoTest the Morphix ISOs.
I have tweaked the script to be less Morphix specific:-
In a nutshell, the script runs qemu, viewed via vnc session, then
captures screenshots. Then converts the screenshots into a video. I am
using vnc, so one day I can drop the require to be running a local
x-server. (Google for vncrec)
Required packages -
The Autotesting is a big tough on tmp disk space and CPU usage. I have
a spare old Laptop that runs the Autotesting overnight. Each full test
takes ~1 hour, depending on how many frames are grabbed.
I have space on the machine to test an webconverger.iso per day. In a
week of cron job I could get through most of all language versions.
I would be glad to help webconverger, I have been using your package
Iceweasel-webconverger_6-16_all.deb. It works really well.
Hops this helps,
----- End forwarded message -----
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Size: 189 bytes
Desc: Digital signature
Url : http://lists.alioth.debian.org/pipermail/debian-live-devel/attachments/20070629/04ebd618/attachment.pgp
- Image QA
- From: daniel at debian.org (Daniel Baumann)