On Wed, 06 Dec 2017, intrigeri <intrigeri@debian.org> wrote: > Hi, > > Philip Hands: >> Having jenkins in the mix makes things at least twice as painful. > > I would certainly never recommend *developing* such tests directly on > Jenkins. At Tails we develop tests locally and use Jenkins only > for CI. Yeah, that was the thing that I was doing most wrong. I somehow never succeeded in getting SikuliX to run locally -- I'm sure that would help a lot. In the mean time I've developed a pretty profound dislike of jenkins, so being able to largely avoid that is a bonus from my point of view (I guess we'll be triggering jobs from it, but at least I'll not be having to fight with jenkins in order to see the results of the tests). >> OpenQA really makes it a lot easier, orders of magnitude quicker, and >> much more fun. > > :) > >> I can imagine getting OpenQA to a point where people can do drive-by >> test creation when they're testing bugs in random packages, and that not >> only would it be less effort than testing by hand, but should build into >> a nice regression suite -- I doubt that was ever going to happen with >> cucumber etc. > > Glad you've found something that works better for Debian. The thing that I've not yet managed to do, that I had working nicely in cucumber is talking to the VM's serial port, but it seems that they have some nice scripting for dealing with that (which I'm not quite understanding as yet). I certainly liked that aspect of the tails tests. Cheers, Phil. -- |)| Philip Hands [+44 (0)20 8530 9560] HANDS.COM Ltd. |-| http://www.hands.com/ http://ftp.uk.debian.org/ |(| Hugo-Klemm-Strasse 34, 21075 Hamburg, GERMANY
Attachment:
signature.asc
Description: PGP signature