[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#898443: kpackage: flaky autopkgtest



Source: kpackage
Version: 5.42.0-2
Severity: important
User: debian-ci@lists.debian.org
Usertags: flaky

While inspecting regressions in autopkgtest results¹, I noticed that
your package kpackage fails regularly (5.45.0-1 hasn't even passed once
yet), without obvious changes. As far as I checked, the error is nearly
always the same (copied below).

Could you please investigate and make your autopkgtest more robust?
Please contact me if you need help and you think I can provide that (I
am not subscribed to this bug).

Recent discussion of gating migration by autopkgtests on debian-devel²
noted that if this is going to work, and in particular if we are going
to *block* migration when it causes autopkgtest regressions rather than
merely delaying it, intermittent autopkgtest failures are likely to have
to be considered RC due to their impact on the tested package's
dependencies; for now I've filed it as important.

Simon McVittie has previously proposed³ a way to mark autopkgtests as
unsuitable for gating CI, while still having them available for
convenient manual testing (and optionally run, but with their results
disregarded, on the real CI infrastructure so that their reliability can
be assessed), but this isn't currently possible. If the autopkgtest
can't be made reliable then it would make sense to disable it for the
moment.

Paul

¹ https://ci.debian.net/packages/k/kpackage/unstable/amd64/
² https://lists.debian.org/debian-devel/2018/05/msg00061.html
³ https://bugs.debian.org/851558

autopkgtest [13:54:56]: test testsuite: [-----------------------
	cd obj-x86_64-linux-gnu && make -j8 test ARGS\+=-j8
Running tests...
/usr/bin/ctest --force-new-ctest-process -j8
Test project
/tmp/autopkgtest-lxc.m3zi8kbh/downtmp/build.JS4/src/obj-x86_64-linux-gnu
      Start  1: plasma-fallbackpackagetest
      Start  2: plasma-packagestructuretest
      Start  3: plasma-plasmoidpackagetest
      Start  4: plasma-rccpackagetest
      Start  6: testfallbackpackage-appstream
      Start  7: testpackage-appstream
      Start  8: testpackage-nodisplay-appstream
      Start  9: testjsonmetadatapackage-appstream
 1/11 Test  #7: testpackage-appstream ...............   Passed    0.11 sec
 2/11 Test  #8: testpackage-nodisplay-appstream .....   Passed    0.11 sec
 3/11 Test  #3: plasma-plasmoidpackagetest ..........***Failed    0.11 sec
********* Start testing of PlasmoidPackageTest *********
Config: Using QtTest library 5.9.2, Qt 5.9.2 (x86_64-little_endian-lp64
shared (dynamic) release build; by GCC 7.3.0)
PASS   : PlasmoidPackageTest::initTestCase()
QDEBUG : PlasmoidPackageTest::createAndInstallPackage()
PlasmoidPackage::init()
QDEBUG : PlasmoidPackageTest::createAndInstallPackage() cleaning up
QDEBUG : PlasmoidPackageTest::createAndInstallPackage()
QDEBUG : PlasmoidPackageTest::createAndInstallPackage()    CreateAndInstall
QDEBUG : PlasmoidPackageTest::createAndInstallPackage() Create test
package "/home/debci/.qttest/share/packageRoot"
QDEBUG : PlasmoidPackageTest::createAndInstallPackage() Created
"/home/debci/.qttest/share/packageRoot/plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::createAndInstallPackage() OUT:
"plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::createAndInstallPackage() THIS IS A
PLASMOID SCRIPT THING
FAIL!  : PlasmoidPackageTest::createAndInstallPackage()
'QFile::exists(packagePath)' returned FALSE. ()
   Loc:
[/tmp/autopkgtest-lxc.m3zi8kbh/downtmp/build.JS4/src/autotests/plasmoidpackagetest.cpp(277)]
QDEBUG : PlasmoidPackageTest::createAndInstallPackage() cleaning up
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage()
PlasmoidPackage::init()
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() cleaning up
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage()
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage()    CreateAndUpdate
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Create test
package "/home/debci/.qttest/share/packageRoot"
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Created
"/home/debci/.qttest/share/packageRoot/plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() OUT:
"plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() THIS IS A
PLASMOID SCRIPT THING
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Installing
"/home/debci/.qttest/share/packageRoot/testpackage.plasmoid"
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage()
!!!!!!!!!!!!!!!!!!!! package installed true ""
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() "Not installing
version 1.1 of plasmoid_to_package. Version 1.1 already installed."
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Create test
package "/home/debci/.qttest/share/packageRoot"
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Created
"/home/debci/.qttest/share/packageRoot/plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() OUT:
"plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() THIS IS A
PLASMOID SCRIPT THING
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage()
!!!!!!!!!!!!!!!!!!!! package installed true ""
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage()
!!!!!!!!!!!!!!!!!!!!! package uninstalled
QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() cleaning up
PASS   : PlasmoidPackageTest::createAndUpdatePackage()
QDEBUG : PlasmoidPackageTest::uncompressPackageWithSubFolder()
PlasmoidPackage::init()
QDEBUG : PlasmoidPackageTest::uncompressPackageWithSubFolder() cleaning up
QWARN  : PlasmoidPackageTest::uncompressPackageWithSubFolder()
kf5.kcoreaddons.desktopparser: Unable to find service type for service
"SimpleContent" listed in
"/tmp/plasmoidpackagetest-4vl84q/customcontent//metadata.desktop"
QWARN  : PlasmoidPackageTest::uncompressPackageWithSubFolder()
kf5.kcoreaddons.desktopparser: Unable to find service type for service
"CustomContent" listed in
"/tmp/plasmoidpackagetest-4vl84q/customcontent//metadata.desktop"
QWARN  : PlasmoidPackageTest::uncompressPackageWithSubFolder()
kf5.kcoreaddons.desktopparser: Unable to find service type for service
"SimpleContent" listed in
"/tmp/plasmoidpackagetest-4vl84q/customcontent/metadata.desktop"
QWARN  : PlasmoidPackageTest::uncompressPackageWithSubFolder()
kf5.kcoreaddons.desktopparser: Unable to find service type for service
"CustomContent" listed in
"/tmp/plasmoidpackagetest-4vl84q/customcontent/metadata.desktop"
QDEBUG : PlasmoidPackageTest::uncompressPackageWithSubFolder() cleaning up
PASS   : PlasmoidPackageTest::uncompressPackageWithSubFolder()
QDEBUG : PlasmoidPackageTest::isValid() PlasmoidPackage::init()
QDEBUG : PlasmoidPackageTest::isValid() cleaning up
QDEBUG : PlasmoidPackageTest::isValid() package path is ""
QWARN  : PlasmoidPackageTest::isValid() kf5.kpackage: No metadata file
in the package, expected it at:
"/home/debci/.qttest/share/packageRoot/Package/"
QDEBUG : PlasmoidPackageTest::isValid() cleaning up
PASS   : PlasmoidPackageTest::isValid()
QDEBUG : PlasmoidPackageTest::filePath() PlasmoidPackage::init()
QDEBUG : PlasmoidPackageTest::filePath() cleaning up
QDEBUG : PlasmoidPackageTest::filePath() cleaning up
PASS   : PlasmoidPackageTest::filePath()
QDEBUG : PlasmoidPackageTest::entryList() PlasmoidPackage::init()
QDEBUG : PlasmoidPackageTest::entryList() cleaning up
QDEBUG : PlasmoidPackageTest::entryList() Create test package
"/home/debci/.qttest/share/packageRoot"
QDEBUG : PlasmoidPackageTest::entryList() Created
"/home/debci/.qttest/share/packageRoot/Package"
QDEBUG : PlasmoidPackageTest::entryList() OUT:  "Package"
QDEBUG : PlasmoidPackageTest::entryList() THIS IS A PLASMOID SCRIPT THING
QDEBUG : PlasmoidPackageTest::entryList() cleaning up
PASS   : PlasmoidPackageTest::entryList()
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall()
PlasmoidPackage::init()
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() cleaning up
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() Create test
package "/home/debci/.qttest/share/packageRoot"
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() Created
"/home/debci/.qttest/share/packageRoot/plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() OUT:
"plasmoid_to_package"
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() THIS IS A PLASMOID
SCRIPT THING
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall()
!!!!!!!!!!!!!!!!!!!! package installed true ""
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall()
!!!!!!!!!!!!!!!!!!!!! package uninstalled
QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() cleaning up
PASS   : PlasmoidPackageTest::noCrashOnAsyncInstall()
PASS   : PlasmoidPackageTest::cleanupTestCase()
Totals: 8 passed, 1 failed, 0 skipped, 0 blacklisted, 47ms
********* Finished testing of PlasmoidPackageTest *********

 4/11 Test  #1: plasma-fallbackpackagetest ..........   Passed    0.11 sec
 5/11 Test  #6: testfallbackpackage-appstream .......   Passed    0.11 sec
 6/11 Test  #4: plasma-rccpackagetest ...............   Passed    0.11 sec
 7/11 Test  #9: testjsonmetadatapackage-appstream ...   Passed    0.11 sec
      Start 10: testpackagesdep-appstream
      Start 11: testpackagesdepinvalid-appstream
 8/11 Test #11: testpackagesdepinvalid-appstream ....   Passed    0.10 sec
 9/11 Test #10: testpackagesdep-appstream ...........   Passed    0.10 sec
10/11 Test  #2: plasma-packagestructuretest .........   Passed    0.22 sec
      Start  5: plasma-querytest
11/11 Test  #5: plasma-querytest ....................   Passed    0.03 sec

91% tests passed, 1 tests failed out of 11

Total Test time (real) =   0.25 sec

The following tests FAILED:
	  3 - plasma-plasmoidpackagetest (Failed)
Errors while running CTest
Makefile:109: recipe for target 'test' failed
make: *** [test] Error 8
dh_auto_test: cd obj-x86_64-linux-gnu && make -j8 test ARGS\+=-j8
returned exit code 2
autopkgtest [13:54:57]: test testsuite: -----------------------]
autopkgtest [13:54:57]: test testsuite:  - - - - - - - - - - results - -
- - - - - - - -
testsuite            FAIL non-zero exit status 2
autopkgtest [13:54:57]: test testsuite:  - - - - - - - - - - stderr - -
- - - - - - - -
Errors while running CTest
make: *** [test] Error 8
dh_auto_test: cd obj-x86_64-linux-gnu && make -j8 test ARGS\+=-j8
returned exit code 2

Attachment: signature.asc
Description: OpenPGP digital signature


Reply to: