Source: kpackage Version: 5.42.0-2 Severity: important User: debian-ci@lists.debian.org Usertags: flaky While inspecting regressions in autopkgtest results¹, I noticed that your package kpackage fails regularly (5.45.0-1 hasn't even passed once yet), without obvious changes. As far as I checked, the error is nearly always the same (copied below). Could you please investigate and make your autopkgtest more robust? Please contact me if you need help and you think I can provide that (I am not subscribed to this bug). Recent discussion of gating migration by autopkgtests on debian-devel² noted that if this is going to work, and in particular if we are going to *block* migration when it causes autopkgtest regressions rather than merely delaying it, intermittent autopkgtest failures are likely to have to be considered RC due to their impact on the tested package's dependencies; for now I've filed it as important. Simon McVittie has previously proposed³ a way to mark autopkgtests as unsuitable for gating CI, while still having them available for convenient manual testing (and optionally run, but with their results disregarded, on the real CI infrastructure so that their reliability can be assessed), but this isn't currently possible. If the autopkgtest can't be made reliable then it would make sense to disable it for the moment. Paul ¹ https://ci.debian.net/packages/k/kpackage/unstable/amd64/ ² https://lists.debian.org/debian-devel/2018/05/msg00061.html ³ https://bugs.debian.org/851558 autopkgtest [13:54:56]: test testsuite: [----------------------- cd obj-x86_64-linux-gnu && make -j8 test ARGS\+=-j8 Running tests... /usr/bin/ctest --force-new-ctest-process -j8 Test project /tmp/autopkgtest-lxc.m3zi8kbh/downtmp/build.JS4/src/obj-x86_64-linux-gnu Start 1: plasma-fallbackpackagetest Start 2: plasma-packagestructuretest Start 3: plasma-plasmoidpackagetest Start 4: plasma-rccpackagetest Start 6: testfallbackpackage-appstream Start 7: testpackage-appstream Start 8: testpackage-nodisplay-appstream Start 9: testjsonmetadatapackage-appstream 1/11 Test #7: testpackage-appstream ............... Passed 0.11 sec 2/11 Test #8: testpackage-nodisplay-appstream ..... Passed 0.11 sec 3/11 Test #3: plasma-plasmoidpackagetest ..........***Failed 0.11 sec ********* Start testing of PlasmoidPackageTest ********* Config: Using QtTest library 5.9.2, Qt 5.9.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 7.3.0) PASS : PlasmoidPackageTest::initTestCase() QDEBUG : PlasmoidPackageTest::createAndInstallPackage() PlasmoidPackage::init() QDEBUG : PlasmoidPackageTest::createAndInstallPackage() cleaning up QDEBUG : PlasmoidPackageTest::createAndInstallPackage() QDEBUG : PlasmoidPackageTest::createAndInstallPackage() CreateAndInstall QDEBUG : PlasmoidPackageTest::createAndInstallPackage() Create test package "/home/debci/.qttest/share/packageRoot" QDEBUG : PlasmoidPackageTest::createAndInstallPackage() Created "/home/debci/.qttest/share/packageRoot/plasmoid_to_package" QDEBUG : PlasmoidPackageTest::createAndInstallPackage() OUT: "plasmoid_to_package" QDEBUG : PlasmoidPackageTest::createAndInstallPackage() THIS IS A PLASMOID SCRIPT THING FAIL! : PlasmoidPackageTest::createAndInstallPackage() 'QFile::exists(packagePath)' returned FALSE. () Loc: [/tmp/autopkgtest-lxc.m3zi8kbh/downtmp/build.JS4/src/autotests/plasmoidpackagetest.cpp(277)] QDEBUG : PlasmoidPackageTest::createAndInstallPackage() cleaning up QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() PlasmoidPackage::init() QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() cleaning up QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() CreateAndUpdate QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Create test package "/home/debci/.qttest/share/packageRoot" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Created "/home/debci/.qttest/share/packageRoot/plasmoid_to_package" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() OUT: "plasmoid_to_package" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() THIS IS A PLASMOID SCRIPT THING QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Installing "/home/debci/.qttest/share/packageRoot/testpackage.plasmoid" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() !!!!!!!!!!!!!!!!!!!! package installed true "" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() "Not installing version 1.1 of plasmoid_to_package. Version 1.1 already installed." QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Create test package "/home/debci/.qttest/share/packageRoot" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() Created "/home/debci/.qttest/share/packageRoot/plasmoid_to_package" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() OUT: "plasmoid_to_package" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() THIS IS A PLASMOID SCRIPT THING QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() !!!!!!!!!!!!!!!!!!!! package installed true "" QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() !!!!!!!!!!!!!!!!!!!!! package uninstalled QDEBUG : PlasmoidPackageTest::createAndUpdatePackage() cleaning up PASS : PlasmoidPackageTest::createAndUpdatePackage() QDEBUG : PlasmoidPackageTest::uncompressPackageWithSubFolder() PlasmoidPackage::init() QDEBUG : PlasmoidPackageTest::uncompressPackageWithSubFolder() cleaning up QWARN : PlasmoidPackageTest::uncompressPackageWithSubFolder() kf5.kcoreaddons.desktopparser: Unable to find service type for service "SimpleContent" listed in "/tmp/plasmoidpackagetest-4vl84q/customcontent//metadata.desktop" QWARN : PlasmoidPackageTest::uncompressPackageWithSubFolder() kf5.kcoreaddons.desktopparser: Unable to find service type for service "CustomContent" listed in "/tmp/plasmoidpackagetest-4vl84q/customcontent//metadata.desktop" QWARN : PlasmoidPackageTest::uncompressPackageWithSubFolder() kf5.kcoreaddons.desktopparser: Unable to find service type for service "SimpleContent" listed in "/tmp/plasmoidpackagetest-4vl84q/customcontent/metadata.desktop" QWARN : PlasmoidPackageTest::uncompressPackageWithSubFolder() kf5.kcoreaddons.desktopparser: Unable to find service type for service "CustomContent" listed in "/tmp/plasmoidpackagetest-4vl84q/customcontent/metadata.desktop" QDEBUG : PlasmoidPackageTest::uncompressPackageWithSubFolder() cleaning up PASS : PlasmoidPackageTest::uncompressPackageWithSubFolder() QDEBUG : PlasmoidPackageTest::isValid() PlasmoidPackage::init() QDEBUG : PlasmoidPackageTest::isValid() cleaning up QDEBUG : PlasmoidPackageTest::isValid() package path is "" QWARN : PlasmoidPackageTest::isValid() kf5.kpackage: No metadata file in the package, expected it at: "/home/debci/.qttest/share/packageRoot/Package/" QDEBUG : PlasmoidPackageTest::isValid() cleaning up PASS : PlasmoidPackageTest::isValid() QDEBUG : PlasmoidPackageTest::filePath() PlasmoidPackage::init() QDEBUG : PlasmoidPackageTest::filePath() cleaning up QDEBUG : PlasmoidPackageTest::filePath() cleaning up PASS : PlasmoidPackageTest::filePath() QDEBUG : PlasmoidPackageTest::entryList() PlasmoidPackage::init() QDEBUG : PlasmoidPackageTest::entryList() cleaning up QDEBUG : PlasmoidPackageTest::entryList() Create test package "/home/debci/.qttest/share/packageRoot" QDEBUG : PlasmoidPackageTest::entryList() Created "/home/debci/.qttest/share/packageRoot/Package" QDEBUG : PlasmoidPackageTest::entryList() OUT: "Package" QDEBUG : PlasmoidPackageTest::entryList() THIS IS A PLASMOID SCRIPT THING QDEBUG : PlasmoidPackageTest::entryList() cleaning up PASS : PlasmoidPackageTest::entryList() QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() PlasmoidPackage::init() QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() cleaning up QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() Create test package "/home/debci/.qttest/share/packageRoot" QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() Created "/home/debci/.qttest/share/packageRoot/plasmoid_to_package" QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() OUT: "plasmoid_to_package" QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() THIS IS A PLASMOID SCRIPT THING QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() !!!!!!!!!!!!!!!!!!!! package installed true "" QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() !!!!!!!!!!!!!!!!!!!!! package uninstalled QDEBUG : PlasmoidPackageTest::noCrashOnAsyncInstall() cleaning up PASS : PlasmoidPackageTest::noCrashOnAsyncInstall() PASS : PlasmoidPackageTest::cleanupTestCase() Totals: 8 passed, 1 failed, 0 skipped, 0 blacklisted, 47ms ********* Finished testing of PlasmoidPackageTest ********* 4/11 Test #1: plasma-fallbackpackagetest .......... Passed 0.11 sec 5/11 Test #6: testfallbackpackage-appstream ....... Passed 0.11 sec 6/11 Test #4: plasma-rccpackagetest ............... Passed 0.11 sec 7/11 Test #9: testjsonmetadatapackage-appstream ... Passed 0.11 sec Start 10: testpackagesdep-appstream Start 11: testpackagesdepinvalid-appstream 8/11 Test #11: testpackagesdepinvalid-appstream .... Passed 0.10 sec 9/11 Test #10: testpackagesdep-appstream ........... Passed 0.10 sec 10/11 Test #2: plasma-packagestructuretest ......... Passed 0.22 sec Start 5: plasma-querytest 11/11 Test #5: plasma-querytest .................... Passed 0.03 sec 91% tests passed, 1 tests failed out of 11 Total Test time (real) = 0.25 sec The following tests FAILED: 3 - plasma-plasmoidpackagetest (Failed) Errors while running CTest Makefile:109: recipe for target 'test' failed make: *** [test] Error 8 dh_auto_test: cd obj-x86_64-linux-gnu && make -j8 test ARGS\+=-j8 returned exit code 2 autopkgtest [13:54:57]: test testsuite: -----------------------] autopkgtest [13:54:57]: test testsuite: - - - - - - - - - - results - - - - - - - - - - testsuite FAIL non-zero exit status 2 autopkgtest [13:54:57]: test testsuite: - - - - - - - - - - stderr - - - - - - - - - - Errors while running CTest make: *** [test] Error 8 dh_auto_test: cd obj-x86_64-linux-gnu && make -j8 test ARGS\+=-j8 returned exit code 2
Attachment:
signature.asc
Description: OpenPGP digital signature