[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#1004516: cwltool breaks toil autopkgtest: No such file or directory: '/home/debci/tmp/tmpgxz5j85g'



Source: cwltool, toil
Control: found -1 cwltool/3.1.20220119140128-2
Control: found -1 toil/5.6.0-2
Severity: serious
Tags: sid bookworm
X-Debbugs-CC: debian-ci@lists.debian.org
User: debian-ci@lists.debian.org
Usertags: breaks needs-update

Dear maintainer(s),

With a recent upload of cwltool the autopkgtest of toil fails in testing when that autopkgtest is run with the binary packages of cwltool from unstable. It passes when run with only packages from testing. In tabular form:

                       pass            fail
cwltool                from testing    3.1.20220119140128-2
toil                   from testing    5.6.0-2
versioned deps [0]     from testing    from unstable
all others             from testing    from testing

I copied some of the output at the bottom of this report.

Currently this regression is blocking the migration of cwltool to testing [1]. Due to the nature of this issue, I filed this bug report against both packages. Can you please investigate the situation and reassign the bug to the right package?

More information about this bug and the reason for filing it can be found on
https://wiki.debian.org/ContinuousIntegration/RegressionEmailInformation

Paul

[0] You can see what packages were added from the second line of the log file quoted below. The migration software adds source package from unstable to the list if they are needed to install packages from cwltool/3.1.20220119140128-2. I.e. due to versioned dependencies or breaks/conflicts.
[1] https://qa.debian.org/excuses.php?package=cwltool

https://ci.debian.net/data/autopkgtest/testing/amd64/t/toil/18793124/log.gz

=================================== FAILURES =================================== _______________ FileJobStoreTest.testEmptyFileStoreIDIsReadable ________________
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/toil/jobStores/fileJobStore.py", line 489, in read_file
    os.link(jobStoreFilePath, local_path)
FileExistsError: [Errno 17] File exists: '/tmp/autopkgtest-lxc.85mlkjg3/downtmp/build.vip/src/jobstore-test-07ead108-dcba-43a6-9148-1858e1cd24c6/files/no-job/file-db26c7b57ee84f5597ddbf2a60af46e7/stream' -> '/home/debci/tmp/tmpgxz5j85g'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/toil/test/jobStores/jobStoreTest.py", line 1039, in testEmptyFileStoreIDIsReadable
    self.jobstore_initialized.read_file(id, path)
File "/usr/lib/python3/dist-packages/toil/jobStores/fileJobStore.py", line 498, in read_file
    os.link(jobStoreFilePath, local_path)
OSError: [Errno 18] Invalid cross-device link: '/tmp/autopkgtest-lxc.85mlkjg3/downtmp/build.vip/src/jobstore-test-07ead108-dcba-43a6-9148-1858e1cd24c6/files/no-job/file-db26c7b57ee84f5597ddbf2a60af46e7/stream' -> '/home/debci/tmp/tmpgxz5j85g'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/toil/test/jobStores/jobStoreTest.py", line 1042, in testEmptyFileStoreIDIsReadable
    os.unlink(path)
FileNotFoundError: [Errno 2] No such file or directory: '/home/debci/tmp/tmpgxz5j85g' ---------------------------- Captured stdout setup -----------------------------


[TEST] toil.test.jobStores.jobStoreTest.FileJobStoreTest:testEmptyFileStoreIDIsReadable (Jan 29 2022 03:14:35:362865 PST)


------------------------------ Captured log call ------------------------------- INFO toil.test:__init__.py:109 Setting up toil.test.jobStores.jobStoreTest.FileJobStoreTest.testEmptyFileStoreIDIsReadable ... DEBUG toil.jobStores.fileJobStore:fileJobStore.py:74 Path to job store directory is '/tmp/autopkgtest-lxc.85mlkjg3/downtmp/build.vip/src/jobstore-test-07ead108-dcba-43a6-9148-1858e1cd24c6'. DEBUG toil.jobStores.abstractJobStore:abstractJobStore.py:183 The workflow ID is: '38228cb7-9d17-4058-b812-cd5f00e89fc6' DEBUG toil.jobStores.fileJobStore:fileJobStore.py:74 Path to job store directory is '/tmp/autopkgtest-lxc.85mlkjg3/downtmp/build.vip/src/jobstore-test-07ead108-dcba-43a6-9148-1858e1cd24c6'. INFO toil.test:__init__.py:114 Tore down toil.test.jobStores.jobStoreTest.FileJobStoreTest.testEmptyFileStoreIDIsReadable - generated xml file: /tmp/autopkgtest-lxc.85mlkjg3/downtmp/run-unit-tests-artifacts/toil-tests-junit.xml - =========================== short test summary info ============================ SKIPPED [6] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Install Toil with the 'kubernetes' extra to include this test. SKIPPED [6] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Install py-tes to include this test SKIPPED [122] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/batchSystems/batchSystemTest.py:998: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/batchSystems/batchSystemTest.py:377: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/batchSystems/batchSystemTest.py:1038: Need at least four cores to run this test SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/jobStores/jobStoreTest.py:942: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/jobStores/jobStoreTest.py:1015: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/jobStores/jobStoreTest.py:780: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/jobStores/jobStoreTest.py:896: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/jobStores/jobStoreTest.py:799: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [53] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Install Toil with the 'google' extra to include this test. SKIPPED [44] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Skipping docker test. SKIPPED [8] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Set TOIL_AWS_KEYNAME to an AWS-stored SSH key to include this test. SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/provisioners/clusterScalerTest.py:502: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/provisioners/clusterScalerTest.py:531: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/provisioners/clusterScalerTest.py:600: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/provisioners/aws/awsProvisionerTest.py:50: Set TOIL_AWS_KEYNAME to an AWS-stored SSH key to include this test. SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/provisioners/aws/awsProvisionerTest.py:58: Set TOIL_AWS_KEYNAME to an AWS-stored SSH key to include this test. SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Install Toil with the 'server' extra to include this test. SKIPPED [12] ../../../../../usr/lib/python3/dist-packages/_pytest/unittest.py:153: Install Mesos (and Toil with the 'mesos' extra) to include this test. SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/checkpointTest.py:35: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/checkpointTest.py:51: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/deferredFunctionTest.py:96: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/deferredFunctionTest.py:127: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:118: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:168: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:623: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:453: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:421: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:437: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:1096: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:399: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:903: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:792: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:803: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:1149: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:1142: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:911: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/fileStoreTest.py:926: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/importExportFileTest.py:84: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobFileStoreTest.py:79: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobServiceTest.py:56: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobServiceTest.py:76: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobServiceTest.py:137: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobServiceTest.py:114: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobServiceTest.py:40: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [2] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobServiceTest.py:107: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobTest.py:373: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobTest.py:265: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobTest.py:287: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobTest.py:152: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobTest.py:37: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/jobTest.py:122: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/miscTests.py:48: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/promisedRequirementTest.py:37: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/promisedRequirementTest.py:53: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/promisedRequirementTest.py:123: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/regularLogTest.py:56: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/regularLogTest.py:84: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/regularLogTest.py:74: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/restartDAGTest.py:43: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/restartDAGTest.py:47: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/src/userDefinedJobArgTypeTest.py:41: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/utils/toilDebugTest.py:48: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/utils/utilsTest.py:120: Set TOIL_AWS_KEYNAME to an AWS-stored SSH key to include this test. SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/utils/utilsTest.py:319: Skipping docker test. SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/utils/utilsTest.py:331: Skipping docker test. SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/utils/utilsTest.py:270: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/utils/utilsTest.py:164: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/utils/utilsTest.py:231: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/wdl/toilwdlTest.py:323: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/wdl/toilwdlTest.py:113: Skipping docker test. SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/wdl/toilwdlTest.py:266: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/wdl/toilwdlTest.py:280: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/wdl/toilwdlTest.py:294: Skipped because TOIL_TEST_QUICK is "True" SKIPPED [1] ../../../../../usr/lib/python3/dist-packages/toil/test/wdl/toilwdlTest.py:308: Skipped because TOIL_TEST_QUICK is "True" === 1 failed, 228 passed, 331 skipped, 217 deselected in 1447.83s (0:24:07) ====
autopkgtest [03:37:28]: test run-unit-tests

Attachment: OpenPGP_signature
Description: OpenPGP digital signature


Reply to: