Re: Query on Package rasdaemon Transition to Testing: QEMU vs. LXC
On Sun, 07 Jan 2024 at 13:00:00 +0100, Taihsiang Ho (tai271828) wrote:
> does Debian CI accept exit code 8 when migrating a
> package from Sid to Testing?
Yes, exit status 8 (meaning no non-superficial tests that were runnable
with the current restrictions) is equivalent to not having any tests
at all. debci logs it as "neutral" rather than as a pass or fail.
"Restrictions: isolation-machine" is the correct way to represent a test
that cannot run successfully under e.g. lxc.
For example see https://ci.debian.net/packages/b/bubblewrap/ which also
cannot be tested under lxc and therefore has all tests tagged as
isolation-machine.
The technical detail is that all of these situations are treated as
being very similar:
* test "x" was excluded by the current restrictions and not run at all
* test "x" is tagged as flaky, and it failed
* test "x" is tagged as superficial, and it succeeded
* test "x" is tagged as skippable, and it exited with status 77
If every test had one of those statuses, then you get exit status 8,
reported by debci as neutral. You can think of this as: "we have no solid
evidence that this package works, but also no evidence that it's broken".
If at least one test had one of those statuses, and at least one other
test was successful, and no tests failed, then you get exit status 2,
reported by debci as success. You can think of it as "success, but
with limitations".
smcv
Reply to: