Bug#1118567: udd: archive-ubuntu importer isn't working
Hi,
On 22/10/25 at 03:58 -0400, Jeremy Bícha wrote:
> Package: qa.debian.org
> Severity: important
>
> https://udd.debian.org/udd-status.cgi is reporting that the
> archive-ubuntu importer isn't working. It provides this log excerpt:
>
> /srv/udd.debian.org/udd/udd/archive_gatherer.rb:290:in
> `exec_prepared': ERROR: duplicate key value violates unique
> constraint "ubuntu_packages_pkey" (PG::UniqueViolation)
> DETAIL: Key (package, version, architecture, distribution, release,
> component)=(3cpio, 0.10.2-0ubuntu1, amd64, ubuntu, questing, main)
> already exists.
>
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:290:in `block in
> process_packages'
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:240:in `each'
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:240:in `process_packages'
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:402:in `block in run_path'
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:400:in `each'
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:400:in `run_path'
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:299:in `run'
> from /srv/udd.debian.org/udd/udd/archive_gatherer.rb:412:in `<main>'
>
> That source package (rust-threecpio) version is present in both
> questing and resolute.
>
> I assume this began failing after
> https://salsa.debian.org/qa/udd/-/merge_requests/64 was merged.
This is unrelated: web/ubuntu-releases.yml is only used by the web views
(to figure out which Ubuntu releases are the stable and devel ones).
Running the importer in debug mode fails with:
> Processing /srv/udd.debian.org/mirrors/ubuntu//dists/questing/main/binary-amd64/Packages.gz rel=questing comp=main arch=amd64
> Processing /srv/udd.debian.org/mirrors/ubuntu//dists/questing/main/binary-amd64v3/Packages.gz rel=questing comp=main arch=amd64v3
> /srv/udd.debian.org/udd/udd/archive_gatherer.rb:290:in `exec_prepared': ERROR: duplicate key value violates unique constraint "ubuntu_packages_pkey" (PG::UniqueViolation)
> DETAIL: Key (package, version, architecture, distribution, release, component)=(3cpio, 0.10.2-0ubuntu1, amd64, ubuntu, questing, main) already exists.
It looks like Ubuntu enabled Architecture Variants
(https://wiki.debian.org/ArchitectureVariants). The Packages.gz file in
binary-amd64v3 has 'Architecture-Variant: amd64v3', which is currently
ignored by UDD.
There's a blog article from December 2023 about this at
https://ubuntu.com/blog/optimising-ubuntu-performance-on-amd64-architecture
but I did not find any communication since then. What is the status of
this on the Ubuntu/Canonical side? Was this coordinated with Debian
somehow?
Also it's strange that the amd64v3 variant for questing (stable) was
added on the mirrors just before it was released, and not during the
development cycle. (or at least I assume that's the case since the
importer worked fine until 2025-09-30)
For now I disabled rsync'ing the binary-amd64v3/Packages.gz files, so
UDD does not process them. I'd like to understand a bit better the long
term plan before adding a proper fix into UDD.
Lucas
Reply to: