On 2025-08-25 4 h 05 p.m., Ian Jackson wrote:
Hi. (I wasn't able to find another mailing list for this. I found a bit of discussion on debian-devel about one specific overload incident.) Since sid opened, people have naturally been hard at work. Great! But I notice that Salsa CI is now frequently very overloaded. Even when it's not half a day behind (!), I often see that my package is able to run only about one job at a time. I think this is slowing a lot of us down quite considerably. It seems to me that we (Debian) could probably acquire more computing resources if we wanted. Perhaps some of our jobs are wasteful, but I think that overall, adding capacity would be well justified. I haven't seen any discussion of this anywhere. Is work ongoing to try to add more capacity to Salsa CI? What are the key difficulties? If we knew what kind of expertise/assistance/input/sponsorship was needed, I feel we could probably find it within our project. Thanks, Ian.
I raised a similar issue during DebConf25 and it looks like some changes were made back then [1], as it seems to me Salsa CI is indeed faster than it used to be.
Generally though, Salsa CI is pretty underpowered, which definitely slows down my Debian work. Running the Lintian testsuite (which is a requirement to merge contributions) frequently takes more than 2 hours to run. On my local machine at home, it takes around 4 minutes :(
I feel like making people wait around for CI to run isn't a great use of our collective time.
IIUC, runners are currently sponsored machines running in the Google Cloud [2]. Maybe we could prod them again and ask for some more resources, pretty please?
[1]: many thanks to the folks who worked on that issue[2]: https://salsa.debian.org/salsa/salsa-ansible/-/blob/master/inventories/prod/host_vars/salsa-runner.salsa-runner.debian.net.yml?ref_type=heads#L8-9
-- ⢀⣴⠾⠻⢶⣦⠀ ⣾⠁⢠⠒⠀⣿⡁ Louis-Philippe Véronneau ⢿⡄⠘⠷⠚⠋ pollo@debian.org / veronneau.org ⠈⠳⣄
Attachment:
OpenPGP_0xE1E5457C8BAD4113.asc
Description: OpenPGP public key
Attachment:
OpenPGP_signature.asc
Description: OpenPGP digital signature