Greetings folks!
I wanted to announce that salsa-status.debian.net is now up and running!
This Status Page provides both Salsa CI users and the Salsa CI developer team with visibility into CI performance, helping identify wasteful practices, broken configurations, and optimization opportunities across the entire Debian package ecosystem.
One of the main objectives is to help catch wasteful CI usage, which hasn't been possible/easy before due to lack of overview/stats.
The main features of the Salsa CI status page are:
Real-time Pipeline Monitoring: Pipeline stats, success rates, performance trends, and related metrics.
Project Analytics: Detailed insights into projects’ CI history and configurations
Job Type Analysis: Insights into types of jobs running in and on top of Salsa CI
CI Stats & Performance: CI duration trends and resource consumption
Matrix Alerts - Automated notifications for performance degradation at https://matrix.to/#/#salsa-stats:matrix.org
Quick glance of benefits for Debian/Salsa
Waste Detection & Resource Optimization:
The status page helps monitor total CI resource consumption across all projects, identify jobs and pipelines with excessive run times and failure rates, and track average durations to spot performance regressions over time.
Problem Identification:
The Status Page would greatly benefit the Salsa CI Team and its users in early identification of failures due to upstream changes, controlled roll-outs of features, regression after merged MRs, focused probing of job types, and in helping/encouraging projects with failing CI to fix them. The backend will send the alerts about such identified issues to the Matrix room.
Insight into Salsa:
The Salsa Status page will provide insight into the functioning of and load on Salsa. It provides real-time view of reported pipelines, their status, and run duration. With various filters in place, developers could also narrow down searches to probe specific issues. Salsa CI users could look into their individual project stats and pipelines and compare their trends over time.
Dashboard:
The dashboard consists mainly of 4 pages: Home page, Projects page, Pipelines page, and Job Types page. It is best optimized for desktops, though you can also use it on a phone with desktop mode enabled. I would encourage you to go ahead and explore the website since words can only say so much ;)
Registration and privacy:
Automated cron jobs fetch pipeline, job, and project data from Salsa Gitlab API. Only projects that are public are registered. Additionally, projects can opt-out by adding `SALSA_CI_ENABLE_STATS: 0` to their CI configuration, or reach out to delete their project’s pipeline stats.
Hosting:
Frontend: React dashboard is served at https://salsa-status.debian.net
Backend: Node.js API on the same domain at /api/v1
Database: We are using TiDB (tidbcloud.com)
**Note: The Salsa Status page is under active development. If you encounter any bugs or flaws, please consider overlooking the rough edges and reporting them. Feedback and feature requests are welcome in this email thread or at the issue tracker at https://salsa.debian.org/salsa-ci-team/pipeline/-/issues/413
Thanks,
Aayush Raj
GSoC student mentored by Otto Kekäläinen