Linus Nordberg pushed to branch master at snapshot / snapshot
Commits:
-
448312a9
by Linus Nordberg at 2024-10-10T09:41:23+02:00
-
8cf3959a
by Linus Nordberg at 2024-10-10T09:41:25+02:00
-
fb857a8d
by Linus Nordberg at 2024-10-15T15:01:01+00:00
4 changed files:
- + web/app/snapshot/static/images/glasklar.png
- web/app/snapshot/templates/base/page.html
- web/app/snapshot/templates/root/description.html
- web/app/snapshot/templates/root/news.html
Changes:
... | ... | @@ -55,10 +55,12 @@ |
55 | 55 | <br/>
|
56 | 56 | Hosting for snapshot.debian.org generously provided by our partners.
|
57 | 57 | <div>
|
58 | - <a title="Wellcome Trust Sanger Institute" href="">"https://www.sanger.ac.uk"><img width="150" height="50" alt="Sanger" src="">"/static/images/sanger.png"/></a>
|
|
58 | + <a title="Glasklar Teknik AB" href="">"https://www.glasklarteknik.se/"><img width="174" height="40" alt="Glasklar" src="">"/static/images/glasklar.png"/></a>
|
|
59 | 59 |
|
60 | 60 | <a title="LeaseWeb offers hosted infrastructure solutions, including Cloud, CDN, Dedicated Servers, Managed Hosting, Colocation, and Hybrid Solutions" href="">"https://www.leaseweb.com"><img width="150" height="50" alt="LeaseWeb" src="">"/static/images/leaseweb.png"/></a>
|
61 | - </div>
|
|
61 | +
|
|
62 | + <a title="Wellcome Trust Sanger Institute" href="">"https://www.sanger.ac.uk"><img width="150" height="50" alt="Sanger" src="">"/static/images/sanger.png"/></a>
|
|
63 | + </div>
|
|
62 | 64 | </div>
|
63 | 65 | </body>
|
64 | 66 | </html> |
... | ... | @@ -15,10 +15,11 @@ used by all. |
15 | 15 | </p>
|
16 | 16 | |
17 | 17 | <p>
|
18 | -The Debian Project would like to thank the
|
|
19 | -<a href="">"https://www.sanger.ac.uk/">Wellcome Trust Sanger Institute</a> and
|
|
20 | -<a href="">"https://www.leaseweb.com">LeaseWeb Netherlands B.V.</a> for providing
|
|
21 | -hardware and hosting.
|
|
18 | +The Debian Project would like to thank
|
|
19 | +<a href="">"https://www.glasklarteknik.se/">Glasklar Teknik AB</a>,
|
|
20 | +<a href="">"https://www.leaseweb.com">LeaseWeb Netherlands B.V.</a> and the
|
|
21 | +<a href="">"https://www.sanger.ac.uk/">Wellcome Trust Sanger Institute</a>
|
|
22 | +for providing hardware and hosting.
|
|
22 | 23 | |
23 | 24 | We would also like to thank the
|
24 | 25 | <a href="">"https://www.ece.ubc.ca/">Electrical and Computer Engineering</a>
|
1 | 1 | <h1>News</h1>
|
2 | 2 | |
3 | +<h2>2024-10-08</h2>
|
|
4 | +<p>After some time of trouble with imports lagging
|
|
5 | +behind, <a title="Glasklar Teknik AB"
|
|
6 | +href="">"https://www.glasklarteknik.se/">Glasklar Teknik AB</a>
|
|
7 | +generously offered to donate and host hardware for a new main site.
|
|
8 | +Earlier this year, a new 4U Supermicro with an AMD Epyc 24C/48T CPU,
|
|
9 | +512GB RAM, 10GE + 1GE NICs, SSD storage for the system and 480TB HDD
|
|
10 | +for storage of packages was purchased and set up. The HDD's are
|
|
11 | +organised in two RAID6 arrays with 11 x 20TB plus one spare 20TB drive
|
|
12 | +in each array, providing 2 x 164TB worth of storage.
|
|
13 | +</p>
|
|
14 | +<p>The new server has no problems keeping up with importing the full
|
|
15 | +archives on every update as each run finishes comfortably in time
|
|
16 | +before it's time to run again. For example, the 'debian' archive which
|
|
17 | +is updated every six hours takes on average 11 minutes to
|
|
18 | +import. While the new server is the one doing all the importing of
|
|
19 | +updated archives, the HTTP interface (https://snapshot.debian.org/) is
|
|
20 | +being served by both the new server and one of the VM's at LeaseWeb.
|
|
21 | +Snapshot is currently holding 172TB of data.
|
|
22 | +</p>
|
|
23 | +<p>Other recent changes include
|
|
24 | + <ul>
|
|
25 | + <li>A new API endpoint for listing all timestamps grouped by
|
|
26 | + archives (/mr/timestamp/) was added in August 2024.</li>
|
|
27 | + <li>The Netfilter rate limiting has been disabled. It will be
|
|
28 | + replaced by rate limiting on the HTTP layer, which should be
|
|
29 | + easier for clients to deal with.</li>
|
|
30 | + </ul>
|
|
31 | +</p>
|
|
32 | +<p>Future outlook:
|
|
33 | + <ul>
|
|
34 | + <li>There is ongoing work to import all lost debian-ports
|
|
35 | + history.</li>
|
|
36 | + <li>A development and test system is being set up for a less
|
|
37 | + stressful develop/test/deploy cycle.</li>
|
|
38 | + <li>Replacing SHA-1 with SHA-256 for file identities is
|
|
39 | + planned. Old URLs with SHA-1 strings will keep working.</li>
|
|
40 | + <li>A reimplementation of the import scripts is being
|
|
41 | + considered. The rationale is that it should be easier to find
|
|
42 | + programmers who are comfortable with Python than what it is for
|
|
43 | + Ruby.</li>
|
|
44 | + </ul>
|
|
45 | +</p>
|
|
46 | + |
|
3 | 47 | <h2>2022-09-28</h2>
|
4 | 48 | <p>In the last couple of weeks, the snapshot.debian.org web frontends were
|
5 | 49 | updated from a pylons-based Python 2 application to a flask-based Python 3
|