Linus Nordberg pushed to branch master at snapshot / snapshot
Commits:
-
448312a9
by Linus Nordberg at 2024-10-10T09:41:23+02:00
-
8cf3959a
by Linus Nordberg at 2024-10-10T09:41:25+02:00
-
fb857a8d
by Linus Nordberg at 2024-10-15T15:01:01+00:00
4 changed files:
- + web/app/snapshot/static/images/glasklar.png
- web/app/snapshot/templates/base/page.html
- web/app/snapshot/templates/root/description.html
- web/app/snapshot/templates/root/news.html
Changes:
| ... | ... | @@ -55,10 +55,12 @@ |
| 55 | 55 | <br/>
|
| 56 | 56 | Hosting for snapshot.debian.org generously provided by our partners.
|
| 57 | 57 | <div>
|
| 58 | - <a title="Wellcome Trust Sanger Institute" href="">"https://www.sanger.ac.uk"><img width="150" height="50" alt="Sanger" src="">"/static/images/sanger.png"/></a>
|
|
| 58 | + <a title="Glasklar Teknik AB" href="">"https://www.glasklarteknik.se/"><img width="174" height="40" alt="Glasklar" src="">"/static/images/glasklar.png"/></a>
|
|
| 59 | 59 |
|
| 60 | 60 | <a title="LeaseWeb offers hosted infrastructure solutions, including Cloud, CDN, Dedicated Servers, Managed Hosting, Colocation, and Hybrid Solutions" href="">"https://www.leaseweb.com"><img width="150" height="50" alt="LeaseWeb" src="">"/static/images/leaseweb.png"/></a>
|
| 61 | - </div>
|
|
| 61 | +
|
|
| 62 | + <a title="Wellcome Trust Sanger Institute" href="">"https://www.sanger.ac.uk"><img width="150" height="50" alt="Sanger" src="">"/static/images/sanger.png"/></a>
|
|
| 63 | + </div>
|
|
| 62 | 64 | </div>
|
| 63 | 65 | </body>
|
| 64 | 66 | </html> |
| ... | ... | @@ -15,10 +15,11 @@ used by all. |
| 15 | 15 | </p>
|
| 16 | 16 | |
| 17 | 17 | <p>
|
| 18 | -The Debian Project would like to thank the
|
|
| 19 | -<a href="">"https://www.sanger.ac.uk/">Wellcome Trust Sanger Institute</a> and
|
|
| 20 | -<a href="">"https://www.leaseweb.com">LeaseWeb Netherlands B.V.</a> for providing
|
|
| 21 | -hardware and hosting.
|
|
| 18 | +The Debian Project would like to thank
|
|
| 19 | +<a href="">"https://www.glasklarteknik.se/">Glasklar Teknik AB</a>,
|
|
| 20 | +<a href="">"https://www.leaseweb.com">LeaseWeb Netherlands B.V.</a> and the
|
|
| 21 | +<a href="">"https://www.sanger.ac.uk/">Wellcome Trust Sanger Institute</a>
|
|
| 22 | +for providing hardware and hosting.
|
|
| 22 | 23 | |
| 23 | 24 | We would also like to thank the
|
| 24 | 25 | <a href="">"https://www.ece.ubc.ca/">Electrical and Computer Engineering</a>
|
| 1 | 1 | <h1>News</h1>
|
| 2 | 2 | |
| 3 | +<h2>2024-10-08</h2>
|
|
| 4 | +<p>After some time of trouble with imports lagging
|
|
| 5 | +behind, <a title="Glasklar Teknik AB"
|
|
| 6 | +href="">"https://www.glasklarteknik.se/">Glasklar Teknik AB</a>
|
|
| 7 | +generously offered to donate and host hardware for a new main site.
|
|
| 8 | +Earlier this year, a new 4U Supermicro with an AMD Epyc 24C/48T CPU,
|
|
| 9 | +512GB RAM, 10GE + 1GE NICs, SSD storage for the system and 480TB HDD
|
|
| 10 | +for storage of packages was purchased and set up. The HDD's are
|
|
| 11 | +organised in two RAID6 arrays with 11 x 20TB plus one spare 20TB drive
|
|
| 12 | +in each array, providing 2 x 164TB worth of storage.
|
|
| 13 | +</p>
|
|
| 14 | +<p>The new server has no problems keeping up with importing the full
|
|
| 15 | +archives on every update as each run finishes comfortably in time
|
|
| 16 | +before it's time to run again. For example, the 'debian' archive which
|
|
| 17 | +is updated every six hours takes on average 11 minutes to
|
|
| 18 | +import. While the new server is the one doing all the importing of
|
|
| 19 | +updated archives, the HTTP interface (https://snapshot.debian.org/) is
|
|
| 20 | +being served by both the new server and one of the VM's at LeaseWeb.
|
|
| 21 | +Snapshot is currently holding 172TB of data.
|
|
| 22 | +</p>
|
|
| 23 | +<p>Other recent changes include
|
|
| 24 | + <ul>
|
|
| 25 | + <li>A new API endpoint for listing all timestamps grouped by
|
|
| 26 | + archives (/mr/timestamp/) was added in August 2024.</li>
|
|
| 27 | + <li>The Netfilter rate limiting has been disabled. It will be
|
|
| 28 | + replaced by rate limiting on the HTTP layer, which should be
|
|
| 29 | + easier for clients to deal with.</li>
|
|
| 30 | + </ul>
|
|
| 31 | +</p>
|
|
| 32 | +<p>Future outlook:
|
|
| 33 | + <ul>
|
|
| 34 | + <li>There is ongoing work to import all lost debian-ports
|
|
| 35 | + history.</li>
|
|
| 36 | + <li>A development and test system is being set up for a less
|
|
| 37 | + stressful develop/test/deploy cycle.</li>
|
|
| 38 | + <li>Replacing SHA-1 with SHA-256 for file identities is
|
|
| 39 | + planned. Old URLs with SHA-1 strings will keep working.</li>
|
|
| 40 | + <li>A reimplementation of the import scripts is being
|
|
| 41 | + considered. The rationale is that it should be easier to find
|
|
| 42 | + programmers who are comfortable with Python than what it is for
|
|
| 43 | + Ruby.</li>
|
|
| 44 | + </ul>
|
|
| 45 | +</p>
|
|
| 46 | + |
|
| 3 | 47 | <h2>2022-09-28</h2>
|
| 4 | 48 | <p>In the last couple of weeks, the snapshot.debian.org web frontends were
|
| 5 | 49 | updated from a pylons-based Python 2 application to a flask-based Python 3
|