[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Cannot connect to snapshot.debian.org

Steffen Eichler schrieb am Montag, dem 26. Juli 2010:

> thanks for your fast reply. Sorry for the trouble we have caused.
> The request came from our debian package caching system. All our servers
> (over 400) running over this cache.
> We solved this with apt-cacher-ng. Every sunday we change the package
> source urls timestamp to the actual date.
> For example:
> http://snapshot.debian.org/archive/debian/20100726T135349Z/
> http://snapshot.debian.org/archive/debian-security/20100726T135349Z/
> http://snapshot.debian.org/archive/backports.org/20100726T135349Z/
> http://snapshot.debian.org/archive/debian-volatile/20100726T135349Z/
> Unfortunately it seems so that apt-cacher-ng passes all request for
> /dists/ directly to your system and this caused the 550000 hits.
> At the moment I switched back to the "normal" package mirrors
> (packages.debian.org, backports.org, ...).
> I hope to solve the problem with apt-cacher-ng and to reduce the hits on
> snapshots.debian.org. I would be very pleased if you could disable the
> block of our ip. So I can test an possible solution.

That's an interesting usecase.  I have removed the block for now, tho if
it causes problems again we'll have to start rate limiting requests.

Looking at the status codes returned a good chunk is for files that don't even
|       # http code
|    1026 200
|  352016 206
|  199136 404
|     117 500

It'd be nice if apt-cacher could be taught to not be so stupid about
requests and caching tho.  Snapshot sends a
'Cache-Control: public, max-age=864000' header for most static content,
so in theory a client should not even come back for requests that got
answered successfully for a day.

Yet we had almost 20k requests for

Maybe we should just set up squid as a reverse proxy on snapshot.d.o to
get rid of the more stupid clients out there.

                           |  .''`.  ** Debian GNU/Linux **
      Peter Palfrader      | : :' :      The  universal
 http://www.palfrader.org/ | `. `'      Operating System
                           |   `-    http://www.debian.org/

Reply to: