Re: this mirror not push: rocky-mountain.csail.mit.edu

[Justin Pryzby <justinpryzby@users.sourceforge.net>]

> On Sat, Apr 05, 2008 at 10:30:37AM -0400, Justin Pryzby wrote:
> > Err http://ftp.us.debian.org unstable/main libwrap0-dev 7.6.q-15
> >   404 Not Found [IP: 128.30.2.36 80]
> [...]
> > Is this just a generalized incarnation of the problem with
> > mirrors.k.o?  The ftp.us.d.o are at: mit.edu, msu.edu, and osuosl.org.
> > Is there (supposed to be) something in place to avoid updating *any*
> > of their Packages files until *all* their /pool/ debs are sent?

On Sat, Apr 05, 2008 at 05:19:11PM +0200, Simon Paillard wrote:

> Could you please check that you use a rsync strategy identical as
> http://debian.org/mirror/anonftpsync (which first download new packages,
> then sync the rest, so that no problem should happen from the user point
> of view).

I don't think this is a mirror-specific problem, but rather some
design problem, or just something not implemented/behaving as
intended.

http://www.debian.org/mirrors/list
[A primary mirror] has an easy to remember name of the form
ftp.<country>.debian.org [and is] automatically updated whenever there
are updates to the Debian archive.

I think that means that ftp.us.debian.org should all be getting data
pushed to them [0].  So it's not a problem of the individual mirror
using an old, 1-stage anonftp, but rather the mirror push host not
doing the needed serialization [1], thusly updating some host's
Packages file before some other host's pool debs are finished sending.

Justin

[0] via a "Tier-1" aka "Push-Primary client"
    http://www.debian.org/mirror/push_mirroring

[1] Something of the form:

    for a in $pushtohosts
    do
    	rsync $archive/pool $a/pool >>log.$a 2>>&1
    done

    for a in $pushtohosts
    do
    	rsync --delay-updates --delete-after $archive $a
    done