Re: New mirror scripts for Debian mirrors
Arnt Karlsen (firstname.lastname@example.org) wrote on 9 November 2008 23:31:
>On Sun, 09 Nov 2008 12:21:33 -0500, Ricardo wrote in message
>> Carlos Carvalho wrote:
>> > The problem, in our case, is not the download, it's the scavenging
>> > of an enormous tree to determine what has to be transfered. This is
>> > very heavy because it's almost only disk seeks.
>> Yes, this part of the sync process is time consuming and is what will
>> eventually limit the frequency of pushes.
>..what then am I seeing?; with 256MB ram in my mirror box, I saw scan(?)
>times around 1/2 an hour, with 1/2GB I now see 2 to 3 minutes before
>the download starts from ftp.de2.d.o, but from ftp.de.d.o it's still
>close to 1/2 an hour??? These 2 are "my" best mirrors, I'm in Norway
>but the ones closer to me, are all slower.
If you use the --stats option of rsync it'll show the time the server
takes to build the file list. See if they're very different for the
two mirrors. Note that this may vary a lot for a given mirror, so you
have to build some statistics before drawing conclusions.