Re: New mirror scripts for Debian mirrors

[carlos@fisica.ufpr.br (Carlos Carvalho)]

Arnt Karlsen (arnt@c2i.net) wrote on 9 November 2008 23:31:
 >On Sun, 09 Nov 2008 12:21:33 -0500, Ricardo wrote in message 
 ><[🔎] 49171C1D.80706@calel.org>:
 >
 >> Carlos Carvalho wrote:
 >> 
 >> > The problem, in our case, is not the download, it's the scavenging
 >> > of an enormous tree to determine what has to be transfered. This is
 >> > very heavy because it's almost only disk seeks.
 >> > 
 >> 
 >> Yes, this part of the sync process is time consuming and is what will 
 >> eventually limit the frequency of pushes.
 >
 >..what then am I seeing?; with 256MB ram in my mirror box, I saw scan(?)
 >times around 1/2 an hour, with 1/2GB I now see 2 to 3 minutes before
 >the download starts from ftp.de2.d.o, but from ftp.de.d.o it's still
 >close to 1/2 an hour???  These 2 are "my" best mirrors, I'm in Norway
 >but the ones closer to me, are all slower.

If you use the --stats option of rsync it'll show the time the server
takes to build the file list. See if they're very different for the
two mirrors. Note that this may vary a lot for a given mirror, so you
have to build some statistics before drawing conclusions.