Re: occasional error on ftp.cz.debian.org

[Josip Rodin <joy@entuzijast.net>]

On Sun, Nov 05, 2006 at 02:43:57PM +0100, Dan Ohnesorg wrote:
> > They should first pull the debs, then update the Packages* files, then
> > delete. --delete-after --delay-updates to rsync should do the trick.
> > I'm CC'ing the admins.
> 
> Thank you for the report, I will check it, we are using oficial mirror
> script, which suggest only --delete-after:

> rsync -4 --recursive --links --hard-links --times --verbose --compress
> --delete --delete-after \
>      --exclude "Archive-Update-in-Progress-${HOSTNAME}" \
>      --exclude "project/trace/${HOSTNAME}" \
>      $EXCLUDE \
>      $RSYNC_USER@$RSYNC_HOST::debian $TO > /var/log/rsync/ftp.log 2>&1

You can optimize that further, by doing a two stage sync.
More exactly, like this:

  rsync --recursive --times --links --hard-links \
        --exclude "Packages*" --exclude "Sources*" \
        --exclude "Release*" --exclude "ls-lR*" \
        --verbose --stats \
        $FROM $TO > $LOGFILE 2>&1

  rsync --recursive --times --links --hard-links --max-delete=40000 \
        --delete --delete-after \
        --exclude "Archive-Update-in-Progress-${HOSTNAME}" \
        --exclude "project/trace/${HOSTNAME}" \
        --verbose --stats \
        $FROM $TO > $LOGFILE.2nd 2>&1

  cat $LOGFILE.2nd >> $LOGFILE
  rm $LOGFILE.2nd

-- 
     2. That which causes joy or happiness.