Slow Server Syncs?
It was brought to Progeny's attention yesterday that the time it
takes for archive.progeny.com to synchronize to ftp-master.debian.org's
contents is extremely long. For the past several days it has taken over
12 hours for the synchronization to finish. We're seeing rsync data
transfers on the order 40 to 50 kB/s (320 to 400 kbps).
I'm fairly sure the problem is not on our end, so I thought we'd
check with the Debian mirror maintainers to see if they knew anything
about the slow transfer rate.
Thanks.
Example: the script that controls these two rsync jobs began
Monday, September 18, 2006 at 16:34 EST and ended Tuesday, September 19,
2006 at 08:27 EST. (15 hours, 53 minutes.)
===
> rsync -vaH --stats --partial --exclude "Packages*" --exclude \
> "Sources*" --exclude "Release*" --exclude "ls-lR*" \
> $RSITE $FTPPUB/debian/
===
> Number of files: 444006
> Number of files transferred: 2641
> Total file size: 217496349916 bytes
> Total transferred file size: 2538772468 bytes
> Literal data: 2453150131 bytes
> Matched data: 85622337 bytes
> File list size: 12245054
> File list generation time: 350.756 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 413774
> Total bytes received: 2465967118
>
> sent 413774 bytes received 2465967118 bytes 47917.41 bytes/sec
> total size is 217496349916 speedup is 88.18
===
===
> rsync -vaH --stats --partial --delete --delete-after \
> $RSITE $FTPPUB/debian/
===
> Number of files: 455937
> Number of files transferred: 541
> Total file size: 218205204086 bytes
> Total transferred file size: 253272336 bytes
> Literal data: 250809506 bytes
> Matched data: 2462830 bytes
> File list size: 12544735
> File list generation time: 374.972 seconds
> File list transfer time: 0.000 seconds
> Total bytes sent: 778616
> Total bytes received: 263422351
>
> sent 778616 bytes received 263422351 bytes 44221.44 bytes/sec
> total size is 218205204086 speedup is 825.91
===
--
Bernie Hoefer Progeny Linux Systems, Inc.
Reply to: