Re: How to make Packages file 50% smaller
> > >- rsync: uses too much load on the server.
> >
> > Why uses rsync too much load?
> >
> > Why don't you rsync Packages uncompressed? I don't know how much it's
> > producing load on the server, but rsync'ing Packages uncompressed needs
> > around 6 times less time than compressed, even if it's 3 times larger.
>
> See the rsync tech report (which comes in the rsync package). In order for
> rsync to do its job, the server must compute checksums for the entire file,
> which can be a CPU- and/or IO-intensive operation.
>
> I seem to recall someone working on a method for caching these checksums
> across multiple rsync invocations...
I don't think computing checksums adds that much cpu load in relation to
what's needed for the actual filetransfer. Anyway it would be good if we
had some comparable numbers. Could anybody with a Debian mirror messure
(approximatly) how much CPU-load a filetransfer of i.e. Packages.gz
needs with rsync in relation to ftp, of course without anything on the
client side?
O. Wyss
Reply to: