Bug#501747: occurs only via ‘apt-cacher’, not otherwise
reassign 501747 apt-cacher
retitle 501747 apt-cacher: clients take excessive time to download files
thanks
On 11-Oct-2008, Ben Finney wrote:
> The correct resolution is to fix the download of diffs that are taking
> orders of magnitude longer than a manual download of the all-in-one
> file, so that ‘update’ is useable again. Unfrotunately for this
> purpose, I have now worked around the problem on this system, so
> cannot offer much more diagnostic help.
Further diagnosis shows that this is only a problem when fetching
files via an ‘apt-cacher’ instance. It occurs for any requested files;
‘Packages.gz’ or binary ‘….deb’ have both shown this behaviour.
=====
$ sudo aptitude full-upgrade
Reading package lists... Done
Building dependency tree
Reading state information... Done
Reading extended state information
Initializing package states... Done
The following packages will be upgraded:
clamav clamav-base clamav-daemon clamav-freshclam console-common console-data cron dhcp3-client dhcp3-common elinks elinks-data gcc-4.3-base
libapache2-mod-php5 libclamav5 libdb4.5 libdb4.6 libgcc1 libparted1.8-10 libperl5.10 libpng12-0 libpq5 libstdc++6 libvolume-id0 libx11-6 libx11-data
libzzip-0-12 logrotate parted perl perl-base perl-doc perl-modules php-pear php5 php5-common python2.5 python2.5-minimal spamc ssl-cert udev
x-ttcidfont-conf
41 packages upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Need to get 50.6MB of archives. After unpacking 1831kB will be used.
Do you want to continue? [Y/n/?]
Writing extended state information... Done
Get:1 http://proxy lenny/main perl-modules 5.10.0-15 [3191kB]
Get:2 http://proxy lenny/main perl-modules 5.10.0-15 [3191kB]
Get:3 http://proxy lenny/main perl-modules 5.10.0-15 [3191kB]
1% [3 perl-modules 839840/3191kB 26%]^C
====
Each of the above downloads takes tens of minutes, and after each
download another begins downloading the same file. Estimated time to
complete varies during the process, but is on the order of 10 hours. I
can only interrupt the process, or it will cycle indefinitely.
The ‘/var/log/apt-cacher/*.log’ files show no unusual behaviour; only
accesses of the requested files.
When I reconfigure ‘/etc/apt/sources.list.d/’ to avoid the
‘apt-cacher’ proxy, the download proceeds much faster and downloads
files only once as expected:
=====
$ sudo aptitude update && sudo aptitude full-upgrade
Get:1 http://security.debian.org lenny/updates Release.gpg [189B]
Ign http://security.debian.org lenny/updates/main Translation-en_AU
Get:2 http://security.debian.org lenny/updates Release [40.7kB]
Get:3 http://mirror.internode.on.net lenny Release.gpg [189B]
Ign http://mirror.internode.on.net lenny/main Translation-en_AU
Hit http://volatile.debian.net lenny/volatile Release.gpg
Ign http://volatile.debian.net lenny/volatile/main Translation-en_AU
Hit http://volatile.debian.net lenny/volatile Release
Ign http://volatile.debian.net lenny/volatile/main Packages/DiffIndex
Get:4 http://mirror.internode.on.net lenny Release [74.5kB]
Hit http://volatile.debian.net lenny/volatile/main Packages
Get:5 http://security.debian.org lenny/updates/main Packages [172kB]
Get:6 http://mirror.internode.on.net lenny/main Packages [5359kB]
Fetched 5647kB in 9min34s (9835B/s)
Reading package lists... Done
Current status: 36 updates [+36], 21635 new [+21635].
Reading package lists... Done
Building dependency tree
Reading state information... Done
Reading extended state information
Initializing package states... Done
The following packages will be upgraded:
clamav clamav-base clamav-daemon clamav-freshclam console-common cron elinks elinks-data gcc-4.3-base libapache2-mod-php5 libclamav5 libdb4.5 libdb4.6
libgcc1 libperl5.10 libpng12-0 libpq5 libstdc++6 libvolume-id0 libx11-6 libx11-data libzzip-0-12 logrotate perl perl-base perl-doc perl-modules
php-pear php5 php5-common python2.5 python2.5-minimal spamc ssl-cert udev x-ttcidfont-conf
36 packages upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Need to get 48.7MB of archives. After unpacking 1815kB will be used.
Do you want to continue? [Y/n/?]
Writing extended state information... Done
Get:1 http://security.debian.org lenny/updates/main libzzip-0-12 0.12.83-8lenny1 [35.2kB]
Get:2 http://mirror.internode.on.net lenny/main perl-modules 5.10.0-15 [3191kB]
Get:3 http://mirror.internode.on.net lenny/main libdb4.6 4.6.21-11 [573kB]
Get:4 http://mirror.internode.on.net lenny/main perl 5.10.0-15 [4547kB]
[…]
Get:34 http://mirror.internode.on.net lenny/main python2.5-minimal 2.5.2-11.1 [1180kB]
Get:35 http://mirror.internode.on.net lenny/main spamc 3.2.5-1 [72.2kB]
Get:36 http://mirror.internode.on.net lenny/main ssl-cert 1.0.23 [13.1kB]
Get:37 http://mirror.internode.on.net lenny/main x-ttcidfont-conf 30 [23.4kB]
Fetched 41.9MB in 42min4s (16.6kB/s)
Reading changelogs...
[…]
=====
--
\ “A free society is one where it is safe to be unpopular.” |
`\ —Adlai Ewing Stevenson |
_o__) |
Ben Finney <ben@benfinney.id.au>
Reply to: