Bug#137709: marked as done (feature request: gzip /var/lib/apt/lists/*)
Your message dated Mon, 11 Mar 2002 15:52:28 -0700 (MST)
with message-id <[🔎] Pine.LNX.3.96.1020311154640.3123A-100000@wakko.debian.net>
and subject line Bug#137709: feature request: gzip /var/lib/apt/lists/*
has caused the attached Bug report to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what I am
talking about this indicates a serious mail system misconfiguration
somewhere. Please contact me immediately.)
Debian bug tracking system administrator
(administrator, Debian Bugs database)
--------------------------------------
Received: (at submit) by bugs.debian.org; 10 Mar 2002 14:13:34 +0000
>From richard@sfere.greenend.org.uk Sun Mar 10 08:13:34 2002
Return-path: <richard@sfere.greenend.org.uk>
Received: from chiark.greenend.org.uk [212.22.195.2] (mail)
by master.debian.org with esmtp (Exim 3.12 1 (Debian))
id 16k44r-0004Zv-00; Sun, 10 Mar 2002 08:13:34 -0600
Received: from (sfere.anjou.terraraq.org.uk) [172.17.207.1] (mail)
by chiark.greenend.org.uk with esmtp (Exim 3.12 #1)
id 16k44q-0000g9-00 (Debian); Sun, 10 Mar 2002 14:13:32 +0000
Received: from richard by sfere.anjou.terraraq.org.uk with local (Exim 3.34 #1 (Debian))
id 16k44p-0000bd-00; Sun, 10 Mar 2002 14:13:31 +0000
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Message-ID: <[🔎] wwv7kokzf1x.fsf@rjk.greenend.org.uk>
Date: Sun, 10 Mar 2002 14:13:30 +0000
X-Face: h[Hh-7npe<<b4/eW[]sat,I3O`t8A`(ej.H!F4\8|;ih)`7{@:A~/j1}gTt4e7-n*F?.Rl^
F<\{jehn7.KrO{!7=:(@J~]<.[{>v9!1<qZY,{EJxg6?Er4Y7Ng2\Ft>Z&W?r\c.!4DXH5PWpga"ha
+r0NzP?vnz:e/knOY)PI-
X-Boydie: NO
From: Richard Kettlewell <rjk@greenend.org.uk>
X-Mailer: Norman
To: submit@bugs.debian.org
Subject: feature request: gzip /var/lib/apt/lists/*
X-Mailer: VM 7.00 under 21.4 (patch 6) "Common Lisp" XEmacs Lucid
Delivered-To: submit@bugs.debian.org
Package: apt
Version: 0.5.4
This directory takes up a lot of space, but the packages files it
contains are highly compressible (about 75% can be saved on one of my
systems). This may not be much of an issue on large modern machines
but I still have one system which is short of disk space.
Space may not be the only consideration. I recall that when the idea
of compressing man pages originally came up on debian-devel, tests
showed that the compressed versions actually rendered faster even on a
486: the reduction in disk access required more than compensated for
the extra CPU used.
Of course this is a different application, so the results may differ,
but it could be worth investigating.
ttfn/rjk
---------------------------------------
Received: (at 137709-done) by bugs.debian.org; 11 Mar 2002 22:52:30 +0000
>From jgg@debian.org Mon Mar 11 16:52:30 2002
Return-path: <jgg@debian.org>
Received: from skip-ext.ab.videon.ca [206.75.216.36]
by master.debian.org with smtp (Exim 3.12 1 (Debian))
id 16kYec-0005kh-00; Mon, 11 Mar 2002 16:52:30 -0600
Received: (qmail 21225 invoked from network); 11 Mar 2002 22:52:28 -0000
Received: from unknown (HELO wakko.debian.net) ([24.86.210.128]) (envelope-sender <jgg@debian.org>)
by skip-ext.ab.videon.ca (qmail-ldap-1.03) with SMTP
for <doogie@debian.org>; 11 Mar 2002 22:52:28 -0000
Received: from localhost
([127.0.0.1] helo=wakko.debian.net ident=jgg)
by wakko.debian.net with smtp (Exim 3.16 #1 (Debian))
id 16kYea-0000oO-00; Mon, 11 Mar 2002 15:52:28 -0700
Date: Mon, 11 Mar 2002 15:52:28 -0700 (MST)
From: Jason Gunthorpe <jgg@debian.org>
X-Sender: jgg@wakko.debian.net
To: Adam Heath <doogie@debian.org>, 137709-done@bugs.debian.org
cc: Richard Kettlewell <rjk@greenend.org.uk>,
debian-bugs-dist@lists.debian.org,
APT Development Team <deity@lists.debian.org>, apt@packages.qa.debian.org
Subject: Re: Bug#137709: feature request: gzip /var/lib/apt/lists/*
In-Reply-To: <[🔎] Pine.LNX.4.33.0203111229260.22804-100000@gradall.private.brainfood.com>
Message-ID: <[🔎] Pine.LNX.3.96.1020311154640.3123A-100000@wakko.debian.net>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Delivered-To: 137709-done@bugs.debian.org
On Mon, 11 Mar 2002, Adam Heath wrote:
> On a performance note, dpkg has support for reading status/available, either
> with mmap, or with block reads(apt only uses mmap). My performance testing
> showed the difference in speed, with a sufficiently large block size, was just
> noise.
It doesn't mmap, it just random-seeks. It doesn't load the package files
at all, only the portions of records it needs when it needs them. The
shear amount of data in the package files make it infeasible to load them
all at once into ram. That is why the memory footprint is so very small,
which is far more important on older systems than disk usage.
It is possible to store them compressed but it would have to use a
non-standard compression scheme to allow random seeking to still work.
Jason
Reply to: