Bug#152711: marked as done ([methods/http] apt has problems with chunked encoding or publicfile?)
Your message dated Sat, 08 May 2004 16:47:03 -0400
with message-id <E1BMYit-0002m8-00@newraff.debian.org>
and subject line Bug#152711: fixed in apt 0.5.25
has caused the attached Bug report to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what I am
talking about this indicates a serious mail system misconfiguration
somewhere. Please contact me immediately.)
Debian bug tracking system administrator
(administrator, Debian Bugs database)
--------------------------------------
Received: (at submit) by bugs.debian.org; 12 Jul 2002 06:16:57 +0000
>From bblack@turd.schlitzed.com Fri Jul 12 01:16:57 2002
Return-path: <bblack@turd.schlitzed.com>
Received: from turd.schlitzed.com [216.70.9.121]
by master.debian.org with smtp (Exim 3.12 1 (Debian))
id 17Stjc-0007lS-00; Fri, 12 Jul 2002 01:16:56 -0500
Received: (qmail 5852 invoked by uid 33); 12 Jul 2002 06:15:33 -0000
Received: from 206.11.233.79 ( [206.11.233.79])
as user bblack@localhost by mail.schlitzed.com with HTTP;
Fri, 12 Jul 2002 01:15:32 -0500
Message-ID: <1026454532.3d2e7404b324b@mail.schlitzed.com>
Date: Fri, 12 Jul 2002 01:15:32 -0500
From: bblack@turd.schlitzed.com
To: submit@bugs.debian.org
Subject: apt has problems with chunked encoding or publicfile?
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
User-Agent: Internet Messaging Program (IMP) 3.1
X-Originating-IP: 206.11.233.79
Delivered-To: submit@bugs.debian.org
Package: apt
Version: 0.5.4
I was setting up a debian mirror at work at noticed that apt has problems
downloading large files from djb's http server publicfile
(http://cr.yp.to/publicfile.html) Small files download fine (like the contrib
and non-free Packages.gz files) but large files become corrupted during transfer.
I copied the /var/lib/apt/lists/partial/______ file during mid transfer and
started paging through it and noticed the file became corrupted midway through
I guess that means that some of the gzip conversion table data had been lost by
that point.
The large file corruption problem happens during "update" as well as during
"install"s
Here are the things i know.
publicfile was the only daemon that apt/http had problems transferring from.
apt/http had no problems downloading from apache, boa or webfs
publicfile was the only daemon that was doing chunked transfers.
links and galeon/mozilla were the only other download tools i had on hand that i
could do http/1.1 transfers with.
links galeon/mozilla downloaded the Releases.gz file without problem.
modifying methods/http.cc to do a 1.0 request and then setting the apt.conf
pipeline var to 0 so it didn't try to ask for 1.1 featurs the file downloads fine.
Headers.....(from ethereal)
apt headers:
T 127.0.0.1:1585 -> 127.0.0.1:80 [AP]
GET /debian/dists/woody/main/binary-i386/Packages.gz HTTP/1.1..Host: 127.0.
0.1..Connection: keep-alive..User-Agent: Debian APT-HTTP/1.3....GET /debian
/dists/woody/main/binary-i386/Release HTTP/1.1..Host: 127.0.0.1..Connection
: keep-alive..User-Agent: Debian APT-HTTP/1.3....
T 127.0.0.1:80 -> 127.0.0.1:1585 [AP]
HTTP/1.1 200 OK..Server: publicfile..Date: Fri, 12 Jul 2002 05:24:19 GMT..L
ast-Modified: Thu, 11 Jul 2002 19:08:01 GMT..Content-Type: application/x-gz
ip..Transfer-Encoding: chunked....400..
-
links headers:
T 127.0.0.1:1599 -> 127.0.0.1:80 [AP]
GET /debian/dists/woody/main/binary-i386/Packages.gz HTTP/1.1..Host: 127.0.
0.1..User-Agent: ELinks (0.4pre5; Unix; 80x25)..Accept: */*..Accept-Charset
: us-ascii, ISO-8859-1, ISO-8859-2, ISO-8859-4, ISO-8895-5, ISO-8859-7, ISO
-8895-9, ISO-8859-13, ISO-8859-15, ISO-8859-16, windows-1250, windows-1251,
windows-1257, cp437, cp737, cp850, cp852, cp866, x-cp866-u, x-mac, x-mac-c
e, x-kam-cs, koi8-r, koi8-u, TCVN-5712, VISCII, utf-8..Connection: Keep-Ali
ve....
T 127.0.0.1:80 -> 127.0.0.1:1599 [AP]
HTTP/1.1 200 OK..Server: publicfile..Date: Fri, 12 Jul 2002 05:30:01 GMT..L
ast-Modified: Thu, 11 Jul 2002 19:08:01 GMT..Content-Type: application/x-gz
ip..Transfer-Encoding: chunked....400..
-
galeon/mozilla headers:
T 127.0.0.1:1596 -> 127.0.0.1:80 [AP]
GET /debian/dists/woody/main/binary-i386/Packages.gz HTTP/1.1..Host: 127.0.
0.1..User-Agent: Mozilla/5.0 Galeon/1.2.5 (X11; Linux i686; U;) Gecko/20020
623 Debian/1.2.5-0.woody.1..Accept: text/xml,application/xml,application/xh
tml+xml,text/html;q=0.9,text/plain;q=0.8,video/x-mng,image/png,image/jpeg,i
mage/gif;q=0.2,text/css,*/*;q=0.1..Accept-Encoding: gzip, deflate, compress
;q=0.9..Accept-Charset: ISO-8859-1, utf-8;q=0.66, *;q=0.66..Keep-Alive: 300
..Connection: keep-alive....
T 127.0.0.1:80 -> 127.0.0.1:1596 [AP]
HTTP/1.1 200 OK..Server: publicfile..Date: Fri, 12 Jul 2002 05:27:30 GMT..L
ast-Modified: Thu, 11 Jul 2002 19:08:01 GMT..Content-Type: application/x-gz
ip..Transfer-Encoding: chunked....400..
If you need me to do any further tests just send me the details.
Thanks,
Bob Black
bblack@schlitzed.com
bblack@superiorbroadband.com
---------------------------------------
Received: (at 152711-close) by bugs.debian.org; 8 May 2004 20:53:09 +0000
>From katie@ftp-master.debian.org Sat May 08 13:53:09 2004
Return-path: <katie@ftp-master.debian.org>
Received: from newraff.debian.org [208.185.25.31] (mail)
by spohr.debian.org with esmtp (Exim 3.35 1 (Debian))
id 1BMYon-0005Ze-00; Sat, 08 May 2004 13:53:09 -0700
Received: from katie by newraff.debian.org with local (Exim 3.35 1 (Debian))
id 1BMYit-0002m8-00; Sat, 08 May 2004 16:47:03 -0400
From: Matt Zimmerman <mdz@debian.org>
To: 152711-close@bugs.debian.org
X-Katie: $Revision: 1.49 $
Subject: Bug#152711: fixed in apt 0.5.25
Message-Id: <E1BMYit-0002m8-00@newraff.debian.org>
Sender: Archive Administrator <katie@ftp-master.debian.org>
Date: Sat, 08 May 2004 16:47:03 -0400
Delivered-To: 152711-close@bugs.debian.org
X-Spam-Checker-Version: SpamAssassin 2.60-bugs.debian.org_2004_03_25
(1.212-2003-09-23-exp) on spohr.debian.org
X-Spam-Status: No, hits=-5.0 required=4.0 tests=BAYES_00,HAS_BUG_NUMBER
autolearn=no version=2.60-bugs.debian.org_2004_03_25
X-Spam-Level:
X-CrossAssassin-Score: 1
Source: apt
Source-Version: 0.5.25
We believe that the bug you reported is fixed in the latest version of
apt, which is due to be installed in the Debian FTP archive:
apt-doc_0.5.25_all.deb
to pool/main/a/apt/apt-doc_0.5.25_all.deb
apt-utils_0.5.25_i386.deb
to pool/main/a/apt/apt-utils_0.5.25_i386.deb
apt_0.5.25.dsc
to pool/main/a/apt/apt_0.5.25.dsc
apt_0.5.25.tar.gz
to pool/main/a/apt/apt_0.5.25.tar.gz
apt_0.5.25_i386.deb
to pool/main/a/apt/apt_0.5.25_i386.deb
libapt-pkg-dev_0.5.25_i386.deb
to pool/main/a/apt/libapt-pkg-dev_0.5.25_i386.deb
libapt-pkg-doc_0.5.25_all.deb
to pool/main/a/apt/libapt-pkg-doc_0.5.25_all.deb
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to 152711@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Matt Zimmerman <mdz@debian.org> (supplier of updated apt package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@debian.org)
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Format: 1.7
Date: Sat, 8 May 2004 12:52:20 -0700
Source: apt
Binary: apt-utils libapt-pkg-doc libapt-pkg-dev apt-doc apt
Architecture: source all i386
Version: 0.5.25
Distribution: unstable
Urgency: low
Maintainer: APT Development Team <deity@lists.debian.org>
Changed-By: Matt Zimmerman <mdz@debian.org>
Description:
apt - Advanced front-end for dpkg
apt-doc - Documentation for APT
apt-utils - APT utility programs
libapt-pkg-dev - Development files for APT's libapt-pkg and libapt-inst
libapt-pkg-doc - Documentation for APT development
Closes: 152711 238578 238943 239785 240074 241971 242388 243959 244176 244293 244369 244835 245923 246550 246925 247311
Changes:
apt (0.5.25) unstable; urgency=low
.
* Patch from Jason Gunthorpe to remove arbitrary length limit on Binary
field in SourcesWriter::DoPackage
* Fix typo in apt-cache(8) (Closes: #238578)
* Fix obsolete reference to bug(1) in stub apt(8) man page
(Closes: #245923)
* Fix typo in configure-index (RecruseDepends -> RecurseDepends)
(Closes: #246550)
* Support DEB_BUILD_OPTIONS=noopt in debian/rules
(Closes: #244293)
* Increase length of line buffer in ReadConfigFile to 1024 chars;
detect if a line is longer than that and error out
(Closes: #244835)
* Suppress a signed/unsigned warning in apt-cache.cc:DisplayRecord
* Build apt-ftparchive with libdb4.2 rather than libdb2
- Patch from Clint Adams to do most of the work
- Build-Depends: s/libdb2-dev/libdb4.2-dev/
- Add AC_PREREQ(2.50) to configure.in
- Use db_strerror(err) rather than GlobalError::Errno (which uses strerror)
- Add note to NEWS.Debian about upgrading old databases
* Attempt to fix problems with chunked encoding by stripping only a single CR
(Closes: #152711)
* Modify debian/rules cvs-build to use cvs export, to avoid picking up
junk files from the working directory
* Add lang=fr attribute to refentry section of
apt-extracttemplates.fr.1.sgml and apt-sortpkgs.fr.1.sgml so they are
correctly built
* Remove extraneous '\' characters from <command> tags in
apt_preferences.fr.5.sgml
* Translation updates:
- Updated Swedish translation from Peter Karlsson <peter@softwolves.pp.se>
(Closes: #238943)
- New Slovenian translation from Jure Ä?uhalev <gandalf@owca.info>
(closes: #239785)
- New Portuguese translation from Miguel Figueiredo <elmig@debianpt.org>
(closes: #240074)
- Updated Spanish translation from Ruben Porras <nahoo82@telefonica.net>
- Updated Spanish translation of man pages from Ruben Porras
<nahoo82@telefonica.net>
- Updated Simplified Chinese translation from "Carlos Z.F. Liu" <carlos_liu@yahoo.com>
(Closes: #241971)
- Updated Russian translation from Dmitry Astapov <adept@despammed.com>
(Closes: #243959)
- Updated Polish translation from Marcin Owsiany <porridge@debian.org>
(Closes: #242388)
- Updated Czech translation from Miroslav Kure <kurem@upcase.inf.upol.cz>
(Closes: #244369)
- Updated Japanese translation from Kenshi Muto <kmuto@debian.org>
(Closes: #244176)
- Run make -C po update-po to update .po files
- Updated French translation from Christian Perrier <bubulle@debian.org>
(Closes: #246925)
- Updated Danish translation from Claus Hindsgaul <claus_h@image.dk>
(Closes: #247311)
Files:
b498d368cd955eb176803d0ca4aef9de 756 admin important apt_0.5.25.dsc
01f9ade1f00f398c1c03ebcc85655e5e 1187769 admin important apt_0.5.25.tar.gz
08ea3d780fd77cc39dd754c2cf5ac04a 67956 doc optional apt-doc_0.5.25_all.deb
2f2ef58272571d74f8593a0be6fac4d9 96778 doc optional libapt-pkg-doc_0.5.25_all.deb
e0352eb89097e7c52dac5d36a0e42f82 969520 base important apt_0.5.25_i386.deb
1f7eb2a0c8219561e9ee21182fd663b3 67308 libdevel optional libapt-pkg-dev_0.5.25_i386.deb
9342f5c13291623f11c733a3f7ee89c2 181608 admin optional apt-utils_0.5.25_i386.deb
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
iD8DBQFAnUSnArxCt0PiXR4RAn8jAKDCZsg5QSn+DWVY7yPD8v0PQd9kegCgn1aW
LIq0HD5KvrI+KGLADWiWZ6E=
=I/Qc
-----END PGP SIGNATURE-----
Reply to: