Bug#812994: apt 1.2.1 fails to configure packages
On Wed, Feb 10, 2016 at 10:16:47AM +0100, Julian Andres Klode wrote:
> Control: tag -1 confirmed
>
> On Tue, Feb 09, 2016 at 11:42:59PM -0500, James McCoy wrote:
> > On Fri, Feb 05, 2016 at 12:35:11AM +0100, Julian Andres Klode wrote:
> > > On 4 February 2016 at 23:44, Guillem Jover <guillem@debian.org> wrote:
> > > > On Thu, 2016-02-04 at 08:39:30 -0500, James McCoy wrote:
> > > >> On Thu, Feb 04, 2016 at 12:56:53AM +0100, Guillem Jover wrote:
> > > >> > Just to make sure, if you have the libjpeg62-turbo_1%3a1.4.2-2_amd64.deb
> > > >> > around could you check that it really contains the libjpec62-turbo
> > > >> > package inside with say dpkg-deb, or manually with ar+tar?
> >
> > After some discussion with Julian on IRC about some of the issues I've
> > been seing lately, and his suggestion that a parse change might be
> > related, I'm thinking that's more likely.
> >
> > Just as a recap, yesterday I was hitting #813000 (corrupt package index,
> > can't find Filename:). I mentioned that it happened even after I
> > removed the Packages file and re-ran "apt update", so it's not PDiff
> > related.
> >
> > Today, after an update, I tried to install the same package I was trying
> > to install last night and ran into the "Writing more data than expected"
> > error while downloading the deb. The interesting part is that apt
> > reported it got that error while trying to download a deb that it
> > shouldn't have been downloading:
> >
> > └[jamessan@freya] 0 % sudo apt install abi-dumper
> > Reading package lists... Done
> > Building dependency tree
> > Reading state information... Done
> > The following additional packages will be installed:
> > elfutils libasm1 vtable-dumper
> > The following NEW packages will be installed:
> > abi-dumper elfutils libasm1 vtable-dumper
> > 0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded.
> > Need to get 353 kB of archives.
> > After this operation, 1,155 kB of additional disk space will be used.
> > Do you want to continue? [Y/n]
> > Get:1 http://httpredir.debian.org/debian sid/main amd64 libasm1 amd64 0.165-3 [27.6 kB]
> > Get:2 http://httpredir.debian.org/debian sid/main amd64 elfutils amd64 0.165-3 [293 kB]
> > Get:3 http://httpredir.debian.org/debian sid/main amd64 vtable-dumper amd64 1.1-1 [6,870 B]
> > Err:3 http://httpredir.debian.org/debian sid/main amd64 vtable-dumper amd64 1.1-1
> > Writing more data than expected (27304 > 25526)
> > Get:4 http://httpredir.debian.org/debian sid/main i386 abi-dumper all 0.99.12-1 [25.5 kB]
> > Fetched 346 kB in 1s (228 kB/s)
> > E: Failed to fetch http://httpredir.debian.org/debian/pool/main/r/r-cran-teachingdemos/r-cran-teachingdemos_2.9-1_all.deb Writing more data than expected (27304 > 25526)
> >
> > E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
> >
> > Apt is supposed to be downloading abi-dumper, but it then reports it
> > failed to fetch r-cran-teachingdemos.
> >
> > Seeing that reminded me of this email, so I checked
> > /var/cache/apt/archives/partial:
> >
> > └[jamessan@freya] 0 % sudo dpkg-deb -I /var/cache/apt/archives/partial/vtable-dumper_1.1-1_amd64.deb.FAILED
> > new debian package, version 2.0.
> > size 65536 bytes: control archive=1338 bytes.
> > 608 bytes, 14 lines control
> > 2223 bytes, 26 lines md5sums
> > Package: r-cran-teachingdemos
> > Version: 2.9-1
> > Architecture: all
> > Maintainer: Debian Science Team <debian-science-maintainers@lists.alioth.debian.org>
> > Installed-Size: 1741
> > Depends: r-base-core (>= 3.0.1-1)
> > Recommends: r-cran-misc3d, r-recommended, r-cran-mapproj
> > Section: gnu-r
> > Priority: optional
> > Homepage: http://cran.r-project.org/web/packages/TeachingDemos/
> > Description: GNU R Demonstrations for teaching and learning
> > This package is a set of demonstration functions that can be used in a
> > classroom to demonstrate statistical concepts, or on your own to better
> > understand the concepts or the programming.
> >
> > After another dinstall run, I still can't install abi-dumper, but now
> > apt is downloading r-cran-surveillance instead of r-cran-teachingdemos.
> >
> > I've made the two Packages files available at:
> > https://people.debian.org/~jamessan/tmp/r-cran-teachingdemos-amd64_Packages.lz4
> > https://people.debian.org/~jamessan/tmp/r-cran-surveillance-amd64_Packages.lz4
> >
> > > On IRC it was mentioned that bug #813000 mentions that the update can
> > > generate Packages files in the APT dir with messed up contents.
> >
> > From at least visual inspection, it isn't corrupted. Also, given that
> > both a PDiff generated and downloaded Packages file show this issue, it
> > seems to be something in apt's parsing.
> >
> > > I'm
> > > not entirely sure it's related, but maybe it is. That must be a very
> > > unlikely incarnation of that bug though (two packages would need their
> > > Filename and various hash sum fields replaced by that of another
> > > package).
> >
> > A quick check of the file doesn't show anything as obvious as that.
> >
> > > We cannot reproduce that one yet, but I'm working on it (running apt
> > > update manually now, and backing up lists before update).
>
> Bisecting gives me:
>
> b0f4b486e6850c5f98520ccf19da71d0ed748ae4 is the first bad commit
> commit b0f4b486e6850c5f98520ccf19da71d0ed748ae4
> Author: Michael Vogt <mvo@debian.org>
> Date: Sun Sep 21 10:18:03 2014 +0200
>
> generalize Acquire::GzipIndex
Turns out that was not the cause, just the commit where we could start
having compressed index files not using gzip.
I could only reproduce this with lz4 compressed indexes, both with
external decompressor (lz4 binary) and internal one. gzip indexes
and uncompressed ones work fine.
--
Julian Andres Klode - Debian Developer, Ubuntu Member
See http://wiki.debian.org/JulianAndresKlode and http://jak-linux.org/.
When replying, only quote what is necessary, and write each reply
directly below the part(s) it pertains to (`inline'). Thank you.
Reply to: