Bug#779592: [apt] /var/lib/apt/lists/partial/ gets filled by Diff_index file

To: Debian Bug Tracking System <779592@bugs.debian.org>
Subject: Bug#779592: [apt] /var/lib/apt/lists/partial/ gets filled by Diff_index file
From: Jayen Ashar <j__n@yahoo.com>
Date: Fri, 13 Mar 2015 09:08:55 +1100
Message-id: <[🔎] 20150312220855.8916.63942.reportbug@suburbchooser.com>
Reply-to: Jayen Ashar <j__n@yahoo.com>, 779592@bugs.debian.org
Package: apt
Version: 1.0.9.7
Followup-For: Bug #779592

Dear Maintainer,

   * What led up to the situation?

apt-get update -o quiet=2 # run from cron-apt

   * What exactly did you do (or not do) that was effective (or
     ineffective)?

deleted /var/lib/apt/lists/partial/snapshot.debian.org_archive_debian_20130710T214032Z_dists_jessie_non-free_binary-i386_Packages.diff_Index was effective

i took a look at it before i deleted it.  the file started with md5sums as 
expected, but instead of EOF at the end, there were a series of [presumably 
infinite] null bytes (^@ in `less`)

i also find it odd that the filename is different to the non-partial version: 
/var/lib/apt/lists/snapshot.debian.org_archive_debian_20130710T214032Z_dists_jessie_non-free_binary-i386_Packages.IndexDiff

some more things as i poke around lists/ and lists/partial/ (not sure if they 
are related):

/var/lib/apt/lists/partial/snapshot.debian.org_archive_debian_20130710T214032Z_dists_jessie_non-free_binary-i386_Packages.bz2 
is a text file (not a bz2)

there's a lot of .FAILED files in lists/partial/

there's a lot of 
ftp.iinet.net.au_pub_debian_debian_dists_experimental_main_i18n_Translation-en.ed.$date-$time.gz 
files in lists/ (going back two months)

   * What was the outcome of this action?

deleting the file worked as expected as apt was not running.

   * What outcome did you expect instead?

i expected apt not to write infinite null bytes.

-- Package-specific info:

-- apt-config dump --

APT "";
APT::Architecture "i386";
APT::Build-Essential "";
APT::Build-Essential:: "build-essential";
APT::Install-Recommends "1";
APT::Install-Suggests "0";
APT::Authentication "";
APT::Authentication::TrustCDROM "true";
APT::NeverAutoRemove "";
APT::NeverAutoRemove:: "^firmware-linux.*";
APT::NeverAutoRemove:: "^linux-firmware$";
APT::NeverAutoRemove:: "^linux-image-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^linux-image-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^linux-headers-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^linux-headers-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^linux-image-extra-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^linux-image-extra-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^linux-signed-image-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^linux-signed-image-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^kfreebsd-image-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^kfreebsd-image-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^kfreebsd-headers-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^kfreebsd-headers-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^gnumach-image-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^gnumach-image-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^.*-modules-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^.*-modules-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^.*-kernel-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^.*-kernel-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^linux-backports-modules-.*-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^linux-backports-modules-.*-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^linux-tools-3\.16-3-686-pae$";
APT::NeverAutoRemove:: "^linux-tools-3\.16\.0-4-686-pae$";
APT::NeverAutoRemove:: "^postgresql-";
APT::VersionedKernelPackages "";
APT::VersionedKernelPackages:: "linux-image";
APT::VersionedKernelPackages:: "linux-headers";
APT::VersionedKernelPackages:: "linux-image-extra";
APT::VersionedKernelPackages:: "linux-signed-image";
APT::VersionedKernelPackages:: "kfreebsd-image";
APT::VersionedKernelPackages:: "kfreebsd-headers";
APT::VersionedKernelPackages:: "gnumach-image";
APT::VersionedKernelPackages:: ".*-modules";
APT::VersionedKernelPackages:: ".*-kernel";
APT::VersionedKernelPackages:: "linux-backports-modules-.*";
APT::VersionedKernelPackages:: "linux-tools";
APT::Never-MarkAuto-Sections "";
APT::Never-MarkAuto-Sections:: "metapackages";
APT::Never-MarkAuto-Sections:: "restricted/metapackages";
APT::Never-MarkAuto-Sections:: "universe/metapackages";
APT::Never-MarkAuto-Sections:: "multiverse/metapackages";
APT::Never-MarkAuto-Sections:: "oldlibs";
APT::Never-MarkAuto-Sections:: "restricted/oldlibs";
APT::Never-MarkAuto-Sections:: "universe/oldlibs";
APT::Never-MarkAuto-Sections:: "multiverse/oldlibs";
APT::Periodic "";
APT::Periodic::Update-Package-Lists "1";
APT::Periodic::Download-Upgradeable-Packages "0";
APT::Periodic::AutocleanInterval "0";
APT::Update "";
APT::Update::Post-Invoke "";
APT::Update::Post-Invoke:: "touch /var/lib/apt/periodic/update-success-stamp 2>/dev/null || true";
APT::Archives "";
APT::Archives::MaxAge "30";
APT::Archives::MinAge "2";
APT::Archives::MaxSize "500";
APT::Cache-Limit "95165824";
APT::Architectures "";
APT::Architectures:: "i386";
APT::Compressor "";
APT::Compressor::. "";
APT::Compressor::.::Name ".";
APT::Compressor::.::Extension "";
APT::Compressor::.::Binary "";
APT::Compressor::.::Cost "1";
APT::Compressor::gzip "";
APT::Compressor::gzip::Name "gzip";
APT::Compressor::gzip::Extension ".gz";
APT::Compressor::gzip::Binary "gzip";
APT::Compressor::gzip::Cost "2";
APT::Compressor::gzip::CompressArg "";
APT::Compressor::gzip::CompressArg:: "-9n";
APT::Compressor::gzip::UncompressArg "";
APT::Compressor::gzip::UncompressArg:: "-d";
APT::Compressor::bzip2 "";
APT::Compressor::bzip2::Name "bzip2";
APT::Compressor::bzip2::Extension ".bz2";
APT::Compressor::bzip2::Binary "bzip2";
APT::Compressor::bzip2::Cost "3";
APT::Compressor::bzip2::CompressArg "";
APT::Compressor::bzip2::CompressArg:: "-9";
APT::Compressor::bzip2::UncompressArg "";
APT::Compressor::bzip2::UncompressArg:: "-d";
APT::Compressor::xz "";
APT::Compressor::xz::Name "xz";
APT::Compressor::xz::Extension ".xz";
APT::Compressor::xz::Binary "xz";
APT::Compressor::xz::Cost "4";
APT::Compressor::xz::CompressArg "";
APT::Compressor::xz::CompressArg:: "-6";
APT::Compressor::xz::UncompressArg "";
APT::Compressor::xz::UncompressArg:: "-d";
APT::Compressor::lzma "";
APT::Compressor::lzma::Name "lzma";
APT::Compressor::lzma::Extension ".lzma";
APT::Compressor::lzma::Binary "xz";
APT::Compressor::lzma::Cost "5";
APT::Compressor::lzma::CompressArg "";
APT::Compressor::lzma::CompressArg:: "--format=lzma";
APT::Compressor::lzma::CompressArg:: "-9";
APT::Compressor::lzma::UncompressArg "";
APT::Compressor::lzma::UncompressArg:: "--format=lzma";
APT::Compressor::lzma::UncompressArg:: "-d";
Dir "/";
Dir::State "var/lib/apt/";
Dir::State::lists "lists/";
Dir::State::cdroms "cdroms.list";
Dir::State::mirrors "mirrors/";
Dir::State::extended_states "extended_states";
Dir::State::status "/var/lib/dpkg/status";
Dir::Cache "var/cache/apt/";
Dir::Cache::archives "/tmp";
Dir::Cache::srcpkgcache "srcpkgcache.bin";
Dir::Cache::pkgcache "pkgcache.bin";
Dir::Etc "etc/apt/";
Dir::Etc::sourcelist "sources.list";
Dir::Etc::sourceparts "sources.list.d";
Dir::Etc::vendorlist "vendors.list";
Dir::Etc::vendorparts "vendors.list.d";
Dir::Etc::main "apt.conf";
Dir::Etc::netrc "auth.conf";
Dir::Etc::parts "apt.conf.d";
Dir::Etc::preferences "preferences";
Dir::Etc::preferencesparts "preferences.d";
Dir::Etc::trusted "trusted.gpg";
Dir::Etc::trustedparts "trusted.gpg.d";
Dir::Bin "";
Dir::Bin::methods "/usr/lib/apt/methods";
Dir::Bin::solvers "";
Dir::Bin::solvers:: "/usr/lib/apt/solvers";
Dir::Bin::dpkg "/usr/bin/dpkg";
Dir::Bin::bzip2 "/bin/bzip2";
Dir::Bin::xz "/usr/bin/xz";
Dir::Bin::lzma "/usr/bin/xz";
Dir::Media "";
Dir::Media::MountPath "/media/apt";
Dir::Log "var/log/apt";
Dir::Log::Terminal "term.log";
Dir::Log::History "history.log";
Dir::Ignore-Files-Silently "";
Dir::Ignore-Files-Silently:: "~$";
Dir::Ignore-Files-Silently:: "\.disabled$";
Dir::Ignore-Files-Silently:: "\.bak$";
Dir::Ignore-Files-Silently:: "\.dpkg-[a-z]+$";
Dir::Ignore-Files-Silently:: "\.save$";
Dir::Ignore-Files-Silently:: "\.orig$";
Dir::Ignore-Files-Silently:: "\.distUpgrade$";
Acquire "";
Acquire::cdrom "";
Acquire::cdrom::mount "/media/cdrom/";
Acquire::http "";
Acquire::http::No-Cache "true";
Acquire::Check-Valid-Until "false";
Acquire::Languages "";
Acquire::Languages:: "en";
Acquire::Languages:: "none";
DPkg "";
DPkg::Pre-Install-Pkgs "";
DPkg::Pre-Install-Pkgs:: "/usr/sbin/dpkg-preconfigure --apt || true";
DPkg::Post-Invoke "";
DPkg::Post-Invoke:: "if [ -d /var/lib/update-notifier ]; then touch /var/lib/update-notifier/dpkg-run-stamp; fi; if [ -e /var/lib/update-notifier/updates-available ]; then echo > /var/lib/update-notifier/updates-available; fi ";
CommandLine "";
CommandLine::AsString "apt-config dump";

-- /etc/apt/preferences --

Package: *
Pin: release a=testing
Pin-Priority: 900

Package: *
Pin: release a=unstable
Pin-Priority: 800

Package: *
Pin: release a=stable
Pin-Priority: 700

Package: *
Pin: release a=oldstable
Pin-Priority: 600

Package: iceweasel
Pin: release a=experimental
Pin-Priority: 900

Package: *
Pin: release a=experimental
Pin-Priority: 600

-- /etc/apt/sources.list --

deb http://ftp.iinet.net.au/pub/debian/debian/ testing main non-free contrib
#deb-src http://ftp.iinet.net.au/pub/debian/debian/ testing main non-free contrib
deb http://mirror.aarnet.edu.au/pub/debian-security/ testing/updates main non-free contrib
#deb-src http://mirror.aarnet.edu.au/pub/debian-security/ testing/updates main non-free contrib

deb http://ftp.iinet.net.au/pub/debian/debian/ stable main non-free contrib
deb-src http://ftp.iinet.net.au/pub/debian/debian/ stable main non-free contrib
deb http://mirror.aarnet.edu.au/pub/debian-security/ stable/updates main non-free contrib
#deb-src http://mirror.aarnet.edu.au/pub/debian-security/ stable/updates main non-free contrib

deb http://ftp.iinet.net.au/pub/debian/debian/ oldstable main non-free contrib
#deb-src http://ftp.iinet.net.au/pub/debian/debian/ oldstable main non-free contrib
deb http://mirror.aarnet.edu.au/pub/debian-security/ oldstable/updates main non-free contrib
#deb-src http://mirror.aarnet.edu.au/pub/debian-security/ oldstable/updates main non-free contrib
#deb http://mirror.aarnet.edu.au/pub/debian-volatile/ oldstable/volatile main non-free contrib
#deb-src http://mirror.aarnet.edu.au/pub/debian-volatile/ oldstable/volatile main non-free contrib

deb http://ftp.iinet.net.au/pub/debian/debian/ unstable main non-free contrib
#deb-src http://ftp.iinet.net.au/pub/debian/debian/ unstable main non-free contrib

deb http://ftp.iinet.net.au/pub/debian/debian/ experimental main non-free contrib
deb-src http://ftp.iinet.net.au/pub/debian/debian/ experimental main non-free contrib

#deb-src http://mentors.debian.net/debian/ unstable main non-free contrib

deb http://download.skype.com/linux/repos/debian/ stable non-free

-- System Information:
Debian Release: 8.0
  APT prefers testing
  APT policy: (900, 'testing'), (800, 'unstable'), (700, 'stable'), (600, 'experimental'), (600, 'oldstable')
Architecture: i386 (i686)

Kernel: Linux 3.16.0-4-686-pae (SMP w/8 CPU cores)
Locale: LANG=en_AU.UTF-8, LC_CTYPE=en_AU.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Init: systemd (via /run/systemd/system)

Versions of packages apt depends on:
ii  debian-archive-keyring  2014.3
ii  gnupg                   1.4.18-7
ii  libapt-pkg4.12          1.0.9.7
ii  libc6                   2.19-15
ii  libgcc1                 1:4.9.2-10
ii  libstdc++6              4.9.2-10

apt recommends no packages.

Versions of packages apt suggests:
pn  apt-doc     <none>
ii  aptitude    0.6.11-1+b1
ii  dpkg-dev    1.17.24
ii  python-apt  0.9.3.11

-- Configuration Files:
/etc/logrotate.d/apt changed:
/var/log/apt/term.log {
  rotate 912
  monthly
  compress
  missingok
  notifempty
}
/var/log/apt/history.log {
  rotate 912
  monthly
  compress
  missingok
  notifempty
}


-- no debconf information
Reply to:
Prev by Date: Processed: Re: Bug#751728: apt-get warns about "stable-updates"
Next by Date: Processed (with 3 errors): Re: Bug#774815: php-monolog: Versionned Provides field
Previous by thread: Processed: Re: Bug#779592: [apt] /var/lib/apt/lists/partial/ gets filled by Diff_index file
Next by thread: Bug#776910: apt: upgrade from wheezy to jessie breaks in the middle
Index(es):
- Date
- Thread