Can't keep archive up to date (bizarre sources.list problem?)
I keep running into a problem in which apt (via aptitude) will not fetch
the new package list for testing or unstable. It doesn't report any
errors while doing the associated update. I've tried various fiddles,
including especially deleting files from /var/lib/apt/lists
and /var/cache/apt. The main thing the deletions show is that some of
the essential files (e.g., Packages) aren't ending up in lists at all.
Twice I have found that if I simply strip my sources.list down so that
it only contains the one thing I want, everything works. I suspected a
non-printing character, but a) I tried retyping the line, b) did not
notice anything in hexedit, and c) the successful file was made by
deleting other material from the unsuccessful one.
Does anyone have any ideas what's going on, or how I can fix it
permanently?
The rest of this message has additional details.
So
<sources.list>
deb http://10.4.0.223:3142/debian unstable main
</sources.list>
works, while
<sources.list>
#
# deb cdrom:[Debian GNU/Linux 5.0.0 _Lenny_ - Official amd64 NETINST Binary-1 20090214-15:57]/ lenny main
#deb cdrom:[Debian GNU/Linux 5.0.0 _Lenny_ - Official amd64 NETINST Binary-1 20090214-15:57]/ lenny main
deb http://10.4.0.223:3142/debian lenny main contrib non-free
deb-src http://10.4.0.223:3142/debian lenny main contrib non-free
deb http://10.4.0.223:3142/security lenny/updates main contrib non-free
deb-src http://10.4.0.223:3142/security lenny/updates main contrib non-free
deb http://10.4.0.223:3142/volatile lenny/volatile main contrib non-free
deb-src http://10.4.0.223:3142/volatile lenny/volatile main contrib non-free
# mostly for kernel
deb http://10.4.0.223:3142/debian testing main contrib non-free
deb-src http://10.4.0.223:3142/debian testing main contrib non-free
deb http://10.4.0.223:3142/debian unstable main contrib non-free
deb-src http://10.4.0.223:3142/debian unstable main contrib non-free
# for the latest kernel
#deb http://10.4.0.223:3142/kernel-archive.buildserver.net/debian-kernel trunk main
#deb-src http://10.4.0.223:3142/kernel-archive.buildserver.net/debian-kernel trunk main
# which needs kbuild from unstable
#deb http://10.4.0.223:3142/debian unstable main contrib non-free
#deb-src http://10.4.0.223:3142/debian unstable main contrib non-free
</sources.list>
fails. 10.4.0.223 is running apt-cacher.
I tried running with this snippet
<99local>
Debug {
Acquire {
ftp "yes";
http "yes";
gpgv "yes";
};
};
</99local>
in /etc/apt/conf.d. The output (under emacs) was a bit garbled, but it
seemed to show the proper Packages file being fetched and the associated
release file verified even in the case that did not update properly.
The first time shows, in part
<QUOTE>
GET /debian/dists/unstable/main/binary-amd64/Packages.bz2 HTTP/1.1
Host: 10.4.0.223:3142
Connection: keep-alive
Range: bytes=6223195-
If-Range: Tue, 22 Sep 2009 20:35:21 GMT
User-Agent: Debian APT-HTTP/1.3 (0.7.20.2)
99% [Waiting for headers]HTTP/1.1 200 OK
Connection: Keep-Alive
Accept-Ranges: bytes
Content-Length: 6229998
Content-Type: application/x-bzip2
Last-Modified: Sat, 26 Sep 2009 08:17:06 GMT
Get:41 http://10.4.0.223 unstable/main Packages [6230kB]
99% [41 Packages bzip2 0] 3803kB/s 0s
GET /debian/dists/unstable/contrib/binary-amd64/Packages.di\
ff/2009-09-23-1558.42.gz HTTP/1.1
Host: 10.4.0.223:3142
Connection: keep-alive
User-Agent: Debian APT-HTTP/1.3 (0.7.20.2)
99% [41 Packages bzip2 9895936] [Waiting for headers] 3803kB/s 0s
</QUOTE>
Notice the initial Range is followed by a -, and that there is a latter
Content-Length that is somewhat longer (equal to the size of the
Packages file in lists/).
The successful log shows
<QUOTE>
GET /debian/dists/unstable/Release HTTP/1.1
Host: 10.4.0.223:3142
Connection: keep-alive
If-Modified-Since: Sat, 26 Sep 2009 03:37:46 GMT
User-Agent: Debian APT-HTTP/1.3 (0.7.20.2)
GET /debian/dists/unstable/Release HTTP/1.1
Host: 10.4.0.223:3142
Connection: keep-alive
If-Modified-Since: Sat, 26 Sep 2009 03:37:46 GMT
User-Agent: Debian APT-HTTP/1.3 (0.7.20.2)
HTTP/1.1 200 OK
Connection: Keep-Alive
Accept-Ranges: bytes
Content-Length: 103733
Content-Type: text/plain
Last-Modified: Sat, 26 Sep 2009 03:37:46 GMT
Get:2 http://10.4.0.223 unstable Release [104kB]
99% [Working]inside VerifyGetSigners
gpgv path: /usr/bin/gpgv
Keyring path: /etc/apt/trusted.gpg
99% [2 Release gpgv 103733]Preparing to exec: /usr/bin/gpgv /usr/bin/gpgv --status-fd 3 --ignore-time-conflict --keyring /etc/apt/trusted.g\
pg /var/lib/apt/lists/partial/10.4.0.223:3142_debian_dists_unstable_Release.gpg /var/lib/apt/lists/10.4.0.223:3142_debian_dists_unstable_Re\
lease
Read: [GNUPG:] SIG_ID vNAJ+KMK6Iq0Y3QCws3X8GlO99o 2009-09-26 1253936266
Read: [GNUPG:] GOODSIG 9AA38DCD55BE302B Debian Archive Automatic Signing Key (5.0/lenny) <ftpmaster@debian.org>
Got GOODSIG, key ID:GOODSIG 9AA38DCD55BE302B
Read: [GNUPG:] VALIDSIG 150C8614919D8446E01E83AF9AA38DCD55BE302B 2009-09-26 1253936266 0 4 0 1 2 00 150C8614919D8446E01E83AF9AA38DCD55BE302\
B
Read: [GNUPG:] VALIDSIG 150C8614919D8446E01E83AF9AA38DCD55BE302B 2009-09-26 1253936266 0 4 0 1 2 00 150C8614919D8446E01E83AF9AA38DCD55BE302\
B
gpgv exited
gpgv succeeded
99% [Working]GET /debian/dists/unstable/main/binary-amd64/Packages.diff/Index HTTP/1.1
Host: 10.4.0.223:3142
Connection: keep-alive
If-Modified-Since: Sat, 26 Sep 2009 09:11:32 GMT
User-Agent: Debian APT-HTTP/1.3 (0.7.20.2)
99% [Waiting for headers]HTTP/1.1 200 OK
Connection: Keep-Alive
Accept-Ranges: bytes
Content-Length: 2038
Content-Type: text/plain
Last-Modified: Sat, 26 Sep 2009 03:35:52 GMT
Get:3 http://10.4.0.223 unstable/main Packages/DiffIndex [2038B]
98% [Working]GET /debian/dists/unstable/main/binary-amd64/Packages.bz2 HTTP/1.1
Host: 10.4.0.223:3142
Connection: keep-alive
Range: bytes=6229997-
If-Range: Sat, 26 Sep 2009 08:17:06 GMT
User-Agent: Debian APT-HTTP/1.3 (0.7.20.2)
98% [Waiting for headers]HTTP/1.1 200 OK
Connection: Keep-Alive
Accept-Ranges: bytes
Content-Length: 6229557
Content-Type: application/x-bzip2
Last-Modified: Sat, 26 Sep 2009 02:39:48 GMT
Get:4 http://10.4.0.223 unstable/main Packages [6230kB]
Fetched 6336kB in 6s (1031kB/s)
</QUOTE>
In this case the Range again is followed by a "-", but it's now longer than the Content-Length which follows.
/var/lib/apt/lists/ includes
-rw-r--r-- 1 root root 28882716 2009-09-25 19:39 10.4.0.223:3142_debian_dists_unstable_main_binary-amd64_Packages
-rw-r--r-- 1 root root 7831 2009-07-15 19:56 10.4.0.223:3142_debian_dists_unstable_main_binary-amd64_Packages.ed
-rw-r--r-- 1 root root 27303541 2009-06-03 19:15 10.4.0.223:3142_debian_dists_unstable_main_binary-amd64_Packages.FAILED
-rw-r--r-- 1 root root 2038 2009-09-25 20:35 10.4.0.223:3142_debian_dists_unstable_main_binary-amd64_Packages.IndexDiff
After my successful update (with the one-line sources.list) I tried
deleting all those files and re-updating. This time I had only a
Packages file, and not Packages.FAILED or the other ones.
The failure log also had GOODSIG.
Hmm, the log doesn't show individual files (e.g., Packages) being
validated against Release. I thought failure there would trigger a
warning in the GUI, however, and I haven't seen any.
Reply to: