Re: pbuilder error
Hi David!
>(thankfully, apt/experimental has some improvements in terms of error
>reporting which help here. Hash sum mismatch messages used to be
>borderline useless – now they still are, but are very talkative ;)
>That said, I am a bit surprised its installed in your chroot…)
$ aptitude --version
aptitude 0.8.1
Compiler: g++ 5.3.1 20160429
Compiled against:
apt version 5.0.0
NCurses version 6.0
libsigc++ version: 2.8.0
Gtk+ support disabled.
Qt support disabled.
Current library versions:
NCurses version: ncurses 6.0.20160319
cwidget version: 0.5.17
Apt version: 5.0.0
$ apt --version
apt 1.3~exp3 (amd64)
(jut for your information)
> DISCLAIMER: I have this in apt.conf.d> cat /etc/apt/apt.conf.d/99fixbadproxy
> Acquire::http::Pipeline-Depth 0;
> Acquire::http::No-Cache true;
> Acquire::BrokenProxy true;
(While it might be true, the last option doesn't exist, so no effect)
>APT is reasonably good at detecting proxies/servers which mess up
>pipelining and disables pipelining automatically then (with a warning),
>so I would suggest dropping all these options and see what a 'stock' apt
>does. No-Cache /can/ work or its completely ignored as its just a hint
>for proxies – it doesn't solve any of your problems through as all
>requested files have unique names by now and there is no "old" cache
>problem (there are also more of these options with more or less the same
>intended effected as in the web everything must be done in a bunch of
>incompatible vendor-specific ways… but I digress)
I have to say a disclaimer:
without that file even my machine wasn't able to work :)
and it fails in the same way
I: Copy /etc/apt/apt.conf.d/00aptitude /etc/apt/apt.conf.d/00trustcdrom /etc/apt/apt.conf.d/01-vendor-ubuntu /etc/apt/apt.conf.d/01autoremove /etc/apt/apt.conf.d/01autoremove-kernels /etc/apt/apt.conf.d/10periodic /etc/apt/apt.conf.d/15update-stamp /etc/apt/apt.conf.d/20archive /etc/apt/apt.conf.d/20auto-upgrades /etc/apt/apt.conf.d/20dbus /etc/apt/apt.conf.d/50appstream /etc/apt/apt.conf.d/50unattended-upgrades /etc/apt/apt.conf.d/70debconf /etc/apt/apt.conf.d/99synaptic /etc/apt/apt.conf.d/99update-notifier to chroot
I: Installing apt-lines and pinning for experimental
I: mounting /proc filesystem
I: mounting /run/shm filesystem
I: mounting /dev/pts filesystem
I: policy-rc.d already exists
I: Refreshing the base.tgz
I: upgrading packages
Get:1 http://giano.com.dist.unige.it/debian sid InRelease [209 kB]
Get:2 http://giano.com.dist.unige.it/debian experimental InRelease [107 kB]
Get:3 http://giano.com.dist.unige.it/debian sid/main amd64 Packages.diff/Index [27.9 kB]
Get:4 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages.diff/Index [27.8 kB]
Get:5 http://giano.com.dist.unige.it/debian sid/non-free amd64 Packages.diff/Index [27.8 kB]
Get:6 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-04-2114.57.pdiff [14.8 kB]
Get:7 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-0318.07.pdiff [17.1 kB]
Get:8 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-0913.08.pdiff [7036 B]
Get:9 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-1514.06.pdiff [20.4 kB]
Get:10 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-2111.29.pdiff [17.5 kB]
Get:11 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-0311.39.pdiff [11.8 kB]
Get:12 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-0904.26.pdiff [68.7 kB]
Ign:12 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-0904.26.pdiff
Get:13 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-1505.17.pdiff [9176 B]
Get:14 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-2107.39.pdiff [7160 B]
Get:15 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-07-0309.38.pdiff [11.5 kB]
Get:16 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-07-0911.25.pdiff [44.1 kB]
Ign:16 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-07-0911.25.pdiff
Get:17 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages.diff/Index [27.8 kB]
Get:18 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages 2016-07-05-1514.06.pdiff [31 B]
Get:19 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages 2016-07-05-2111.29.pdiff [431 B]
Get:19 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages 2016-07-05-2111.29.pdiff [431 B]
Get:20 http://giano.com.dist.unige.it/debian sid/non-free amd64 Packages 2016-07-05-2111.29.pdiff [434 B]
Get:20 http://giano.com.dist.unige.it/debian sid/non-free amd64 Packages 2016-07-05-2111.29.pdiff [434 B]
Get:21 http://giano.com.dist.unige.it/debian sid/main amd64 Packages [7150 kB]
Err:21 http://giano.com.dist.unige.it/debian sid/main amd64 Packages
Hash Sum mismatch
Hashes of expected file:
- Checksum-FileSize:7150036 [weak]
- SHA256:4cb56a1539103ba2b95d944083297d9b75dc1221397ca5e805546af5f508a860
- MD5Sum:d796a3aa522903626c0264ad2011f17f [weak]
Hashes of received file:
- SHA256:722a3db60a5badd39166c6aa0185aec76c61d2d1948628fb601c7224288f6741
- MD5Sum:8ea70dc8048e38c715faeb601f9f4f84 [weak]
- Checksum-FileSize:7139802 [weak]
Last modification reported: Thu, 07 Jul 2016 08:32:20 GMT
Release file created at: Thu, 07 Jul 2016 09:26:23 GMT
Get:22 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-04-2114.57.pdiff [1942 B]
Get:23 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-0318.07.pdiff [2246 B]
Get:24 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-0913.08.pdiff [2471 B]
Get:25 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-1514.06.pdiff [945 B]
Get:26 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-2111.29.pdiff [15.6 kB]
Get:27 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-0311.39.pdiff [12.6 kB]
Get:28 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-0904.26.pdiff [1318 B]
Get:29 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-1505.17.pdiff [21.9 kB]
Get:30 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-2107.39.pdiff [215 B]
Get:31 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-07-0309.38.pdiff [1228 B]
Get:32 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-07-0911.25.pdiff [467 B]
Get:32 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-07-0911.25.pdiff [467 B]
Fetched 7807 kB in 3s (2396 kB/s)
Reading package lists...
E: Failed to fetch http://giano.com.dist.unige.it/debian/dists/sid/main/binary-amd64/by-hash/SHA256/4cb56a1539103ba2b95d944083297d9b75dc1221397ca5e805546af5f508a860 Hash Sum mismatch
Hashes of expected file:
- Checksum-FileSize:7150036 [weak]
- SHA256:4cb56a1539103ba2b95d944083297d9b75dc1221397ca5e805546af5f508a860
- MD5Sum:d796a3aa522903626c0264ad2011f17f [weak]
Hashes of received file:
- SHA256:722a3db60a5badd39166c6aa0185aec76c61d2d1948628fb601c7224288f6741
- MD5Sum:8ea70dc8048e38c715faeb601f9f4f84 [weak]
- Checksum-FileSize:7139802 [weak]
Last modification reported: Thu, 07 Jul 2016 08:32:20 GMT
Release file created at: Thu, 07 Jul 2016 09:26:23 GMT
>Your problem starts with this innocent looking line already, which is
>present in both update calls – even in the one ending up working. What
>apt is telling you here is that it wanted to do pdiff patching, but
>while downloading this patch something bad happened (what exactly is
>hard to say without debug options as printing the error message would
>counter that the error is ignored, but my guess is hashsum mismatch), so
>apt falls back to acquiring the entire file instead of trying to patch
>up an old version. In the first update that worked, in your second it
>doesn't:
>Interestingly if you truncate the expected file to the size apt got from
>the server and calculate hashes for it, you get the ones apt got, so the
>proxy/server is sending the correct file, but either it doesn't sent
>everything or apt isn't receiving everything. Or something of both…
>
>Please run apt with these options set:
>Debug::Acquire::http "true";
>Debug::pkgAcquire::Worker "true";
>Acquire::Progress::Ignore::ShowErrorText "true";
well, I did comment the two lines you told me above
Acquire::http::Pipeline-Depth 0;
#Acquire::http::No-Cache true;
#Acquire::BrokenProxy true;
and now the experimental chroot has been updated with no issues.
I still have an yakkety chroot that needs update, and with the following content
Acquire::http::Pipeline-Depth 0;
#Acquire::http::No-Cache true;
#Acquire::BrokenProxy true;
Debug::Acquire::http "true";
Debug::pkgAcquire::Worker "true";
Acquire::Progress::Ignore::ShowErrorText "true";
this is the output
I: Copy /etc/apt/apt.conf.d/00aptitude /etc/apt/apt.conf.d/00trustcdrom /etc/apt/apt.conf.d/01-vendor-ubuntu /etc/apt/apt.conf.d/01autoremove /etc/apt/apt.conf.d/01autoremove-kernels /etc/apt/apt.conf.d/10periodic /etc/apt/apt.conf.d/15update-stamp /etc/apt/apt.conf.d/20archive /etc/apt/apt.conf.d/20auto-upgrades /etc/apt/apt.conf.d/20dbus /etc/apt/apt.conf.d/50appstream /etc/apt/apt.conf.d/50unattended-upgrades /etc/apt/apt.conf.d/70debconf /etc/apt/apt.conf.d/99fixbadproxy /etc/apt/apt.conf.d/99synaptic /etc/apt/apt.conf.d/99update-notifier to chroot
I: mounting /proc filesystem
I: mounting /run/shm filesystem
I: mounting /dev/pts filesystem
I: policy-rc.d already exists
I: Refreshing the base.tgz
I: upgrading packages
Get:1 http://archive.ubuntu.com/ubuntu yakkety-proposed InRelease [95.7 kB]
Get:2 http://archive.ubuntu.com/ubuntu yakkety InRelease [247 kB]
Get:3 http://archive.ubuntu.com/ubuntu yakkety-proposed/main amd64 Packages [54.5 kB]
Get:4 http://archive.ubuntu.com/ubuntu yakkety-proposed/universe amd64 Packages [201 kB]
Err:4 http://archive.ubuntu.com/ubuntu yakkety-proposed/universe amd64 Packages
Hash Sum mismatch
Hashes of expected file:
- Checksum-FileSize:201188
- SHA256:b75b6b2f6bab4ac4cdc52baf89addf8ad67850fbbd4944f42920987b737fe5f8
- SHA1:738d1744cc4da9e24515efc618af30838149002c
- MD5Sum:2c3de3c80b5aa2b66a1d5fa9cce41377
Hashes of received file:
- SHA256:6298ed1c0bc28f8d24d36304f680161c1892cddaf932a5ab2002debee749d60d
- SHA1:91da46bd8393286b5af602621e54a96c8abc9490
- MD5Sum:66d9f854a7ab3a7fc692658e8f4193d8
- Checksum-FileSize:178104
Last modification reported: Thu, 07 Jul 2016 12:57:25 GMT
Release file created at: Thu, 07 Jul 2016 12:57:20 GMT
Get:5 http://archive.ubuntu.com/ubuntu yakkety/main amd64 Packages [1205 kB]
Get:6 http://archive.ubuntu.com/ubuntu yakkety/universe amd64 Packages [7816 kB]
Fetched 9596 kB in 3s (2497 kB/s)
Reading package lists...
E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/yakkety-proposed/universe/binary-amd64/by-hash/SHA256/b75b6b2f6bab4ac4cdc52baf89addf8ad67850fbbd4944f42920987b737fe5f8 Hash Sum mismatch
Hashes of expected file:
- Checksum-FileSize:201188
- SHA256:b75b6b2f6bab4ac4cdc52baf89addf8ad67850fbbd4944f42920987b737fe5f8
- SHA1:738d1744cc4da9e24515efc618af30838149002c
- MD5Sum:2c3de3c80b5aa2b66a1d5fa9cce41377
Hashes of received file:
- SHA256:6298ed1c0bc28f8d24d36304f680161c1892cddaf932a5ab2002debee749d60d
- SHA1:91da46bd8393286b5af602621e54a96c8abc9490
- MD5Sum:66d9f854a7ab3a7fc692658e8f4193d8
- Checksum-FileSize:178104
Last modification reported: Thu, 07 Jul 2016 12:57:25 GMT
Release file created at: Thu, 07 Jul 2016 12:57:20 GMT
E: Some index files failed to download. They have been ignored, or old ones used instead.
>That causes apt (or to be specific: apts 'http' method) to display the HTTP
>request it makes as well as the responses it gets while the second shows the
>interprocess communication between apt and its methods (beware, lots of output).
>And third causes apt to tell us the error it ignored, just for completeness.
>
>[aka: No need for wireshark or other "hard" debug stuff just yet, There
>tends to be an option for everything in apt… so much that some are even
>made up and people believe they exist: BrokenProxy from above ;) ]
this is "my" fault, when I wasn't even able to apt-get upgrade, I googled around, found
that stackoverflow [1] solution about the proxy issue, copy-pasted it, and everything was good.
This is why I didn't investigate it further, since the issue was fixed
BTW googling for Acquire::BrokenProxy=true shows *lots* of results
[1] http://stackoverflow.com/questions/15505775/debian-apt-packages-hash-sum-mismatch
thanks for your help!
Gianfranco
Reply to: