[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#401017: marked as done (Apt hangs for ever, complains about bzip2)

Your message dated Thu, 07 Dec 2006 16:17:02 +0000
with message-id <E1GsLvi-0006fP-Cx@ries.debian.org>
and subject line Bug#401017: fixed in apt 0.6.46.4
has caused the attached Bug report to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what I am
talking about this indicates a serious mail system misconfiguration
somewhere.  Please contact me immediately.)

Debian bug tracking system administrator
(administrator, Debian Bugs database)
--- Begin Message --- 
Package: apt
Version: 0.6.46.2
Severity: serious

I'm filing this new bug following some discussion (attached) in
debian-devel. I've also seen this behaviour a few time and it's very
annoying. This should be fixed for etch...

Cheers,
-- 
Raphaël Hertzog

Premier livre français sur Debian GNU/Linux :
http://www.ouaza.com/livre/admin-debian/
--- Begin Message --- 
Hello,

Is this a bug in apt?

pbuilder update --override-config --configfile /tmp/pbuilder-local.SvMNy19452
W: /home/brian/.pbuilderrc does not exist
Upgrading for distribution etch
Building the build Environment
 -> extracting base tarball [/var/cache/pbuilder/base-etch.tgz]
 -> creating local configuration
 -> copying local configuration
 -> mounting /proc filesystem
 -> mounting /dev/pts filesystem
 -> policy-rc.d already exists
  -> Installing apt-lines
Refreshing the base.tgz 
 -> upgrading packages
Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
Get:2 http://ftp.au.debian.org etch Release [74.4kB]
Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
99% [5 Packages gzip 0]                                                                                                                
 (hangs for ever)

I have tried waiting for it to timeout, but it doesn't.

I tried running it in strace, but then it works. Perfectly.

Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Installed/Config-files/Unpacked/Failed-config/Half-installed
|/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
||/ Name                         Version                      Description
+++-============================-============================-========================================================================
ii  apt                          0.6.46.2                     Advanced front-end for dpkg

The chroot in question doesn't yet have the latest Etch key, but I
don't think that is significant.

Doing a search for bugs, I see #358817, but this doesn't involve NFS
so it looks different.
-- 
Brian May <bam@snoopy.debian.net>


-- 
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

--- End Message ---
--- Begin Message --- 
Hi,

Brian May wrote:
> Hello,
> 
> Is this a bug in apt?
> 
> pbuilder update --override-config --configfile /tmp/pbuilder-local.SvMNy19452
[...]
> Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> 99% [5 Packages gzip 0]                                                                                                                
>  (hangs for ever)
[...]

I experienced the same some time ago and worked it around
by temporarily switching to a different mirror. It then succeeded,
and afterwards I could again switch to my usual mirror.

But, yesterday I had the same issue in my i386 chroot, so the issue
seems to persist....

	Andreas




-- 
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

--- End Message ---
--- Begin Message --- 
On Mon, 27 Nov 2006, Andreas Fester wrote:
> I experienced the same some time ago and worked it around
> by temporarily switching to a different mirror. It then succeeded,
> and afterwards I could again switch to my usual mirror.
> 
> But, yesterday I had the same issue in my i386 chroot, so the issue
> seems to persist....

Use --save-after-login and pbuilder login to open the chroot, add the new
apt key, and only then run the update.

I don't know where the bug is, but it is directly related to apt key
management.

-- 
  "One disk to rule them all, One disk to find them. One disk to bring
  them all and in the darkness grind them. In the Land of Redmond
  where the shadows lie." -- The Silicon Valley Tarot
  Henrique Holschuh


-- 
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

--- End Message ---
--- Begin Message --- 
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Henrique de Moraes Holschuh wrote:
> On Mon, 27 Nov 2006, Andreas Fester wrote:
>> I experienced the same some time ago and worked it around
>> by temporarily switching to a different mirror. It then succeeded,
>> and afterwards I could again switch to my usual mirror.
>>
>> But, yesterday I had the same issue in my i386 chroot, so the issue
>> seems to persist....
> 
> Use --save-after-login and pbuilder login to open the chroot, add the new
> apt key, and only then run the update.
> 
> I don't know where the bug is, but it is directly related to apt key
> management.

I tried to track it down; I could reproduce it with non-stripped apt-binaries from
a re-compiled apt source package. pstree showed the following processes while
apt-get was hanging:

apt-get(5027)???bzip2(5049)
              ??gpgv(5032)
              ??gzip(5038)
              ??http(5029)
              ??http(5030)

apt-get was blocked in a select() called from apt-get.cc:1354

1353   // Run it
1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
1355      return false;

bzip/gzip/gpgv were hanging in a select() which was called from WaitFd(),
and http did not show a useful stack trace.

Then, strangely, while still debugging, apt-get update suddenly
worked again (even without updating the apt key), so I was not able to
further examine it ... Maybe the above observations help when it happens
again :)

	Andreas

- --
Andreas Fester
mailto:andreas@littletux.net
WWW: http://www.littletux.net
ICQ: 326674288
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFaz9jZ3bQVzeW+rsRAjQVAKCZYlKQftP1lwjz7OvbUUYXJYaZ6wCgv5mp
S4msVMYT39GL2ZaXET4fUF0=
=Glr1
-----END PGP SIGNATURE-----


-- 
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

--- End Message ---
--- Begin Message --- 
On Mon, Nov 27, 2006 at 08:41:23PM +0100, Andreas Fester wrote:
> I tried to track it down; I could reproduce it with non-stripped apt-binaries from
> a re-compiled apt source package. pstree showed the following processes while
> apt-get was hanging:
> 
> apt-get(5027)???bzip2(5049)
>               ??gpgv(5032)
>               ??gzip(5038)
>               ??http(5029)
>               ??http(5030)
> 
> apt-get was blocked in a select() called from apt-get.cc:1354
> 
> 1353   // Run it
> 1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
> 1355      return false;
> 
> bzip/gzip/gpgv were hanging in a select() which was called from WaitFd(),
> and http did not show a useful stack trace.

This sounds similar to
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=341537

Try to see if the place where apt is getting stuck is one where it's
waiting for input from an external process which might have gotten
stuck or dead.

-- 
Rodrigo Gallardo
GPG-Fingerprint: 7C81 E60C 442E 8FBC D975  2F49 0199 8318 ADC9 BC28

Billboard billboard burning bright / in my windshield every night.
Lead me to a decent joint / where I can stop and get a bite.

Attachment: signature.asc
Description: Digital signature


--- End Message ---
--- Begin Message --- 
Andreas Fester wrote:
> I tried to track it down; I could reproduce it with non-stripped apt-binaries from
> a re-compiled apt source package. pstree showed the following processes while
> apt-get was hanging:
> 
> apt-get(5027)???bzip2(5049)
>               ??gpgv(5032)
>               ??gzip(5038)
>               ??http(5029)
>               ??http(5030)

I'm also seeing this, I've been seeing it starting approximatly 2 weeks ago
(well before the new apt key) on several machines (i386, arm) with several
mirrors, including mirrors.kernel.org and ftp.nl.debian.org.

> apt-get was blocked in a select() called from apt-get.cc:1354
> 
> 1353   // Run it
> 1354   if (Fetcher.Run() == pkgAcquire::Failed)   // <<==
> 1355      return false;

Hmm, when I straced apt-get, it was in a loop looking for a file:

select(8, [5 6 7], [], NULL, {0, 500000}) = 0 (Timeout)
stat64("/var/lib/apt/lists/partial/mirrors.kernel.org_debian_dists_testing_non-free_binary-i386_Packages.decomp",
0xafe9b960) = -1 ENOENT (No such file or directory)
gettimeofday({1164688481, 613704}, NULL) = 0
rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
write(1, "\r99% [3 Packages bzip2 0]", 25) = 25

I've also seen this on some of the machines. Running apt again clears
this up:

Get: 9 http://mirrors.kernel.org testing/main Packages [4249kB]
Get: 10 http://mirrors.kernel.org testing/main Packages [4249kB]              
50% [9 Packages bzip2 0] [10 Packages 22499/4249kB 0%]              512kB/s 8s
bzip2: Compressed file ends unexpectedly;
        perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
        Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

Err http://mirrors.kernel.org testing/main Packages                           
  Sub-process bzip2 returned an error code (2)

> Then, strangely, while still debugging, apt-get update suddenly
> worked again (even without updating the apt key), so I was not able to
> further examine it ... Maybe the above observations help when it happens
> again :)

Ditto, after I run it 4-5 times it completes.

-- 
see shy jo

Attachment: signature.asc
Description: Digital signature


--- End Message ---
--- Begin Message --- 
>>>>> "Henrique" == Henrique de Moraes Holschuh <hmh@debian.org> writes:

    Henrique> Use --save-after-login and pbuilder login to open the
    Henrique> chroot, add the new apt key, and only then run the
    Henrique> update.

I tried that, it didn't help.

The only solution I found when I checked last was to run apt-get via
strace...

I also have plenty of diskspace.
-- 
Brian May <bam@snoopy.debian.net>


-- 
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

--- End Message ---
--- Begin Message --- 
On Monday 27 November 2006 11:55, Brian May wrote:
> Hello,
>
> Is this a bug in apt?
>
> pbuilder update --override-config --configfile
> /tmp/pbuilder-local.SvMNy19452 W: /home/brian/.pbuilderrc does not exist
> Upgrading for distribution etch
> Building the build Environment
>  -> extracting base tarball [/var/cache/pbuilder/base-etch.tgz]
>  -> creating local configuration
>  -> copying local configuration
>  -> mounting /proc filesystem
>  -> mounting /dev/pts filesystem
>  -> policy-rc.d already exists
>   -> Installing apt-lines
> Refreshing the base.tgz
>  -> upgrading packages
> Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
> Get:2 http://ftp.au.debian.org etch Release [74.4kB]
> Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
> Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
> Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> 99% [5 Packages gzip 0]
>  (hangs for ever)
>
> I have tried waiting for it to timeout, but it doesn't.
>

Don't know whether its related, I stopped using ftp.au.debian.org.  IIRC it 
was replying to package requests with a 302 redirect, which apt-proxy 
seemed to be unable to handle.

Is this a 302 redirect something debian package management/archive mirroring 
tools are expected to handle, or are mirrors not expected to use redirects?

ftp.iinet.net.au/debian/ also seems to be intermittent partially updated.  I 
wonder whether they're mirroring from ftp.au.debian.org, and also having 
problems with the 302 responses. 

HTH
Andrew


-- 
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

--- End Message ---
--- Begin Message --- 
On Tue, Nov 28, 2006 at 01:34:54AM +1100, Andrew Vaughan wrote:
> > Get:1 http://ftp.au.debian.org etch Release.gpg [378B]
> > Get:2 http://ftp.au.debian.org etch Release [74.4kB]
> > Get:3 http://ftp.au.debian.org etch/main Packages/DiffIndex [2038B]
> > Get:4 http://ftp.au.debian.org etch/main Packages [5579kB]
> > Get:5 http://ftp.au.debian.org etch/main Packages [5579kB]
> > 99% [5 Packages gzip 0]
> >  (hangs for ever)
> >
> > I have tried waiting for it to timeout, but it doesn't.
> >
> 
> Don't know whether its related, I stopped using ftp.au.debian.org.  IIRC it 
> was replying to package requests with a 302 redirect, which apt-proxy 
> seemed to be unable to handle.
> 
> Is this a 302 redirect something debian package management/archive mirroring 
> tools are expected to handle, or are mirrors not expected to use redirects?
> 
> ftp.iinet.net.au/debian/ also seems to be intermittent partially updated.  I 
> wonder whether they're mirroring from ftp.au.debian.org, and also having 
> problems with the 302 responses. 

This is indepent on mirror choice I think. I got the same issue with ftp.it and solved
twice as pointed by henrique. Installing debian-archive-keyring in the
pbuilder chroot (with the new recent key) just before updating solved the
issue this time and in the previous case also. 

-- 
Francesco P. Lovergine


-- 
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

--- End Message ---

--- End Message ---
--- Begin Message --- 
Source: apt
Source-Version: 0.6.46.4

We believe that the bug you reported is fixed in the latest version of
apt, which is due to be installed in the Debian FTP archive:

apt-doc_0.6.46.4_all.deb
  to pool/main/a/apt/apt-doc_0.6.46.4_all.deb
apt-utils_0.6.46.4_i386.deb
  to pool/main/a/apt/apt-utils_0.6.46.4_i386.deb
apt_0.6.46.4.dsc
  to pool/main/a/apt/apt_0.6.46.4.dsc
apt_0.6.46.4.tar.gz
  to pool/main/a/apt/apt_0.6.46.4.tar.gz
apt_0.6.46.4_i386.deb
  to pool/main/a/apt/apt_0.6.46.4_i386.deb
libapt-pkg-dev_0.6.46.4_i386.deb
  to pool/main/a/apt/libapt-pkg-dev_0.6.46.4_i386.deb
libapt-pkg-doc_0.6.46.4_all.deb
  to pool/main/a/apt/libapt-pkg-doc_0.6.46.4_all.deb



A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 401017@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Michael Vogt <mvo@debian.org> (supplier of updated apt package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Format: 1.7
Date: Thu,  7 Dec 2006 10:49:50 +0100
Source: apt
Binary: apt-utils libapt-pkg-doc libapt-pkg-dev apt-doc apt
Architecture: source all i386
Version: 0.6.46.4
Distribution: unstable
Urgency: high
Maintainer: APT Development Team <deity@lists.debian.org>
Changed-By: Michael Vogt <mvo@debian.org>
Description: 
 apt        - Advanced front-end for dpkg
 apt-doc    - Documentation for APT
 apt-utils  - APT utility programs
 libapt-pkg-dev - Development files for APT's libapt-pkg and libapt-inst
 libapt-pkg-doc - Documentation for APT development
Closes: 398381 400874 401017
Changes: 
 apt (0.6.46.4) unstable; urgency=high
 .
   * ack NMU (closes: #401017)
   * added apt-secure.8 to "See also" section
   * apt-pkg/deb/dpkgpm.cc:
     - added "Dpkg::StopOnError" variable that controls if apt
       will abort on errors from dpkg
   * apt-pkg/deb/debsrcrecords.{cc,h}:
     - make the Buffer grow dynmaically (closes: #400874)
   * Merged from Christian Perrier bzr branch:
     - uk.po: New Ukrainian translation: 483t28f3u
     - el.po: Update to 503t9f2u
     - de.po: Updates and corrections.
   * apt-pkg/contrib/progress.cc:
     - OpProgress::CheckChange optimized, thanks to Paul Brook
       (closes: #398381)
   * apt-pkg/contrib/sha256.cc:
     - fix building with noopt
Files: 
 22f6d1c960f5d57263487f6d57dfc57a 788 admin important apt_0.6.46.4.dsc
 82ec892fb9d389a4b6090cc2314e1714 1797347 admin important apt_0.6.46.4.tar.gz
 ab4bd0d33e5112129f4a6fddb30ef051 91468 doc optional apt-doc_0.6.46.4_all.deb
 8b24eafb11eb630306462f77a380b300 113052 doc optional libapt-pkg-doc_0.6.46.4_all.deb
 61aa2370fdd1dd47bdd9a9d4edcf0366 1445796 admin important apt_0.6.46.4_i386.deb
 c6a3bea824c613e787a1a500706a3f1b 84084 libdevel optional libapt-pkg-dev_0.6.46.4_i386.deb
 aedda4fa178a4a05a917cb1df54ceb67 199198 admin important apt-utils_0.6.46.4_i386.deb

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (GNU/Linux)

iD8DBQFFdGNQliSD4VZixzQRAkL1AJ9vw7rECsmRh3DpC+YH/9DHKzQfiwCglZN/
rOSnKrnTPdK5CCm9tuP7f1A=
=t/Se
-----END PGP SIGNATURE-----

--- End Message ---
Reply to: