Bug#788362: security-tracker switched to ftp.de.d.o as httpredir returns 404 when it shouldnt

[Holger Levsen <holger@layer-acht.org>]

package: security-tracker
x-debbugs-cc: Raphael Geissert <geissert@debian.org>

Hi Raphael,

httpredir as used for security-tracker.debian.org has some problems updating
some Packages files, _sometimes_. IOW: i've seen this working on my laptop,
but not when deployed on soler. The url exists... (or rather it does as Packages.gz, 
so it seems apt-update-file has some magic here too...) but it repeatedly
failed like this. (or similar for other targets too)

sectracker@soler:/srv/security-tracker.debian.org/website/secure-testing$ make update-oldstable
set -e ; for rel in wheezy ; do \
        for archive in main contrib non-free ; do \
        python bin/apt-update-file \
                http://httpredir.debian.org/debian//dists/$rel/$archive/source/Sources \
                data/packages/${rel}__${archive}_Sources ; \
        done ; \
        for arch in amd64 armel armhf i386 ia64 mips mipsel powerpc s390 s390x sparc kfreebsd-i386 kfreebsd-amd64 ; do \
          for archive in main contrib non-free ; do \
          python bin/apt-update-file \
            http://httpredir.debian.org/debian//dists/$rel/$archive/binary-$arch/Packages \
            data/packages/${rel}__${archive}_${arch}_Packages ; \
          done ; \
        done ; \
done
error: in download of 'http://httpredir.debian.org/debian//dists/wheezy/contrib/binary-sparc/Packages' to 'data/packages/wheezy__contrib_sparc_Packages':
Traceback (most recent call last):
  File "bin/apt-update-file", line 29, in <module>
    debian_support.updateFile(sys.argv[1], sys.argv[2])
  File "/srv/security-tracker.debian.org/website/secure-testing/lib/python/debian_support.py", line 346, in updateFile
    return downloadFile(remote, local)
  File "/srv/security-tracker.debian.org/website/secure-testing/lib/python/debian_support.py", line 309, in downloadFile
    lines = downloadGunzipLines(remote + '.gz')
  File "/srv/security-tracker.debian.org/website/secure-testing/lib/python/debian_support.py", line 292, in downloadGunzipLines
    data = urllib2.urlopen(remote, timeout=TIMEOUT)
  File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 469, in error
    result = self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 656, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/usr/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 558, in http_error_default   
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 404: Not Found
Makefile:106: recipe for target 'update-oldstable' failed
make: *** [update-oldstable] Error 1

So for now I have switched the security-tracker to use ftp.de.debian.org again.


cheers,
	Holger

Attachment: signature.asc
Description: This is a digitally signed message part.