Bug#756125: tracker.debian.org: update fails with too many open files
Package: tracker.debian.org
Version: 0.20140710
Severity: minor
This happened when we were using the fixture
distro_tracker/core/fixtures/debian-repositories.xml with all
repositories enabled as binary repositories. The total number of APT
cache files was around 700 and I suspect that some files are not
properly closed too. (Ticket migrated from Trello:
https://trello.com/c/duNhR7pO/)
Traceback:
ERROR 2014-06-30 02:38:17,322 Problem extracting source files for systemd, version 208-5 version 208-5
Traceback (most recent call last):
File "/srv/tracker.debian.org/distro-tracker/distro_tracker/extract_source_files/tracker_tasks.py", line 138, in execute
self.extract_files(source_package)
File "/srv/tracker.debian.org/distro-tracker/distro_tracker/extract_source_files/tracker_tasks.py", line 69, in extract_files
debian_directory_only=True)
File "/srv/tracker.debian.org/distro-tracker/distro_tracker/core/utils/packages.py", line 591, in retrieve_source
source_records = self._get_apt_source_records(source_name, version)
File "/srv/tracker.debian.org/distro-tracker/distro_tracker/core/utils/packages.py", line 483, in _get_apt_source_records
cache = apt.cache.Cache(rootdir=self.cache_root_dir)
File "/usr/lib/python2.7/dist-packages/apt/cache.py", line 102, in __init__
self.open(progress)
File "/usr/lib/python2.7/dist-packages/apt/cache.py", line 147, in open
self._records = apt_pkg.PackageRecords(self._cache)
SystemError: E:Impossible d'ouvrir le fichier /srv/tracker.debian.org/distro-tracker/data/cache/apt-cache/var/lib/apt/lists/http.debian.net_debian_dists_oldstable-proposed-updates_main_binary-kfreebsd-i386_Packages - open (24: Too many open files), E:Impossible d'ouvrir le fichier /srv/tracker.debian.org/distro-tracker/data/cache/apt-cache/var/lib/apt/lists/http.debian.net_debian_dists_oldstable-proposed-updates_non-free_binary-kfreebsd-amd64_Packages - open (24: Too many open files)
[...]
E:Impossible d'ouvrir le fichier /srv/tracker.debian.org/distro-tracker/data/cache/apt-cache/var/lib/apt/lists/http.debian.net_debian_dists_oldstable_main_binary-amd64_Packages - open (24: Too many open files)
Segmentation fault
Reply to: