On 06.02.2012 20:58, Adam D. Barratt wrote:
migration/testing.pl needs to be updated to make it react better when called repeatedly, or to avoid the need to do so. Right now it's sufficiently resource hungry to make a 16-core machine unhappy.An initial idea might be to statically generate package pages, althoughthis would need to be benchmarked for feasibility. testing.pl could then simply become a redirect to /package/blah or similar.
It turns out that the cron job already generated cache files for the packages pages, which were then returned by the CGI (except presumably for the brief window while they were being re-generated). testing.pl?package=$foo now serves up the cache page via mod_rewrite. This does mean that there's a brief window once an hour where the pages aren't available, but that could be resolved by having the cron job use a temporary data store which is then swapped to live.
The extra query string parameters aren't currently supported. We should work out which are actually in use, and whether we can re-introduce support for them in a sane way (without either killing franck or exploding the file system use).
Adam