Re: [Popcon-developers] encrypted popcon submissions
On Sat, May 11, 2013 at 11:43:25AM +0200, Bill Allombert wrote:
> > Why do you think this is too much for popov to handle?
>
> I did some benchmark. Currently popov CPU has about 20% of a real CPU.
> Currently processing the popcon data takes between 6h30 and 8h30.
> At this rate decrypting the report would take an additional 7h.
Sorry my benchmarks were completly wrong. Actually the bottleneck is the speed
of the filesystem, especially for writing. Unfortunately popcon.debian.org
has to process a lot of data. The database holds 10.5Gb and it receives about
1.4GB of submissions each days.
One of the test is:
dd if=/dev/zero of=s2 count=30 bs=1k; time (for i in `seq 1 10`; do cat s2 > s1; done)
The other is
time (for i in `seq 1 10`; do gpg < sub.gpg > s1; done)
(sub.gpg is a 30KB encrypted file).
So it would be nice if popcon filesystem was faster. On the other hand the CPU
usage is less a problem.
Maybe I could try to schedule popcon cron job at a different time.
Cheers,
--
Bill. <ballombe@debian.org>
Imagine a large red swirl here.
Reply to: