On Sat, May 11, 2013 at 11:43:25AM +0200, Bill Allombert wrote: > > Why do you think this is too much for popov to handle? > > I did some benchmark. Currently popov CPU has about 20% of a real CPU. > Currently processing the popcon data takes between 6h30 and 8h30. > At this rate decrypting the report would take an additional 7h.
Sorry my benchmarks were completly wrong. Actually the bottleneck is the speed of the filesystem, especially for writing. Unfortunately popcon.debian.org has to process a lot of data. The database holds 10.5Gb and it receives about 1.4GB of submissions each days. One of the test is: dd if=/dev/zero of=s2 count=30 bs=1k; time (for i in `seq 1 10`; do cat s2 > s1; done) The other is time (for i in `seq 1 10`; do gpg < sub.gpg > s1; done) (sub.gpg is a 30KB encrypted file). So it would be nice if popcon filesystem was faster. On the other hand the CPU usage is less a problem. Maybe I could try to schedule popcon cron job at a different time. Cheers, -- Bill. <ballo...@debian.org> Imagine a large red swirl here. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20130515220401.GD24641@yellowpig
