Re: [PHP-DEV] Re: [PHP-QA] Re: [PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-10-19 Thread Clint Priest
Could just as easily launch N sub-processes from run-tests.php as well. I compile php in a VM with -j 40 on a dual core VM powered by quad core chip... The number of simultaneous tests doesn't need to line up with CPU counts... -Clint On Oct 18, 2012, at 7:28 AM, "Pierre Joye" wrote: > hi! >

[PHP-DEV] Re: [PHP-QA] Re: [PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-10-18 Thread Pierre Joye
hi! On Wed, Oct 17, 2012 at 5:41 PM, zoe slattery wrote: > Nuno - just a PS to the last note. It is (mainly) the task allocation across > processors which means that running tests in parallel on a 4-way machine is > not 4 times as fast as running them in sequence. > > Here are some results from a

Re: [PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-10-17 Thread zoe slattery
Nuno - just a PS to the last note. It is (mainly) the task allocation across processors which means that running tests in parallel on a 4-way machine is not 4 times as fast as running them in sequence. Here are some results from a run on my 2-way Mac - http://static.inky.ws/image/3257/image.jp

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-10-15 Thread zoe slattery
Hi Nuno Hi, Here you have a dump of a run of PHP_HEAD in the gcov machine (almost 13k tests) without valgrind: http://gcov.php.net/~nlopess/dump_PHP_HEAD_z4.txt It was run with -z 4. However, the reported CPU usage is only 213% (instead of ~400%). I spent a lot of time this weekend trying

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-10-14 Thread Nuno Lopes
Hi, Here you have a dump of a run of PHP_HEAD in the gcov machine (almost 13k tests) without valgrind: http://gcov.php.net/~nlopess/dump_PHP_HEAD_z4.txt It was run with -z 4. However, the reported CPU usage is only 213% (instead of ~400%). As you can see in the dump, there are a few BORK'e

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-10-05 Thread zoe slattery
Hi Nuno - did you ever get a chance to look at the parallel version of run-tests? I had some free time to work on it last week so REDIRECT is now implemented, I have tested it using ext/pdo_mysql and ext/pdo_sqlite. I'm testing using about 8000 phpt tests and getting the same results as run-te

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-21 Thread Nuno Lopes
Alright, thanks for the reply! I'll try to have a look at the code and give it a try next weekend. Nuno -Original Message- From: zoe slattery Sent: Monday, May 21, 2012 8:26 AM Subject: Re: [PHP-QA] Parallel run-tests On 21/05/2012 06:45, Nuno Lopes wrote: Hi Zoe, Thanks for unde

Re: [PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-21 Thread zoe slattery
On 21/05/2012 08:59, Devis Lucato wrote: Hi, nice work, out of curiosity I tried on a VM with 24 virtual cores: Sequential new phpruntests: 29.6 seconds Parallel -z 4: 12.1 - 12.3 secs Parallel -z 8: 10.6 - 10.9 secs Parallel -z 16: 10.6 - 11.3 secs Parallel -z 24: 10.9 - 11.7 secs Cool - thank

Re: [PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-21 Thread Devis Lucato
Hi, nice work, out of curiosity I tried on a VM with 24 virtual cores: Sequential new phpruntests: 29.6 seconds Parallel -z 4: 12.1 - 12.3 secs Parallel -z 8: 10.6 - 10.9 secs Parallel -z 16: 10.6 - 11.3 secs Parallel -z 24: 10.9 - 11.7 secs Btw I'm seeing this error: PHP Warning: Invalid arg

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-21 Thread zoe slattery
On 21/05/2012 06:45, Nuno Lopes wrote: Hi Zoe, Thanks for undertaking this project! I just have a few concerns about this: - The speedup seems a bit low to me. Maybe with a higher number of extensions enabled it will improve?.. I don't think it will improve with a higher number of extensions.

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-20 Thread Nuno Lopes
Hi Zoe, Thanks for undertaking this project! I just have a few concerns about this: - The speedup seems a bit low to me. Maybe with a higher number of extensions enabled it will improve?.. - Is there any developer documentation available? If I wanted to do a change or a bug fix today, how cou

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-20 Thread zoe slattery
HI Felipe - a couple of updates. 1) Is your ~/dev/php5_4/sapi/cli/php built --with-zlib? 2) This test uses the php-cgi, are you setting it with an env variable? Or relying on run-tests.php to find it (it should do that) Even if it is missing zlib function that is causing the initial error,

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-20 Thread zoe slattery
On 19/05/2012 22:33, Felipe Pena wrote: Hi Zoe, great work on this new run-tests! :D I was testing it and noticed a problem when running using the following command: $ ~/dev/php5_4/sapi/cli/php run-tests.php -z 8 -p ~/dev/php5_4/sapi/cli/php ~/dev/php5_4/ It shows the PHP messages: [...] Fata

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-19 Thread Felipe Pena
Hi Zoe, great work on this new run-tests! :D I was testing it and noticed a problem when running using the following command: $ ~/dev/php5_4/sapi/cli/php run-tests.php -z 8 -p ~/dev/php5_4/sapi/cli/php ~/dev/php5_4/ It shows the PHP messages: [...] Fatal error: Call to undefined function gzenco

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-17 Thread zoe slattery
Olivier - brilliant thanks! So, we have two points now: http://zoah.co.uk/update-parallel-run-tests-php Anyone do an 8 way? Zoe 5. Testing. I'm able to do basic testing on Mac OSX and Linux Hi Zoe, Here is a quick test on my 4-cores Linux server : tested on PHP 5.3.9 412 tests executed Seq

[PHP-DEV] Re: [PHP-QA] Parallel run-tests

2012-05-17 Thread Olivier Doucet
> 5. Testing. I'm able to do basic testing on Mac OSX  and Linux Hi Zoe, Here is a quick test on my 4-cores Linux server : tested on PHP 5.3.9 412 tests executed Sequential : 115,3 seconds Parallel (4 threads) : 43,8 seconds Original run-tests.php : 115,4 seconds Olivier -- PHP Internals - PHP