Hi Matt,

Can you provide instruction how to install and run Joomla and Symfony unit
tests.

Thanks. Dmitry.


On Thu, Aug 21, 2014 at 10:27 PM, Matt Ficken <themattfic...@gmail.com>
wrote:

> Master (with PHPNG) builds on Windows (our snapshot build servers were
> never interrupted BTW), though extensions including  PDO, mysql and soap
> are disabled.
>
>
> Master on Windows now has 201 test failures(all sapi scenarios) while Linux
> (for me at least) only has about 20 failures, see:
>
> http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PHPT_CMP_PHP_5_6-5.6.0RC3-TS-X86-VC11_Local-FileSystem_MySQL-5.6_CLI_v_PHP_Master-r0ac3d8d-TS-X86-VC.html
> Master is now all RED on qa.php.net, see: http://qa.php.net/pftt.php
>
> Additionally, for the CLI sapi scenario, there are many regressions of
> Joomla's PhpUnit test suites: typically I get a ~72% pass rate but now only
> get ~60% pass rate.
> See:
>
> http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Joomla-Platform-12.3_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSyste.html
> Looks like Joomla regressions are mostly because of the deprecation of
> `iconv.internal_encoding` and missing the PDO extension.
>
> Pass rate for Symfony remains unchanged (~93%), see:
>
> http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Symfony-Standard-2.1.8_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSys.html
>
> See list below for PHPT failures and analysis. Apparently I can't attach
> the run-test.php output or Joomla output.
>
> Some tests fail because expected output has changed (sapi and file
> failures) which I don't believe are actual functionality problems. Unless
> anyone disagrees that those tests are not actually ok, I'm going to file
> bug reports and update them (creating -win32 fork if needed).
> Some tests (array, reflection, session) could be a major regression.
>
>
> ;
> ; expected output didn't include the character encoding, which is now
> included by builtin web server
> Sapi\cli\tests\006.phpt
> Sapi\cli\tests\bug43177.phpt
> Sapi\cli\tests\bug61977.phpt
> Sapi\cli\tests\bug65066_100.phpt
> Sapi\cli\tests\bug65066_422.phpt
> Sapi\cli\tests\bug65066_511.phpt
> Sapi\cli\tests\bug65633.phpt
> Sapi\cli\tests\bug66830.phpt
> Sapi\cli\tests\bug67429.phpt
> Sapi\cli\tests\php_cli_server_004.phpt
> Sapi\cli\tests\php_cli_server_005.phpt
> Sapi\cli\tests\php_cli_server_006.phpt
> Sapi\cli\tests\php_cli_server_007.phpt
> Sapi\cli\tests\php_cli_server_008.phpt
> Sapi\cli\tests\php_cli_server_009.phpt
> Sapi\cli\tests\php_cli_server_010.phpt
> Sapi\cli\tests\php_cli_server_012.phpt
> Sapi\cli\tests\php_cli_server_015.phpt
> Sapi\cli\tests\php_cli_server_017.phpt
> Sapi\cli\tests\php_cli_server_018.phpt
> Sapi\cli\tests\php_cli_server_019.phpt
> ;
> ; expected reference count has changed
> Zend\tests\001.phpt
> Zend\tests\002.phpt
> Zend\tests\003.phpt
> Zend\tests\bug24773.phpt
> Zend\tests\bug35393.phpt
> Zend\tests\bug38047.phpt
> Zend\tests\bug40815.phpt
> Zend\tests\bug52361.phpt
> Zend\tests\bug54013.phpt
> Zend\tests\bug60825.phpt
> Zend\tests\bug63635.phpt
> Zend\tests\bug64515.phpt
> Zend\tests\bug67436\bug67436_nohandler.phpt
> Zend\tests\call_user_func_004.phpt
> Zend\tests\call_user_func_005.phpt
> Zend\tests\closure_018.phpt
> Zend\tests\closure_019.phpt
> Zend\tests\closure_026.phpt
> Zend\tests\dereference_002.phpt
> Zend\tests\fr47160.phpt
> Zend\tests\gc_014.phpt
> Zend\tests\gc_029_zts.phpt
> Zend\tests\gc_030.phpt
> Zend\tests\gc_032.phpt
> Zend\tests\generators\errors\non_ref_generator_iterated_by_ref_error.phpt
> Zend\tests\generators\generator_rewind.phpt
> Zend\tests\objects_027.phpt
> ; returning false
> ext\date\tests\009_win32.phpt
> ext\date\tests\DateTimeZone_verify.phpt
> ext\date\tests\DateTime_verify.phpt
> ext\date\tests\bug41523.phpt
> ext\date\tests\bug51866.phpt
> ext\date\tests\bug65184.phpt
> ext\date\tests\gmstrftime_basic.phpt
> ext\date\tests\gmstrftime_variation1.phpt
> ext\date\tests\gmstrftime_variation2.phpt
> ext\date\tests\gmstrftime_variation21
> ext\date\tests\gmstrftime_variation3.phpt
> ext\date\tests\gmstrftime_variation4.phpt
> ext\date\tests\gmstrftime_variation5.phpt
> ext\date\tests\gmstrftime_variation6.phpt
> ext\date\tests\gmstrftime_variation7.phpt
> ext\date\tests\gmstrftime_variation8.phpt
> ext\date\tests\strftime_basic.phpt
> ext\date\tests\strftime_variation1.phpt
> ext\date\tests\strftime_variation2.phpt
> ext\date\tests\strftime_variation21.phpt
> ext\date\tests\strftime_variation23.phpt
> ext\date\tests\strftime_variation3.phpt
> ext\date\tests\strftime_variation4.phpt
> ext\date\tests\strftime_variation5.phpt
> ext\date\tests\strftime_variation6.phpt
> ext\date\tests\strftime_variation7.phpt
> ext\date\tests\strftime_variation8.phpt
> ext\hash\tests\hash_algos.phpt
> ext\hash\tests\hash_copy_001.phpt
> ext\iconv\tests\iconv_encoding_basic.phpt
> ext\iconv\tests\iconv_get_encoding_basic.phpt
> ext\iconv\tests\iconv_set_encoding_variation.phpt
> ext\iconv\tests\iconv_strpos_basic.phpt
> ext\iconv\tests\iconv_strpos_variation5.phpt
> ext\iconv\tests\iconv_strrpos_basic.phpt
> ext\pcre\tests\006.phpt
> ext\pcre\tests\recursion_limit.phpt
> ext\phar\tests\create_path_error.phpt
> ; ?
> ext\reflection\tests\009.phpt
> ext\reflection\tests\025.phpt
> ext\reflection\tests\ReflectionClass_getInterfaces_003.phpt
> ext\reflection\tests\ReflectionClass_getMethods_001.phpt
> ext\reflection\tests\ReflectionClass_getMethods_003.phpt
> ext\reflection\tests\ReflectionClass_getProperties_001.phpt
> ext\reflection\tests\ReflectionClass_getProperties_003.phpt
> ext\reflection\tests\ReflectionExtension_getClasses_basic.phpt
> ext\reflection\tests\ReflectionParameter_canBePassedByValue.phpt
> ext\reflection\tests\ReflectionProperty_setAccessible.phpt
> ext\reflection\tests\bug40431.phpt
> ext\reflection\tests\bug46064_2.phpt
> ext\reflection\tests\traits004.phpt
> ext\session\tests\016.phpt
> ext\session\tests\bug60634_error_1.phpt
> ext\session\tests\session_module_name_variation3.phpt
> ext\session\tests\session_save_path_variation2.phpt
> ext\session\tests\session_set_save_handler_basic.phpt
> ext\session\tests\session_set_save_handler_class_002.phpt
> ext\session\tests\session_set_save_handler_class_003.phpt
> ext\session\tests\session_set_save_handler_class_005.phpt
> ext\session\tests\session_set_save_handler_class_007.phpt
> ext\session\tests\session_set_save_handler_class_012.phpt
> ext\session\tests\session_set_save_handler_class_016.phpt
> ext\session\tests\session_set_save_handler_closures.phpt
> ext\session\tests\session_set_save_handler_error3.phpt
> ext\session\tests\session_set_save_handler_error4.phpt
> ext\session\tests\session_set_save_handler_iface_001.phpt
> ext\session\tests\session_set_save_handler_variation4.phpt
> ext\simplexml\tests\SimpleXMLElement_xpath.phpt
> ext\spl\tests\ArrayObject_unserialize_empty_string.phpt
> ext\spl\tests\SplObjectStorage_unserialize_invalid_parameter3.phpt
> ext\spl\tests\bug51532.phpt
> ext\spl\tests\bug60201.phpt
> ext\spl\tests\bug64782.phpt
> ext\spl\tests\iterator_042.phpt
> ;
> ; not clear why array functions fail
> ext\standard\tests\array\array_fill.phpt
> ext\standard\tests\array\array_fill_error.phpt
> ext\standard\tests\array\array_fill_variation2.phpt
> ext\standard\tests\array\array_filter_error.phpt
> ext\standard\tests\array\array_intersect_uassoc_variation10.phpt
> ext\standard\tests\array\array_intersect_ukey_variation9.phpt
> ext\standard\tests\array\bug24766.phpt
> ext\standard\tests\array\bug25708.phpt
> ext\standard\tests\array\bug26458.phpt
> ext\standard\tests\array\bug67693.phpt
> ext\standard\tests\array\extract_variation1.phpt
> ext\standard\tests\dir\closedir_variation2.phpt
> ext\standard\tests\dir\dir_basic.phpt
> ext\standard\tests\dir\rewinddir_variation2.phpt
> ;
> ; many tests fail because error messages changed slightly
> ext\standard\tests\file\007_basic.phpt
> ext\standard\tests\file\007_error.phpt
> ext\standard\tests\file\bug27508.phpt
> ext\standard\tests\file\bug41655_1.phpt
> ext\standard\tests\file\fclose_variation1.phpt
> ext\standard\tests\file\feof_basic.phpt
> ext\standard\tests\file\fgetc_variation2.phpt
> ext\standard\tests\file\fgets_error.phpt
> ext\standard\tests\file\fgets_variation2.phpt
> ext\standard\tests\file\fgetss.phpt
> ext\standard\tests\file\fgetss_error.phpt
> ext\standard\tests\file\flock.phpt
> ext\standard\tests\file\flock_error.phpt
> ext\standard\tests\file\fread_error.phpt
> ext\standard\tests\file\fscanf_error.phpt
> ext\standard\tests\file\fseek_ftell_rewind_error1.phpt
> ext\standard\tests\file\fseek_ftell_rewind_error2.phpt
> ext\standard\tests\file\fseek_ftell_rewind_error3.phpt
> ext\standard\tests\file\fstat.phpt
> ext\standard\tests\file\ftruncate_error.phpt
> ext\standard\tests\file\fwrite_error.phpt
> ext\standard\tests\file\glob_variation3.phpt
> ext\standard\tests\file\pathinfo_basic1-win32.phpt
> ext\standard\tests\file\pathinfo_basic2-win32.phpt
> ext\standard\tests\file\userwrapper.phpt
> ext\standard\tests\general_functions\bug29038.phpt
> ext\standard\tests\general_functions\bug44487.phpt
> ext\standard\tests\general_functions\call_user_func_return.phpt
> ext\standard\tests\general_functions\call_user_method.phpt
> ext\standard\tests\general_functions\call_user_method_002.phpt
> ext\standard\tests\general_functions\debug_zval_dump_b.phpt
> ext\standard\tests\general_functions\debug_zval_dump_v.phpt
> ext\standard\tests\general_functions\ini_get_all.phpt
> ext\standard\tests\math\pow_variation1.phpt
> ext\standard\tests\math\pow_variation2.phpt
> ext\standard\tests\network\setcookie.phpt
> ext\standard\tests\serialize\005.phpt
> ext\standard\tests\serialize\bug64146.phpt
> ext\standard\tests\serialize\bug67072_2.phpt
> ext\standard\tests\serialize\serialization_arrays_005.phpt
> ext\standard\tests\streams\bug40459.phpt
> ext\standard\tests\streams\bug54623.phpt
> ext\standard\tests\streams\stream_get_meta_data_file_error.phpt
> ext\standard\tests\streams\stream_set_timeout_error.phpt
> ext\standard\tests\strings\bug55871.phpt
> ext\standard\tests\strings\crypt.phpt
> ext\standard\tests\strings\str_pad_variation5.phpt
> ext\standard\tests\strings\strncasecmp_variation10.phpt
> ext\standard\tests\strings\strncasecmp_variation11.phpt
> ext\standard\tests\strings\strncasecmp_variation4.phpt
> ext\standard\tests\strings\strncmp_variation4.phpt
> ext\tokenizer\tests\bug60097.phpt
> ext\wddx\tests\bug48562.phpt
> ext\zlib\tests\bug67724.phpt
> ext\zlib\tests\gzclose_basic.phpt
> ext\zlib\tests\gzeof_variation1.phpt
> ;
> ; might expect phpng to break these
> tests\basic\024.phpt
> tests\basic\026.phpt
> tests\classes\inheritance_007.
> phpt
> tests\func\005a.phpt
> tests\lang\foreachLoop.013.phpt
> tests\lang\foreachLoop.014.phpt
> tests\lang\foreachLoop.015.phpt
> tests\lang\func_get_arg.001.phpt
> tests\lang\func_get_args.004.phpt
>

Reply via email to