Hi Matt, Can you provide instruction how to install and run Joomla and Symfony unit tests.
Thanks. Dmitry. On Thu, Aug 21, 2014 at 10:27 PM, Matt Ficken <themattfic...@gmail.com> wrote: > Master (with PHPNG) builds on Windows (our snapshot build servers were > never interrupted BTW), though extensions including PDO, mysql and soap > are disabled. > > > Master on Windows now has 201 test failures(all sapi scenarios) while Linux > (for me at least) only has about 20 failures, see: > > http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PHPT_CMP_PHP_5_6-5.6.0RC3-TS-X86-VC11_Local-FileSystem_MySQL-5.6_CLI_v_PHP_Master-r0ac3d8d-TS-X86-VC.html > Master is now all RED on qa.php.net, see: http://qa.php.net/pftt.php > > Additionally, for the CLI sapi scenario, there are many regressions of > Joomla's PhpUnit test suites: typically I get a ~72% pass rate but now only > get ~60% pass rate. > See: > > http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Joomla-Platform-12.3_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSyste.html > Looks like Joomla regressions are mostly because of the deprecation of > `iconv.internal_encoding` and missing the PDO extension. > > Pass rate for Symfony remains unchanged (~93%), see: > > http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Symfony-Standard-2.1.8_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSys.html > > See list below for PHPT failures and analysis. Apparently I can't attach > the run-test.php output or Joomla output. > > Some tests fail because expected output has changed (sapi and file > failures) which I don't believe are actual functionality problems. Unless > anyone disagrees that those tests are not actually ok, I'm going to file > bug reports and update them (creating -win32 fork if needed). > Some tests (array, reflection, session) could be a major regression. > > > ; > ; expected output didn't include the character encoding, which is now > included by builtin web server > Sapi\cli\tests\006.phpt > Sapi\cli\tests\bug43177.phpt > Sapi\cli\tests\bug61977.phpt > Sapi\cli\tests\bug65066_100.phpt > Sapi\cli\tests\bug65066_422.phpt > Sapi\cli\tests\bug65066_511.phpt > Sapi\cli\tests\bug65633.phpt > Sapi\cli\tests\bug66830.phpt > Sapi\cli\tests\bug67429.phpt > Sapi\cli\tests\php_cli_server_004.phpt > Sapi\cli\tests\php_cli_server_005.phpt > Sapi\cli\tests\php_cli_server_006.phpt > Sapi\cli\tests\php_cli_server_007.phpt > Sapi\cli\tests\php_cli_server_008.phpt > Sapi\cli\tests\php_cli_server_009.phpt > Sapi\cli\tests\php_cli_server_010.phpt > Sapi\cli\tests\php_cli_server_012.phpt > Sapi\cli\tests\php_cli_server_015.phpt > Sapi\cli\tests\php_cli_server_017.phpt > Sapi\cli\tests\php_cli_server_018.phpt > Sapi\cli\tests\php_cli_server_019.phpt > ; > ; expected reference count has changed > Zend\tests\001.phpt > Zend\tests\002.phpt > Zend\tests\003.phpt > Zend\tests\bug24773.phpt > Zend\tests\bug35393.phpt > Zend\tests\bug38047.phpt > Zend\tests\bug40815.phpt > Zend\tests\bug52361.phpt > Zend\tests\bug54013.phpt > Zend\tests\bug60825.phpt > Zend\tests\bug63635.phpt > Zend\tests\bug64515.phpt > Zend\tests\bug67436\bug67436_nohandler.phpt > Zend\tests\call_user_func_004.phpt > Zend\tests\call_user_func_005.phpt > Zend\tests\closure_018.phpt > Zend\tests\closure_019.phpt > Zend\tests\closure_026.phpt > Zend\tests\dereference_002.phpt > Zend\tests\fr47160.phpt > Zend\tests\gc_014.phpt > Zend\tests\gc_029_zts.phpt > Zend\tests\gc_030.phpt > Zend\tests\gc_032.phpt > Zend\tests\generators\errors\non_ref_generator_iterated_by_ref_error.phpt > Zend\tests\generators\generator_rewind.phpt > Zend\tests\objects_027.phpt > ; returning false > ext\date\tests\009_win32.phpt > ext\date\tests\DateTimeZone_verify.phpt > ext\date\tests\DateTime_verify.phpt > ext\date\tests\bug41523.phpt > ext\date\tests\bug51866.phpt > ext\date\tests\bug65184.phpt > ext\date\tests\gmstrftime_basic.phpt > ext\date\tests\gmstrftime_variation1.phpt > ext\date\tests\gmstrftime_variation2.phpt > ext\date\tests\gmstrftime_variation21 > ext\date\tests\gmstrftime_variation3.phpt > ext\date\tests\gmstrftime_variation4.phpt > ext\date\tests\gmstrftime_variation5.phpt > ext\date\tests\gmstrftime_variation6.phpt > ext\date\tests\gmstrftime_variation7.phpt > ext\date\tests\gmstrftime_variation8.phpt > ext\date\tests\strftime_basic.phpt > ext\date\tests\strftime_variation1.phpt > ext\date\tests\strftime_variation2.phpt > ext\date\tests\strftime_variation21.phpt > ext\date\tests\strftime_variation23.phpt > ext\date\tests\strftime_variation3.phpt > ext\date\tests\strftime_variation4.phpt > ext\date\tests\strftime_variation5.phpt > ext\date\tests\strftime_variation6.phpt > ext\date\tests\strftime_variation7.phpt > ext\date\tests\strftime_variation8.phpt > ext\hash\tests\hash_algos.phpt > ext\hash\tests\hash_copy_001.phpt > ext\iconv\tests\iconv_encoding_basic.phpt > ext\iconv\tests\iconv_get_encoding_basic.phpt > ext\iconv\tests\iconv_set_encoding_variation.phpt > ext\iconv\tests\iconv_strpos_basic.phpt > ext\iconv\tests\iconv_strpos_variation5.phpt > ext\iconv\tests\iconv_strrpos_basic.phpt > ext\pcre\tests\006.phpt > ext\pcre\tests\recursion_limit.phpt > ext\phar\tests\create_path_error.phpt > ; ? > ext\reflection\tests\009.phpt > ext\reflection\tests\025.phpt > ext\reflection\tests\ReflectionClass_getInterfaces_003.phpt > ext\reflection\tests\ReflectionClass_getMethods_001.phpt > ext\reflection\tests\ReflectionClass_getMethods_003.phpt > ext\reflection\tests\ReflectionClass_getProperties_001.phpt > ext\reflection\tests\ReflectionClass_getProperties_003.phpt > ext\reflection\tests\ReflectionExtension_getClasses_basic.phpt > ext\reflection\tests\ReflectionParameter_canBePassedByValue.phpt > ext\reflection\tests\ReflectionProperty_setAccessible.phpt > ext\reflection\tests\bug40431.phpt > ext\reflection\tests\bug46064_2.phpt > ext\reflection\tests\traits004.phpt > ext\session\tests\016.phpt > ext\session\tests\bug60634_error_1.phpt > ext\session\tests\session_module_name_variation3.phpt > ext\session\tests\session_save_path_variation2.phpt > ext\session\tests\session_set_save_handler_basic.phpt > ext\session\tests\session_set_save_handler_class_002.phpt > ext\session\tests\session_set_save_handler_class_003.phpt > ext\session\tests\session_set_save_handler_class_005.phpt > ext\session\tests\session_set_save_handler_class_007.phpt > ext\session\tests\session_set_save_handler_class_012.phpt > ext\session\tests\session_set_save_handler_class_016.phpt > ext\session\tests\session_set_save_handler_closures.phpt > ext\session\tests\session_set_save_handler_error3.phpt > ext\session\tests\session_set_save_handler_error4.phpt > ext\session\tests\session_set_save_handler_iface_001.phpt > ext\session\tests\session_set_save_handler_variation4.phpt > ext\simplexml\tests\SimpleXMLElement_xpath.phpt > ext\spl\tests\ArrayObject_unserialize_empty_string.phpt > ext\spl\tests\SplObjectStorage_unserialize_invalid_parameter3.phpt > ext\spl\tests\bug51532.phpt > ext\spl\tests\bug60201.phpt > ext\spl\tests\bug64782.phpt > ext\spl\tests\iterator_042.phpt > ; > ; not clear why array functions fail > ext\standard\tests\array\array_fill.phpt > ext\standard\tests\array\array_fill_error.phpt > ext\standard\tests\array\array_fill_variation2.phpt > ext\standard\tests\array\array_filter_error.phpt > ext\standard\tests\array\array_intersect_uassoc_variation10.phpt > ext\standard\tests\array\array_intersect_ukey_variation9.phpt > ext\standard\tests\array\bug24766.phpt > ext\standard\tests\array\bug25708.phpt > ext\standard\tests\array\bug26458.phpt > ext\standard\tests\array\bug67693.phpt > ext\standard\tests\array\extract_variation1.phpt > ext\standard\tests\dir\closedir_variation2.phpt > ext\standard\tests\dir\dir_basic.phpt > ext\standard\tests\dir\rewinddir_variation2.phpt > ; > ; many tests fail because error messages changed slightly > ext\standard\tests\file\007_basic.phpt > ext\standard\tests\file\007_error.phpt > ext\standard\tests\file\bug27508.phpt > ext\standard\tests\file\bug41655_1.phpt > ext\standard\tests\file\fclose_variation1.phpt > ext\standard\tests\file\feof_basic.phpt > ext\standard\tests\file\fgetc_variation2.phpt > ext\standard\tests\file\fgets_error.phpt > ext\standard\tests\file\fgets_variation2.phpt > ext\standard\tests\file\fgetss.phpt > ext\standard\tests\file\fgetss_error.phpt > ext\standard\tests\file\flock.phpt > ext\standard\tests\file\flock_error.phpt > ext\standard\tests\file\fread_error.phpt > ext\standard\tests\file\fscanf_error.phpt > ext\standard\tests\file\fseek_ftell_rewind_error1.phpt > ext\standard\tests\file\fseek_ftell_rewind_error2.phpt > ext\standard\tests\file\fseek_ftell_rewind_error3.phpt > ext\standard\tests\file\fstat.phpt > ext\standard\tests\file\ftruncate_error.phpt > ext\standard\tests\file\fwrite_error.phpt > ext\standard\tests\file\glob_variation3.phpt > ext\standard\tests\file\pathinfo_basic1-win32.phpt > ext\standard\tests\file\pathinfo_basic2-win32.phpt > ext\standard\tests\file\userwrapper.phpt > ext\standard\tests\general_functions\bug29038.phpt > ext\standard\tests\general_functions\bug44487.phpt > ext\standard\tests\general_functions\call_user_func_return.phpt > ext\standard\tests\general_functions\call_user_method.phpt > ext\standard\tests\general_functions\call_user_method_002.phpt > ext\standard\tests\general_functions\debug_zval_dump_b.phpt > ext\standard\tests\general_functions\debug_zval_dump_v.phpt > ext\standard\tests\general_functions\ini_get_all.phpt > ext\standard\tests\math\pow_variation1.phpt > ext\standard\tests\math\pow_variation2.phpt > ext\standard\tests\network\setcookie.phpt > ext\standard\tests\serialize\005.phpt > ext\standard\tests\serialize\bug64146.phpt > ext\standard\tests\serialize\bug67072_2.phpt > ext\standard\tests\serialize\serialization_arrays_005.phpt > ext\standard\tests\streams\bug40459.phpt > ext\standard\tests\streams\bug54623.phpt > ext\standard\tests\streams\stream_get_meta_data_file_error.phpt > ext\standard\tests\streams\stream_set_timeout_error.phpt > ext\standard\tests\strings\bug55871.phpt > ext\standard\tests\strings\crypt.phpt > ext\standard\tests\strings\str_pad_variation5.phpt > ext\standard\tests\strings\strncasecmp_variation10.phpt > ext\standard\tests\strings\strncasecmp_variation11.phpt > ext\standard\tests\strings\strncasecmp_variation4.phpt > ext\standard\tests\strings\strncmp_variation4.phpt > ext\tokenizer\tests\bug60097.phpt > ext\wddx\tests\bug48562.phpt > ext\zlib\tests\bug67724.phpt > ext\zlib\tests\gzclose_basic.phpt > ext\zlib\tests\gzeof_variation1.phpt > ; > ; might expect phpng to break these > tests\basic\024.phpt > tests\basic\026.phpt > tests\classes\inheritance_007. > phpt > tests\func\005a.phpt > tests\lang\foreachLoop.013.phpt > tests\lang\foreachLoop.014.phpt > tests\lang\foreachLoop.015.phpt > tests\lang\func_get_arg.001.phpt > tests\lang\func_get_args.004.phpt >