Am 27.10.2015 um 11:15 schrieb Kornel Benko <kor...@lyx.org>: > Am Dienstag, 27. Oktober 2015 um 10:46:58, schrieb Stephan Witt > <st.w...@gmx.net> >> Am 27.10.2015 um 10:13 schrieb Kornel Benko <kor...@lyx.org>: >> >>> Am Dienstag, 27. Oktober 2015 um 00:48:44, schrieb Stephan Witt >>> <st.w...@gmx.net> >>>> Am 26.10.2015 um 12:18 schrieb Kornel Benko <kor...@lyx.org>: >>>> >>>>> Am Montag, 26. Oktober 2015 um 11:43:07, schrieb Stephan Witt >>>>> <st.w...@gmx.net> >>>>>> Am 26.10.2015 um 09:46 schrieb Kornel Benko <kor...@lyx.org>: >>>>>> >>>>>>> They are started, because otherwise you would not see 'out of 199'. >>>>>>> What was your exact test command? >>>>>> >>>>>> This is the command: >>>>>> >>>>>> $ (cd /Users/stephan/git/lyx-build/cmake/2.2.0dev;ctest -C Debug) >>>>> >>>>> Wow ... never used it this way ... >>>>> But then I wonder, why only 199 tests ... >>>>> Apparently you have not configured cmake for export tests (cmake ... >>>>> -DLYX_ENABLE_EXPORT_TESTS=ON …) >>>> >>>> Yes, this make a huge difference - now I've 4621 tests to run :) >>> >>> :) >>> >>>> After 11 hours I'm at test 1405 of 4621… (running with one job at a time). >> >> The result is: >> >> 79% tests passed, 954 tests failed out of 4621 >> >> Label Time Summary: >> cmplyx = 214.12 sec >> export = 72802.49 sec >> layout = 94.51 sec >> load = 700.28 sec >> lyx2lyx = 67.98 sec >> module = 9.83 sec >> reverted = 19013.35 sec >> roundtrip = 186.85 sec >> >> Total Test time (real) = 74085.89 sec >> >>> For that many export tests, I would use 'ctest -j8' (in case you have >>> multiple cores). >>> I normally run 'ctest -j12 -R "export.*pdf"'. Having 8 cores makes the run >>> significantly faster. >> >> Yes, I understood this. But for the first try I didn't want to run it in >> parallel. >> I've observed that e.g. kpsewhich is used heavily while testing and one call >> took ~10ms. >> Perhaps there is some tuning possible? But I'd guess, there is a significant >> overhead >> for the first time to generate all the required pieces like compiled fonts >> etc. >> To check this now I'm starting the test again. >> >>> >>> Some tests may fail because of this parallel handling (I did not found why >>> yet), so I repeat >>> the failed tests without the '-j12' param with the command 'ctest >>> --rerun-failed'. >> >> 1st question: wouldn't it be useful to split the tests into groups and >> enable the tests which should pass on a basic system automatically? >> How could this be done? I don't think it's good to have to enable the >> export tests explicitly. > > Enabling the export tests increase the configuration time ..., so it felt > reasonable to set the > default to OFF. > And not 'many' developers tested at that time. > >> 2nd question: which tests should succeed with a "normal" TeX installation? > > 1.) Some export tests do not depend on TeX > "ctest -R 'export.*_(xhtml|lyx16)$'" > 2.) Probably you want to test TeX without system fonts > "ctest -R 'export.*_texF$'"
With $ (cd /Users/stephan/git/lyx-build/cmake/2.2.0dev;ctest -C Debug -R 'export/doc/.*_texF$' -j8) I get this: 77% tests passed, 70 tests failed out of 302 Label Time Summary: export = 4782.73 sec reverted = 538.92 sec Total Test time (real) = 612.37 sec One interesting example of a failure is as follows: ====== 350/4621 Testing: export/doc/Math_pdf4_texF 350/4621 Test: export/doc/Math_pdf4_texF Command: "/opt/local/bin/cmake" "-DLYX_ROOT=/Users/stephan/git/lyx/lib/doc" "-DLYX_TESTS_USERDIR=/Users/stephan/git/lyx-build/cmake/2.2.0dev/Testing/.lyx" "-Dlyx=/Users/stephan/g it/lyx-build/cmake/2.2.0dev/bin/Debug/LyX" "-DWORKDIR=/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home" "-Dformat=pdf4" "-Dfonttype=texF" "-Dextension=pdf4" "-Dfile =Math" "-Dreverted=0" "-DTOP_SRC_DIR=/Users/stephan/git/lyx" "-DPERL_EXECUTABLE=/opt/local/bin/perl" "-P" "/Users/stephan/git/lyx/development/autotests/export.cmake" Directory: /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home "export/doc/Math_pdf4_texF" start time: Oct 27 13:13 CET Output: ---------------------------------------------------------- -- using fonttype = texF -- LYX_TESTS_USERDIR = /Users/stephan/git/lyx-build/cmake/2.2.0dev/Testing/.lyx -- Converting with perl /Users/stephan/git/lyx/development/autotests/useSystemFonts.pl -- Using source "/Users/stephan/git/lyx/lib/doc/Math.lyx" -- Using dest "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/Math_pdf4_texF.lyx" Added (1) file "/Users/stephan/git/lyx/lib/doc/../images/math/phantom.png" to be copied to "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_phantom_wncljUBI.png" Added (1) file "/Users/stephan/git/lyx/lib/doc/../images/math/vphantom.png" to be copied to "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_vphantom_j7I4wBMv.png" Added (1) file "/Users/stephan/git/lyx/lib/doc/../images/math/hphantom.png" to be copied to "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_hphantom_2utyv1yY.png" Added (1) file "/Users/stephan/git/lyx/lib/doc/clipart/macrobox.png" to be copied to "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_macrobox_0NVbxYic.png" Error: New binding for 'Kontroll-T 1' is overriding old binding... Error: New binding for 'Kontroll-T 2' is overriding old binding... Error: New binding for 'Kontroll-T O' is overriding old binding... Error: New binding for 'Kontroll-T T' is overriding old binding... Error: New binding for 'Kontroll-T X' is overriding old binding... Looking for python v2.x ... Examining /Library/TeX/texbin/pythontex Examining /usr/texbin/pythontex Added (1) file "/Users/stephan/git/lyx/lib/doc/clipart/macrouse.png" to be copied to "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_macrouse_6agOqeLc.png" Added (1) file "/Users/stephan/git/lyx/lib/doc/clipart/MacroToolbar.png" to be copied to "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_MacroToolbar_OEVKjCFz.png" res1 = 1 for "/Users/stephan/git/lyx/lib/doc/Math.lyx" to be copied to /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/Math_pdf4_texF.lyx res1 = 1 for "/Users/stephan/git/lyx/lib/doc/../images/math/hphantom.png" to be copied to /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_hphantom_2utyv1yY.png res1 = 1 for "/Users/stephan/git/lyx/lib/doc/../images/math/vphantom.png" to be copied to /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_vphantom_j7I4wBMv.png res1 = 1 for "/Users/stephan/git/lyx/lib/doc/clipart/macrouse.png" to be copied to /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_macrouse_6agOqeLc.png res1 = 1 for "/Users/stephan/git/lyx/lib/doc/clipart/macrobox.png" to be copied to /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_macrobox_0NVbxYic.png res1 = 1 for "/Users/stephan/git/lyx/lib/doc/../images/math/phantom.png" to be copied to /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_phantom_wncljUBI.png res1 = 1 for "/Users/stephan/git/lyx/lib/doc/clipart/MacroToolbar.png" to be copied to /Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/tmp_pdf4_main_Math/xx_MacroToolbar_OEVKjCFz.png -- Executing /Users/stephan/git/lyx-build/cmake/2.2.0dev/bin/Debug/LyX -userdir "/Users/stephan/git/lyx-build/cmake/2.2.0dev/Testing/.lyx" -E pdf4 Math_texF.pdf4 "/Users/stephan/git/lyx-build/cmake/2.2.0dev/autotests/out-home/AbC_N1_hGi/Math_pdf4_texF.lyx" Examining /opt/local/bin/python Examining /opt/local/bin/python-config Examining /opt/local/bin/python2.7 Found Python 2.7.10 Error 92 returned from iconv when converting from UCS-4LE to ascii: Illegal byte sequence Converted input: 0x0065 0x002c 0x000a 0x0020 0x0062 0x006f 0x006f 0x006b 0x006d 0x0061 0x0072 0x006b 0x0073 0x003d 0x0074 0x0072 0x0075 0x0065 0x002c 0x0062 0x006f 0x006f 0x006b 0x006d 0x0061 0x0072 0x006b 0x0073 0x006e 0x0075 0x006d 0x0062 0x0065 0x0072 0x0065 0x0064 0x003d 0x0074 0x0072 0x0075 0x0065 0x002c 0x0062 0x006f 0x006f 0x006b 0x006d 0x0061 0x0 072 0x006b 0x0073 0x006f 0x0070 0x0065 0x006e 0x003d 0x0074 0x0072 0x0075 0x0065 0x002c 0x0062 0x006f 0x006f 0x006b 0x006d 0x0061 0x0072 0x006b 0x0073 0x006f 0x0070 0x0065 0x006e 0x006c 0x0065 0x0076 0x0065 0x006c 0x003d 0x0031 0x002c 0x000a 0x0020 0x0062 0x0072 0x0065 0x0061 0x006b 0x006c 0x0069 0x006e 0x006b 0x0073 0x003d 0x0066 0x0061 0x006c 0x0073 0x 0065 0x002c 0x0070 0x0064 0x0066 0x0062 0x006f 0x0072 0x0064 0x0065 0x0072 0x003d 0x007b 0x0030 0x0020 0x0030 0x0020 0x0031 0x007d 0x002c 0x0062 0x0061 0x0063 0x006b 0x0072 0x006 5 0x0066 0x003d 0x0066 0x0061 0x006c 0x0073 0x0065 0x002c 0x0063 0x006f 0x006c 0x006f 0x0072 0x006c 0x0069 0x006e 0x006b 0x0073 0x003d 0x0074 0x0072 0x0075 0x0065 0x005d 0x000a 0 x0020 0x007b 0x0068 0x0079 0x0070 0x0065 0x0072 0x0072 0x0065 0x0066 0x007d 0x000a 0x005c 0x0068 0x0079 0x0070 0x0065 0x0072 0x0073 0x0065 0x0074 0x0075 0x0070 0x007b 0x0070 0x00 64 0x0066 0x0074 0x0069 0x0074 0x006c 0x0065 0x003d 0x007b 0x004c 0x0079 0x0058 0x0027 0x0073 0x0020 0x004d 0x0061 0x0074 0x0068 0x0020 0x004d 0x0061 0x006e 0x0075 0x0061 0x006c 0x007d 0x002c 0x000a 0x0020 0x0070 0x0064 0x0066 0x0061 0x0075 0x0074 0x0068 0x006f 0x0072 0x003d 0x007b 0x004c 0x0079 0x0058 0x0020 0x0054 0x0065 0x0061 0x006d 0x002c 0x0020 0x0 055 0x0077 0x0065 0x0020 0x0053 0x0074 Stopped at: 0x00f6 ... File '/var/folders/1x/zm63s22x7s591xrlgm4rl9v40000gn/T/lyx_tmpdir.BtJYGWwj7493/lyx_tmpbuf0/Math_pdf4_texF.tex' was not closed properly. CMake Error at /Users/stephan/git/lyx/development/autotests/export.cmake:78 (message): Export failed <end of output> Test time = 9.82 sec ---------------------------------------------------------- Test Failed. "export/doc/Math_pdf4_texF" end time: Oct 27 13:13 CET "export/doc/Math_pdf4_texF" time elapsed: 00:00:09 ---------------------------------------------------------- ============= Stephan
