Permanently failing bots are way better that 50/50 flaky bots, but still not good. As for the sanitizer-x86_64-linux-bootstrap, it shows some legitimate failures in different parts of llvm that no one bothered to fix. That's kinda understandable because MSan failures are hard to reproduce locally (one needs to do a full bootstrap, including libc++/libc++abi built w/ MSan), and FileCheck tends to show only part of the report.
On Wed, Nov 18, 2015 at 10:43 AM, Aaron Ballman via llvm-commits <llvm-comm...@lists.llvm.org> wrote: > On Wed, Nov 18, 2015 at 1:40 PM, Galina Kistanova via cfe-commits > <cfe-comm...@lists.llvm.org> wrote: >> Hello everyone, >> >> Here are some buildbot statistics you may found interesting. I will be >> adding more statistics. >> My goal is to publish metrics to help with keeping the buildbot >> infrastructure healthy and improving it. > > Thank you for tracking and reporting this information, that's fantastic! > >> >> All the numbers are for the week of 11/8/2015 - 11/14/2015. >> >> Thanks >> >> Galina >> >> >> >> Number of commits by project: >> >> project | commits >> ----------------------------------------- >> llvm | 286 >> cfe | 109 >> lldb | 76 >> compiler-rt | 71 >> polly | 42 >> lld | 38 >> libcxx | 10 >> openmp | 9 >> clang-tools-extra | 7 >> clang-tests-external | 2 >> libunwind | 1 >> ----------------------------------------- >> 651 >> >> >> Number of completed builds, failed builds and average build time for >> successful builds per active builder: >> >> buildername | completed | >> failed | time >> ----------------------------------------------------------------------------------------------------- >> clang-aarch64-lnt | 57 | >> 3 | 02:30:12 >> clang-atom-d525-fedora | 18 | >> | 08:28:15 >> clang-atom-d525-fedora-rel | 83 | >> 5 | 01:29:55 >> clang-bpf-build | 310 | >> 31 | 00:02:53 >> clang-cmake-aarch64-42vma | 278 | >> 49 | 00:16:47 >> clang-cmake-aarch64-quick | 209 | >> 29 | 00:23:46 >> clang-cmake-armv7-a15 | 189 | >> 8 | 00:25:27 >> clang-cmake-armv7-a15-full | 154 | >> 38 | 00:45:32 >> clang-cmake-armv7-a15-selfhost | 58 | >> 24 | 03:00:19 >> clang-cmake-armv7-a15-selfhost-neon | 45 | >> 22 | 04:26:31 >> clang-cmake-mips | 186 | >> 38 | 00:28:52 >> clang-cmake-thumbv7-a15 | 178 | >> 7 | 00:28:30 >> clang-cmake-thumbv7-a15-full-sh | 32 | >> 23 | 06:03:05 >> clang-hexagon-elf | 169 | >> 23 | 00:24:42 >> clang-native-aarch64-full | 24 | >> 8 | 05:53:35 >> clang-native-arm-lnt | 90 | >> 3 | 01:06:01 >> clang-native-arm-lnt-perf | 14 | >> | 08:57:04 >> clang-ppc64-elf-linux | 120 | >> 6 | 01:01:02 >> clang-ppc64-elf-linux2 | 89 | >> 24 | 01:29:49 >> clang-sphinx-docs | 113 | >> | 00:00:20 >> clang-x64-ninja-win7 | 285 | >> 58 | 00:09:49 >> clang-x86-win2008-selfhost | 268 | >> 46 | 00:12:10 >> clang-x86_64-darwin13-cross-arm | 232 | >> 1 | 00:19:45 >> clang-x86_64-darwin13-cross-mingw32 | 217 | >> 12 | 00:23:20 >> clang-x86_64-debian-fast | 147 | >> 12 | 00:11:37 >> clang-x86_64-linux-abi-test | 314 | >> 1 | 00:18:39 >> clang-x86_64-linux-selfhost-modules | 261 | >> 25 | 00:15:02 >> clang-x86_64-ubuntu-gdb-75 | 124 | >> 62 | 00:53:12 >> libcxx-libcxxabi-arm-linux | 8 | >> | 01:05:10 >> libcxx-libcxxabi-singlethreaded-x86_64-linux-debian | 11 | >> 2 | 00:08:50 >> libcxx-libcxxabi-x86_64-linux-debian | 11 | >> 4 | 00:09:43 >> libcxx-libcxxabi-x86_64-linux-debian-noexceptions | 5 | >> 2 | 00:09:24 >> libcxx-libcxxabi-x86_64-linux-ubuntu-asan | 10 | >> 2 | 00:08:22 >> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx03 | 10 | >> | 00:05:12 >> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx11 | 10 | >> | 00:06:19 >> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx14 | 9 | >> | 00:06:56 >> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx1z | 10 | >> 2 | 00:06:06 >> libcxx-libcxxabi-x86_64-linux-ubuntu-msan | 10 | >> 2 | 00:17:00 >> libcxx-libcxxabi-x86_64-linux-ubuntu-tsan | 10 | >> 1 | 00:14:03 >> libcxx-libcxxabi-x86_64-linux-ubuntu-unstable-abi | 10 | >> 2 | 00:06:28 >> libcxx-sphinx-docs | 11 | >> | 00:00:13 >> libomp-clang-x86_64-linux-debian | 3 | >> 3 | >> libomp-gcc-x86_64-linux-debian | 3 | >> 3 | >> lld-sphinx-docs | 100 | >> | 00:00:17 >> lld-x86_64-darwin13 | 250 | >> 23 | 00:10:37 >> lld-x86_64-freebsd | 152 | >> 2 | 00:38:06 >> lld-x86_64-win7 | 254 | >> 4 | 00:08:51 >> lldb-windows7-android | 109 | >> 76 | 01:10:59 >> lldb-x86-win7-msvc | 300 | >> 46 | 00:09:28 >> lldb-x86-windows-msvc | 244 | >> 40 | 00:18:18 >> lldb-x86_64-darwin-13.4 | 141 | >> 43 | 00:50:44 >> lldb-x86_64-debian-clang | 142 | >> 142 | >> lldb-x86_64-ubuntu-14.04-android | 123 | >> 33 | 01:00:35 >> lldb-x86_64-ubuntu-14.04-buildserver | 146 | >> 2 | 00:48:29 >> lldb-x86_64-ubuntu-14.04-cmake | 228 | >> 39 | 00:24:49 >> lldb-x86_64-ubuntu-14.10 | 191 | >> 191 | >> llvm-aarch64-linux | 110 | >> 6 | 01:00:32 >> llvm-clang-lld-x86_64-debian-fast | 189 | >> 189 | >> llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast | 386 | >> 24 | 00:03:22 >> llvm-hexagon-elf | 190 | >> 16 | 00:10:08 >> llvm-mips-linux | 29 | >> 2 | 05:01:59 >> llvm-ppc64-linux1 | 126 | >> 6 | 00:48:28 >> llvm-ppc64-linux2 | 128 | >> 6 | 00:48:01 >> llvm-s390x-linux1 | 5 | >> 3 | 00:37:12 >> llvm-sphinx-docs | 95 | >> 27 | 00:00:19 >> perf-x86_64-penryn-O3 | 26 | >> 1 | 05:49:03 >> perf-x86_64-penryn-O3-polly | 73 | >> | 05:46:16 >> perf-x86_64-penryn-O3-polly-before-vectorizer | 15 | >> 14 | >> perf-x86_64-penryn-O3-polly-before-vectorizer-detect-only | 16 | >> | 05:07:41 >> perf-x86_64-penryn-O3-polly-fast | 309 | >> 13 | 00:09:45 >> perf-x86_64-penryn-O3-polly-parallel-fast | 189 | >> 11 | 00:11:38 >> perf-x86_64-penryn-O3-polly-unprofitable | 195 | >> 139 | 00:12:23 >> polly-amd64-linux | 238 | >> 2 | 00:11:13 >> ppc64le-clang | 41 | >> 13 | 03:25:53 >> ppc64le-clanglnt | 67 | >> 2 | 02:02:39 >> ppc64le-llvm | 74 | >> 3 | 01:47:07 >> sanitizer-ppc64-linux1 | 173 | >> 38 | 00:40:18 >> sanitizer-ppc64le-linux | 146 | >> 28 | 00:51:50 >> sanitizer-windows | 382 | >> 341 | 00:04:20 >> sanitizer-x86_64-linux | 101 | >> 53 | 01:30:13 >> sanitizer-x86_64-linux-autoconf | 335 | >> 252 | 00:10:01 >> sanitizer-x86_64-linux-bootstrap | 92 | >> 92 | >> sanitizer-x86_64-linux-fast | 272 | >> 272 | >> sanitizer-x86_64-linux-fuzzer | 180 | >> 47 | 00:45:34 >> sanitizer_x86_64-freebsd | 54 | >> 54 | > > There are definitely some worrying statistics in here, such as the > bots that seem to have failed all week long on everything: > > lldb-x86_64-debian-clang | > 142 | 142 | > llvm-clang-lld-x86_64-debian-fast | > 189 | 189 | > sanitizer-x86_64-linux-bootstrap | > 92 | 92 | > sanitizer-x86_64-linux-fast | > 272 | 272 | > > ~Aaron > _______________________________________________ > llvm-commits mailing list > llvm-comm...@lists.llvm.org > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits _______________________________________________ lldb-commits mailing list lldb-commits@lists.llvm.org http://lists.llvm.org/cgi-bin/mailman/listinfo/lldb-commits
