Trying today, the roles of the machines have reversed; the one failing on Friday passed today and vice versa. The passing test:
``` $ time go test -test.short cmd/go ok cmd/go 339.070s real 5m45.804s user 1m38.821s sys 0m49.390s ``` The version is a lie - there is a change to malloc.go increasing the heap size to 1TiB, but no other change and without that change I have seen the same behaviour. (I have had a response from one of the admins and the head is a VM where there may be fs contention - the time result below supports this). The failing test (time:real 10m43.407s user 0m42.286s sys 8m9.984s): ``` $ time go test -test.short cmd/go SIGQUIT: quit PC=0x45f6b1 m=0 sigcode=0 goroutine 0 [idle]: runtime.futex(0xba3190, 0x0, 0x0, 0x0, 0x0, 0xc840501800, 0x0, 0x0, 0x7ffd8e883ac8, 0x410f0b, ...) /home/user/go/src/runtime/sys_linux_amd64.s:438 +0x21 runtime.futexsleep(0xba3190, 0xc800000000, 0xffffffffffffffff) /home/user/go/src/runtime/os_linux.go:45 +0x62 runtime.notesleep(0xba3190) /home/user/go/src/runtime/lock_futex.go:151 +0x9b runtime.stopm() /home/user/go/src/runtime/proc.go:1670 +0xe5 runtime.findrunnable(0xc84002a600, 0x0) /home/user/go/src/runtime/proc.go:2125 +0x4d2 runtime.schedule() /home/user/go/src/runtime/proc.go:2245 +0x12c runtime.park_m(0xc8400ad380) /home/user/go/src/runtime/proc.go:2308 +0xb6 runtime.mcall(0x7ffd8e883c60) /home/user/go/src/runtime/asm_amd64.s:286 +0x5b goroutine 1 [chan receive]: testing.(*T).Run(0xc84021e000, 0x9235ca, 0x18, 0x94c240, 0x48f001) /home/user/go/src/testing/testing.go:790 +0x2fc testing.runTests.func1(0xc84021e000) /home/user/go/src/testing/testing.go:1004 +0x64 testing.tRunner(0xc84021e000, 0xc840193b80) /home/user/go/src/testing/testing.go:746 +0xd0 testing.runTests(0xc84013ea60, 0xb9ec40, 0xd7, 0xd7, 0x925e95) /home/user/go/src/testing/testing.go:1002 +0x2d8 testing.(*M).Run(0xc840071f18, 0x4) /home/user/go/src/testing/testing.go:921 +0x111 cmd/go_test.TestMain(0xc840193f18) /home/user/go/src/cmd/go/go_test.go:141 +0x150 main.main() cmd/go/_test/_testmain.go:472 +0xdb goroutine 19 [syscall, 8 minutes]: os/signal.signal_recv(0x0) /home/user/go/src/runtime/sigqueue.go:131 +0xa6 os/signal.loop() /home/user/go/src/os/signal/signal_unix.go:22 +0x22 created by os/signal.init.0 /home/user/go/src/os/signal/signal_unix.go:28 +0x41 goroutine 22 [chan receive, 8 minutes]: testing.(*T).Parallel(0xc84021e0f0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f1900) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestFileLineInErrorMessages(0xc84021e0f0) /home/user/go/src/cmd/go/go_test.go:667 +0x6c testing.tRunner(0xc84021e0f0, 0x94c2d8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 23 [chan receive, 8 minutes]: testing.(*T).Parallel(0xc84021e1e0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f1a40) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestProgramNameInCrashMessages(0xc84021e1e0) /home/user/go/src/cmd/go/go_test.go:681 +0x6c testing.tRunner(0xc84021e1e0, 0x94c720) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 70 [chan receive, 8 minutes]: testing.(*T).Parallel(0xc840414000) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840418000) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoInstallRebuildsStalePackagesInOtherGOPATH(0xc84041400 0) /home/user/go/src/cmd/go/go_test.go:873 +0x7d testing.tRunner(0xc840414000, 0x94c420) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 71 [chan receive, 8 minutes]: testing.(*T).Parallel(0xc8404140f0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840418140) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoInstallDetectsRemovedFiles(0xc8404140f0) /home/user/go/src/cmd/go/go_test.go:903 +0x6c testing.tRunner(0xc8404140f0, 0x94c408) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 189 [chan receive, 8 minutes]: testing.(*T).Parallel(0xc840414780) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474b40) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestNonCanonicalImportPaths(0xc840414780) /home/user/go/src/cmd/go/go_test.go:1361 +0x6c testing.tRunner(0xc840414780, 0x94c6e0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 61 [chan receive, 8 minutes]: testing.(*T).Parallel(0xc84021e960) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8402468c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoInstallDetectsRemovedFilesInPackageMain(0xc84021e960) /home/user/go/src/cmd/go/go_test.go:972 +0x6c testing.tRunner(0xc84021e960, 0x94c400) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 473 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc840415e00) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f08c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestBinaryOnlyPackages(0xc840415e00) /home/user/go/src/cmd/go/go_test.go:3540 +0x7d testing.tRunner(0xc840415e00, 0x94c1e8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 244 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404141e0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474140) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoTestWithPackageListedMultipleTimes(0xc8404141e0) /home/user/go/src/cmd/go/go_test.go:1606 +0x6c testing.tRunner(0xc8404141e0, 0x94c4e0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 401 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc840414f00) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840475180) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestImportMain(0xc840414f00) /home/user/go/src/cmd/go/go_test.go:2818 +0x53 testing.tRunner(0xc840414f00, 0x94c538) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 231 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404961e0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840246280) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestSymlinkWarning(0xc8404961e0) /home/user/go/src/cmd/go/go_test.go:2077 +0x72 testing.tRunner(0xc8404961e0, 0x94c778) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 144 [chan receive, 8 minutes]: testing.(*T).Parallel(0xc8401f64b0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840418f00) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestPackageMainTestImportsArchiveNotBinary(0xc8401f64b0) /home/user/go/src/cmd/go/go_test.go:1423 +0x7d testing.tRunner(0xc8401f64b0, 0x94c700) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 452 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc84021eb40) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8402472c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoTestRaceFailures(0xc84021eb40) /home/user/go/src/cmd/go/go_test.go:3161 +0x57 testing.tRunner(0xc84021eb40, 0x94c4d0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 370 [chan receive, 5 minutes]: testing.(*T).Parallel(0xc8404962d0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024e140) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestCgoAsmError(0xc8404962d0) /home/user/go/src/cmd/go/go_test.go:2375 +0x51 testing.tRunner(0xc8404962d0, 0x94c228) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 245 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404142d0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474280) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoListHasAConsistentOrder(0xc8404142d0) /home/user/go/src/cmd/go/go_test.go:1616 +0x6c testing.tRunner(0xc8404142d0, 0x94c440) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 270 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404153b0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8404757c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoTestDashOWritesBinary(0xc8404153b0) /home/user/go/src/cmd/go/go_test.go:1902 +0x6c testing.tRunner(0xc8404153b0, 0x94c490) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 246 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404143c0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8404743c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoListStdDoesNotIncludeCommands(0xc8404143c0) /home/user/go/src/cmd/go/go_test.go:1628 +0x6c testing.tRunner(0xc8404143c0, 0x94c450) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 247 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404144b0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474500) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoListCmdOnlyShowsCommands(0xc8404144b0) /home/user/go/src/cmd/go/go_test.go:1636 +0x6f testing.tRunner(0xc8404144b0, 0x94c430) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 251 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840414690) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474780) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestUnsuccessfulGoInstallShouldMentionMissingPackage(0xc840 414690) /home/user/go/src/cmd/go/go_test.go:1664 +0x6c testing.tRunner(0xc840414690, 0x94c7b8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 253 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840414960) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474a00) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestMultipleGOPATHEntriesReportedSeparately(0xc840414960) /home/user/go/src/cmd/go/go_test.go:1684 +0x7d testing.tRunner(0xc840414960, 0x94c6c0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 252 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840414870) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8404748c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGOROOTSearchFailureReporting(0xc840414870) /home/user/go/src/cmd/go/go_test.go:1674 +0x72 testing.tRunner(0xc840414870, 0x94c2e0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 254 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840414a50) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474c80) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestMentionGOPATHInFirstGOPATHEntry(0xc840414a50) /home/user/go/src/cmd/go/go_test.go:1697 +0x80 testing.tRunner(0xc840414a50, 0x94c6a8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 255 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840414b40) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474dc0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestMentionGOPATHNotOnSecondEntry(0xc840414b40) /home/user/go/src/cmd/go/go_test.go:1710 +0x80 testing.tRunner(0xc840414b40, 0x94c6b0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 256 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840414c30) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840474f00) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestDefaultGOPATH(0xc840414c30) /home/user/go/src/cmd/go/go_test.go:1733 +0x6c testing.tRunner(0xc840414c30, 0x94c2a0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 262 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840414ff0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8404752c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestLdflagsArgumentsWithSpacesIssue3941(0xc840414ff0) /home/user/go/src/cmd/go/go_test.go:1840 +0x6c testing.tRunner(0xc840414ff0, 0x94c608) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 269 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404152c0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840475680) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoTestDashCDashOControlsBinaryLocation(0xc8404152c0) /home/user/go/src/cmd/go/go_test.go:1893 +0x6c testing.tRunner(0xc8404152c0, 0x94c480) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 271 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404154a0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840475900) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoTestDashIDashOWritesBinary(0xc8404154a0) /home/user/go/src/cmd/go/go_test.go:1911 +0x6c testing.tRunner(0xc8404154a0, 0x94c488) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 229 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc840496000) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840246000) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestInstallWithTags(0xc840496000) /home/user/go/src/cmd/go/go_test.go:2004 +0x6c testing.tRunner(0xc840496000, 0x94c568) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 230 [chan receive, 7 minutes]: testing.(*T).Parallel(0xc8404960f0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840246140) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestCaseCollisions(0xc8404960f0) /home/user/go/src/cmd/go/go_test.go:2031 +0x7d testing.tRunner(0xc8404960f0, 0x94c220) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 429 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc840496a50) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024f040) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoInstallPkgdir(0xc840496a50) /home/user/go/src/cmd/go/go_test.go:3123 +0x53 testing.tRunner(0xc840496a50, 0x94c418) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 512 [chan receive]: testing.(*T).Parallel(0xc8401f6960) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024e780) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestDuplicateGlobalAsmSymbols(0xc8401f6960) /home/user/go/src/cmd/go/go_test.go:3954 +0x81 testing.tRunner(0xc8401f6960, 0x94c2b0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 511 [chan receive]: testing.(*T).Parallel(0xc8401f6870) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024e640) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestFFLAGS(0xc8401f6870) /home/user/go/src/cmd/go/go_test.go:3924 +0x7b testing.tRunner(0xc8401f6870, 0x94c2c8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 372 [chan receive, 5 minutes]: testing.(*T).Parallel(0xc8404964b0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024e280) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestCgoShowsFullPathNames(0xc8404964b0) /home/user/go/src/cmd/go/go_test.go:2415 +0x7b testing.tRunner(0xc8404964b0, 0x94c258) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 361 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc84021e5a0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840246c80) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoGenerateEnv(0xc84021e5a0) /home/user/go/src/cmd/go/go_test.go:2703 +0x7d testing.tRunner(0xc84021e5a0, 0x94c350) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 518 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc8401f62d0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840418a00) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestCgoConsistentResults(0xc8401f62d0) /home/user/go/src/cmd/go/go_test.go:3484 +0x8c testing.tRunner(0xc8401f62d0, 0x94c230) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 474 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc840415ef0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f0a00) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestAlwaysLinkSysoFiles(0xc840415ef0) /home/user/go/src/cmd/go/go_test.go:3621 +0x6c testing.tRunner(0xc840415ef0, 0x94c1a8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 434 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc8404150e0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840475400) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestImportLocal(0xc8404150e0) /home/user/go/src/cmd/go/go_test.go:2906 +0x53 testing.tRunner(0xc8404150e0, 0x94c530) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 373 [chan receive, 5 minutes]: testing.(*T).Parallel(0xc8404965a0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024e3c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestCgoHandlesWlORIGIN(0xc8404965a0) /home/user/go/src/cmd/go/go_test.go:2432 +0x7b testing.tRunner(0xc8404965a0, 0x94c248) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 374 [chan receive, 5 minutes]: testing.(*T).Parallel(0xc840496690) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024e500) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestCgoPkgConfig(0xc840496690) /home/user/go/src/cmd/go/go_test.go:2448 +0x8c testing.tRunner(0xc840496690, 0x94c250) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 386 [chan receive, 5 minutes]: testing.(*T).Parallel(0xc8401f60f0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.TestListTemplateContextFunction(0xc8401f60f0) /home/user/go/src/cmd/go/go_test.go:2523 +0x43 testing.tRunner(0xc8401f60f0, 0x94c618) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 303 [chan receive, 5 minutes]: testing.(*T).Parallel(0xc84021e3c0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840246500) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestBuildDashIInstallsDependencies(0xc84021e3c0) /home/user/go/src/cmd/go/go_test.go:2580 +0x6c testing.tRunner(0xc84021e3c0, 0x94c1f8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 588 [chan receive]: testing.(*T).Parallel(0xc8401f6ff0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024f180) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestNeedVersion(0xc8401f6ff0) /home/user/go/src/cmd/go/go_test.go:4102 +0x6c testing.tRunner(0xc8401f6ff0, 0x94c6c8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 564 [chan receive]: testing.(*T).Parallel(0xc8403604b0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f1180) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestLinkXImportPathEscape(0xc8403604b0) /home/user/go/src/cmd/go/go_test.go:3853 +0x7d testing.tRunner(0xc8403604b0, 0x94c610) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 517 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc8401f61e0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8404188c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestParallelTest(0xc8401f61e0) /home/user/go/src/cmd/go/go_test.go:3454 +0x42 testing.tRunner(0xc8401f61e0, 0x94c710) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 475 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc840360000) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f0b40) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGenerateUsesBuildContext(0xc840360000) /home/user/go/src/cmd/go/go_test.go:3647 +0x6c testing.tRunner(0xc840360000, 0x94c2e8) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 477 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc8403601e0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f0dc0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestGoEnv(0xc8403601e0) /home/user/go/src/cmd/go/go_test.go:3693 +0x42 testing.tRunner(0xc8403601e0, 0x94c340) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 524 [chan receive, 3 minutes]: testing.(*T).Parallel(0xc8401f6780) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc840418dc0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestMatchesNoTestsDoesNotOverrideBuildFailure(0xc8401f6780) /home/user/go/src/cmd/go/go_test.go:3732 +0x6c testing.tRunner(0xc8401f6780, 0x94c668) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 566 [chan receive]: testing.(*T).Parallel(0xc840360690) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f1400) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestConcurrentAsm(0xc840360690) /home/user/go/src/cmd/go/go_test.go:3882 +0x6c testing.tRunner(0xc840360690, 0x94c260) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 565 [chan receive]: testing.(*T).Parallel(0xc8403605a0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc8400f12c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestLdBindNow(0xc8403605a0) /home/user/go/src/cmd/go/go_test.go:3872 +0x6c testing.tRunner(0xc8403605a0, 0x94c600) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 589 [chan receive]: testing.(*T).Parallel(0xc8401f70e0) /home/user/go/src/testing/testing.go:677 +0x127 cmd/go_test.(*testgoData).parallel(0xc84024f2c0) /home/user/go/src/cmd/go/go_test.go:218 +0x382 cmd/go_test.TestUserOverrideFlags(0xc8401f70e0) /home/user/go/src/cmd/go/go_test.go:4123 +0x7b testing.tRunner(0xc8401f70e0, 0x94c7c0) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 590 [syscall]: syscall.Syscall6(0xf7, 0x1, 0x3b7b, 0xc840395ab0, 0x1000004, 0x0, 0x0, 0x0, 0x0, 0x0) /home/user/go/src/syscall/asm_linux_amd64.s:44 +0x5 os.(*Process).blockUntilWaitable(0xc8403a4a20, 0xc8403a4a20, 0x0, 0x0) /home/user/go/src/os/wait_waitid.go:31 +0xa5 os.(*Process).wait(0xc8403a4a20, 0xc84000dba0, 0xc8402e6bd8, 0x1) /home/user/go/src/os/exec_unix.go:22 +0x42 os.(*Process).Wait(0xc8403a4a20, 0x0, 0x0, 0x94d070) /home/user/go/src/os/exec.go:115 +0x2b os/exec.(*Cmd).Wait(0xc8402e6b00, 0x0, 0x0) /home/user/go/src/os/exec/exec.go:446 +0x62 os/exec.(*Cmd).Run(0xc8402e6b00, 0x23, 0xc840067550) /home/user/go/src/os/exec/exec.go:289 +0x5c cmd/go_test.(*testgoData).doRun(0xc84024f400, 0xc840067550, 0x1, 0x1, 0x0, 0x917768) /home/user/go/src/cmd/go/go_test.go:317 +0x425 cmd/go_test.(*testgoData).run(0xc84024f400, 0xc840067550, 0x1, 0x1) /home/user/go/src/cmd/go/go_test.go:332 +0x5c cmd/go_test.TestCgoFlagContainsSpace(0xc8401f71d0) /home/user/go/src/cmd/go/go_test.go:4190 +0x34d testing.tRunner(0xc8401f71d0, 0x94c240) /home/user/go/src/testing/testing.go:746 +0xd0 created by testing.(*T).Run /home/user/go/src/testing/testing.go:789 +0x2de goroutine 591 [IO wait]: internal/poll.runtime_pollWait(0x7fee225b3f70, 0x72, 0x1) /home/user/go/src/runtime/netpoll.go:173 +0x57 internal/poll.(*pollDesc).wait(0xc8402f3dc8, 0x72, 0xffffffffffffff01, 0xb5f2e0, 0xb5b568) /home/user/go/src/internal/poll/fd_poll_runtime.go:85 +0xae internal/poll.(*pollDesc).waitRead(0xc8402f3dc8, 0xc840308801, 0x200, 0x200) /home/user/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d internal/poll.(*FD).Read(0xc8402f3db0, 0xc840308800, 0x200, 0x200, 0x0, 0x0, 0x0) /home/user/go/src/internal/poll/fd_unix.go:125 +0x18a os.(*File).read(0xc84000e478, 0xc840308800, 0x200, 0x200, 0x0, 0xc84043a5e8, 0x4e394b) /home/user/go/src/os/file_unix.go:216 +0x4e os.(*File).Read(0xc84000e478, 0xc840308800, 0x200, 0x200, 0x0, 0xc84043a678, 0x4ccbe6) /home/user/go/src/os/file.go:103 +0x6d bytes.(*Buffer).ReadFrom(0xc84024f460, 0xb5dde0, 0xc84000e478, 0x7fee225b8058, 0xc84024f460, 0xc84043a701) /home/user/go/src/bytes/buffer.go:209 +0x177 io.copyBuffer(0xb5cd20, 0xc84024f460, 0xb5dde0, 0xc84000e478, 0x0, 0x0, 0x0, 0xc8401ea088, 0x3, 0x87b9c0) /home/user/go/src/io/io.go:386 +0x2bb io.Copy(0xb5cd20, 0xc84024f460, 0xb5dde0, 0xc84000e478, 0x1a48a5bc00000008, 0x59d2d3c9, 0xc84043a798) /home/user/go/src/io/io.go:362 +0x68 os/exec.(*Cmd).writerDescriptor.func1(0x4f6b20, 0xc8401f71d0) /home/user/go/src/os/exec/exec.go:264 +0x4d os/exec.(*Cmd).Start.func1(0xc8402e6b00, 0xc84000dbe0) /home/user/go/src/os/exec/exec.go:380 +0x27 created by os/exec.(*Cmd).Start /home/user/go/src/os/exec/exec.go:379 +0x646 goroutine 592 [IO wait]: internal/poll.runtime_pollWait(0x7fee225b3df0, 0x72, 0x1) /home/user/go/src/runtime/netpoll.go:173 +0x57 internal/poll.(*pollDesc).wait(0xc8402f3e68, 0x72, 0xffffffffffffff01, 0xb5f2e0, 0xb5b568) /home/user/go/src/internal/poll/fd_poll_runtime.go:85 +0xae internal/poll.(*pollDesc).waitRead(0xc8402f3e68, 0xc840308a01, 0x200, 0x200) /home/user/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d internal/poll.(*FD).Read(0xc8402f3e50, 0xc840308a00, 0x200, 0x200, 0x0, 0x0, 0x0) /home/user/go/src/internal/poll/fd_unix.go:125 +0x18a os.(*File).read(0xc84000e490, 0xc840308a00, 0x200, 0x200, 0x0, 0xc8400535e8, 0x4e394b) /home/user/go/src/os/file_unix.go:216 +0x4e os.(*File).Read(0xc84000e490, 0xc840308a00, 0x200, 0x200, 0xc8400536c0, 0x53e793, 0xc8400536a0) /home/user/go/src/os/file.go:103 +0x6d bytes.(*Buffer).ReadFrom(0xc84024f4c8, 0xb5dde0, 0xc84000e490, 0x7fee225b8058, 0xc84024f4c8, 0x101) /home/user/go/src/bytes/buffer.go:209 +0x177 io.copyBuffer(0xb5cd20, 0xc84024f4c8, 0xb5dde0, 0xc84000e490, 0x0, 0x0, 0x0, 0xf, 0xc840053798, 0x821adc) /home/user/go/src/io/io.go:386 +0x2bb io.Copy(0xb5cd20, 0xc84024f4c8, 0xb5dde0, 0xc84000e490, 0x266516700000008, 0x59d2d371, 0xc840053798) /home/user/go/src/io/io.go:362 +0x68 os/exec.(*Cmd).writerDescriptor.func1(0x4f6b20, 0xc84021f0e0) /home/user/go/src/os/exec/exec.go:264 +0x4d os/exec.(*Cmd).Start.func1(0xc8402e6b00, 0xc84000dc20) /home/user/go/src/os/exec/exec.go:380 +0x27 created by os/exec.(*Cmd).Start /home/user/go/src/os/exec/exec.go:379 +0x646 rax 0xca rbx 0xba3080 rcx 0xffffffffffffffff rdx 0x0 rdi 0xba3190 rsi 0x0 rbp 0x7ffd8e883a90 rsp 0x7ffd8e883a48 r8 0x0 r9 0x0 r10 0x0 r11 0x286 r12 0x0 r13 0x0 r14 0x45cf20 r15 0x0 rip 0x45f6b1 rflags 0x286 cs 0x33 fs 0x0 gs 0x0 *** Test killed with quit: ran too long (10m0s). FAIL cmd/go 600.017s real 10m43.407s user 0m42.286s sys 8m9.984s ``` On Fri, 2017-09-29 at 06:52 -0700, Ian Lance Taylor wrote: > On Thu, Sep 28, 2017 at 10:12 PM, Dan Kortschak > <dan.kortsc...@adelaide.edu.au> wrote: > > > > > > I have just tried replicating the issue today and this time, one > > machine passes everything, while the other does not. I am beginning > > to > > suspect that file system loads may be a possible cause (the head > > node > > is quiet, but the file system is shared across many nodes in both > > cases). > > > > The newer machine is 3.10.0-514.2.2.el7.x86_64 (also RHEL7). > > > > I will raise this internally and get back to the issue if they > > don't > > think this is the case. Unfortunately the two machines are under > > different management, so it may be difficult to get a clear idea of > > what's going on. > > > > There are a variety of test goroutines in the stack trace (as is > > the > > case with the original) the test you point out is not consistently > > in > > the stack trace for either version. The stack trace for 1.8.3 is > > pasted > > below. > > > > Running `go test -cpuprofile errors.prof -o myerrors.test errors` > > passes without event. > In the stack trace you just posted the failing test is > TestTestRaceInstall. > > What happens if you run simply `go test -test.short cmd/go`? If it > passes, how long does it take? > > Ian -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.