Hello builds, I am seeing channel/timeout errors from a job tied to the ubuntu group only when ubuntu1 is selected as the slave. I think this problem may have been going on for a few days.
Example stack trace below and example console urls showing the problem Would someone be able to take a look please? For instance: https://builds.apache.org/view/M-R/view/Qpid/job/Qpid-Java-Java-Test-0.16/12/console https://builds.apache.org/view/M-R/view/Qpid/job/Qpid-Java-Java-Test-0.16/10/console https://builds.apache.org/view/M-R/view/Qpid/job/Qpid-Java-Java-Test-0.16/8/console https://builds.apache.org/view/M-R/view/Qpid/job/Qpid-Java-Artefact-Release/467/console Started by timer Building remotely on ubuntu1 <https://builds.apache.org/computer/ubuntu1> in workspace /home/jenkins/jenkins-slave/workspace/Qpid-Java-Java-Test-0.16 hudson.util.IOException2: remote file operation failed: /home/jenkins/jenkins-slave/workspace/Qpid-Java-Java-Test-0.16 at hudson.remoting.Channel@22397ea8:ubuntu1 at hudson.FilePath.act(FilePath.java:838) at hudson.FilePath.act(FilePath.java:824) at hudson.FilePath.mkdirs(FilePath.java:890) at hudson.model.AbstractProject.checkout(AbstractProject.java:1243) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:589) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:494) at hudson.model.Run.execute(Run.java:1488) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:236) Caused by: hudson.remoting.ChannelClosedException: channel is already closed at hudson.remoting.Channel.send(Channel.java:492) at hudson.remoting.Request.call(Request.java:129) at hudson.remoting.Channel.call(Channel.java:663) at hudson.FilePath.act(FilePath.java:831) ... 10 more Caused by: java.io.IOException at hudson.remoting.Channel.close(Channel.java:895) at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110) at hudson.remoting.PingThread.ping(PingThread.java:114) at hudson.remoting.PingThread.run(PingThread.java:81) Caused by: java.util.concurrent.TimeoutException: Ping started on 1341557279424 hasn't completed at 1341557519424 ... 2 more Caused by: java.util.concurrent.TimeoutException at hudson.remoting.Request$1.get(Request.java:275) at hudson.remoting.Request$1.get(Request.java:210) at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59) at hudson.remoting.PingThread.ping(PingThread.java:107) ... 1 more Retrying after 10 seconds hudson.util.IOException2: remote file operation failed: /home/jenkins/jenkins-slave/workspace/Qpid-Java-Java-Test-0.16 at hudson.remoting.Channel@22397ea8:ubuntu1 at hudson.FilePath.act(FilePath.java:838) at hudson.FilePath.act(FilePath.java:824) at hudson.FilePath.mkdirs(FilePath.java:890) at hudson.model.AbstractProject.checkout(AbstractProject.java:1243) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:589) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:494) at hudson.model.Run.execute(Run.java:1488) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:236) Caused by: hudson.remoting.ChannelClosedException: channel is already closed at hudson.remoting.Channel.send(Channel.java:492) at hudson.remoting.Request.call(Request.java:129) at hudson.remoting.Channel.call(Channel.java:663) at hudson.FilePath.act(FilePath.java:831) ... 10 more Caused by: java.io.IOException at hudson.remoting.Channel.close(Channel.java:895) at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110) at hudson.remoting.PingThread.ping(PingThread.java:114) at hudson.remoting.PingThread.run(PingThread.java:81) Caused by: java.util.concurrent.TimeoutException: Ping started on 1341557279424 hasn't completed at 1341557519424 ... 2 more Caused by: java.util.concurrent.TimeoutException at hudson.remoting.Request$1.get(Request.java:275) at hudson.remoting.Request$1.get(Request.java:210) at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59) at hudson.remoting.PingThread.ping(PingThread.java:107) ... 1 more Retrying after 10 seconds hudson.util.IOException2: remote file operation failed: /home/jenkins/jenkins-slave/workspace/Qpid-Java-Java-Test-0.16 at hudson.remoting.Channel@22397ea8:ubuntu1 at hudson.FilePath.act(FilePath.java:838) at hudson.FilePath.act(FilePath.java:824) at hudson.FilePath.mkdirs(FilePath.java:890) at hudson.model.AbstractProject.checkout(AbstractProject.java:1243) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:589) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:494) at hudson.model.Run.execute(Run.java:1488) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:236) Caused by: hudson.remoting.ChannelClosedException: channel is already closed at hudson.remoting.Channel.send(Channel.java:492) at hudson.remoting.Request.call(Request.java:129) at hudson.remoting.Channel.call(Channel.java:663) at hudson.FilePath.act(FilePath.java:831) ... 10 more Caused by: java.io.IOException at hudson.remoting.Channel.close(Channel.java:895) at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110) at hudson.remoting.PingThread.ping(PingThread.java:114) at hudson.remoting.PingThread.run(PingThread.java:81) Caused by: java.util.concurrent.TimeoutException: Ping started on 1341557279424 hasn't completed at 1341557519424 ... 2 more Caused by: java.util.concurrent.TimeoutException at hudson.remoting.Request$1.get(Request.java:275) at hudson.remoting.Request$1.get(Request.java:210) at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59) at hudson.remoting.PingThread.ping(PingThread.java:107) ... 1 more Recording test results ERROR: Publisher hudson.tasks.junit.JUnitResultArchiver aborted due to exceptionhudson.remoting.ChannelClosedException <http://stacktrace.jenkins-ci.org/search?query=hudson.remoting.ChannelClosedException>: channel is already closed at hudson.remoting.Channel.send(Channel.java:492) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.send&entity=method> at hudson.remoting.Request.call(Request.java:129) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Request.call&entity=method> at hudson.remoting.Channel.call(Channel.java:663) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.call&entity=method> at hudson.EnvVars.getRemote(EnvVars.java:202) <http://stacktrace.jenkins-ci.org/search/?query=hudson.EnvVars.getRemote&entity=method> at hudson.model.Computer.getEnvironment(Computer.java:843) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Computer.getEnvironment&entity=method> at jenkins.model.CoreEnvironmentContributor.buildEnvironmentFor(CoreEnvironmentContributor.java:28) <http://stacktrace.jenkins-ci.org/search/?query=jenkins.model.CoreEnvironmentContributor.buildEnvironmentFor&entity=method> at hudson.model.Run.getEnvironment(Run.java:1938) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.getEnvironment&entity=method> at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:843) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild.getEnvironment&entity=method> at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:131) <http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.perform&entity=method> at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19) <http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.perform&entity=method> at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:717) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method> at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:692) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method> at hudson.model.Build$BuildExecution.post2(Build.java:183) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method> at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:639) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method> at hudson.model.Run.execute(Run.java:1513) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method> at hudson.model.ResourceController.execute(ResourceController.java:88) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method> at hudson.model.Executor.run(Executor.java:236) <http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method> Caused by: java.io.IOException <http://stacktrace.jenkins-ci.org/search?query=java.io.IOException> at hudson.remoting.Channel.close(Channel.java:895) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.close&entity=method> at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110) <http://stacktrace.jenkins-ci.org/search/?query=hudson.slaves.ChannelPinger$1.onDead&entity=method> at hudson.remoting.PingThread.ping(PingThread.java:114) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.PingThread.ping&entity=method> at hudson.remoting.PingThread.run(PingThread.java:81) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.PingThread.run&entity=method> Caused by: java.util.concurrent.TimeoutException <http://stacktrace.jenkins-ci.org/search?query=java.util.concurrent.TimeoutException>: Ping started on 1341557279424 hasn't completed at 1341557519424 ... 2 more Caused by: java.util.concurrent.TimeoutException <http://stacktrace.jenkins-ci.org/search?query=java.util.concurrent.TimeoutException> at hudson.remoting.Request$1.get(Request.java:275) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Request$1.get&entity=method> at hudson.remoting.Request$1.get(Request.java:210) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Request$1.get&entity=method> at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.FutureAdapter.get&entity=method> at hudson.remoting.PingThread.ping(PingThread.java:107) <http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.PingThread.ping&entity=method> ... 1 more Finished: FAILURE