Hello,
Here is a part of the log:
2015-01-28 10:00:54,046 WARN [c.c.u.d.Merovingian2]
(Work-Job-Executor-138:ctx-90c00639 job-2709/job-2710 ctx-08257b85) Was
unable
to find lock for the key template_spool_ref70 and thread id 1503363977
2015-01-28 10:00:54,046 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-138:ctx-90c00639 job-2709/job-2710 ctx-08257b85) Una
ble to create Vol[263|vm=199|ROOT]:Unable to copy template to primary
storage due to exception:Exception: java.lang.Exception
Message: File upload task failed to complete due to: Error writing request
body to server
2015-01-28 10:00:54,046 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-138:ctx-90c00639 job-2709/job-2710 ctx-08257b85)
Unable to contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is
unreachable: Unable to create Vol[263|vm=199|ROOT]:Unab
le to copy template to primary storage due to exception:Exception:
java.lang.Exception
Message: File upload task failed to complete due to: Error writing request
body to server
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume
(VolumeOrchestrator.java:1205)
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(Volume
Orchestrator.java:1257)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManage
rImpl.java:988)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManage
rImpl.java:5195)
at sun.reflect.GeneratedMethodAccessor568.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.jav
a:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManager
Impl.java:5340)
at
com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext
(AsyncJobManagerImpl.java:503)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedCo
ntextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(Defa
ultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithCon
text(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithCont
ext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedCont
extRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJob
ManagerImpl.java:460)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
45)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15)
at java.lang.Thread.run(Thread.java:745)
2015-01-28 10:00:54,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-138:ctx-90c00639 job-2709/job-2710 ctx-08257b85)
Cleaning up resources for the vm VM[User|i-15-199-VM] in Starting state
2015-01-28 10:00:54,056 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-138:ctx-90c00639 job-2709/job-2710 ctx-08257b85) Seq
1-1339820889
142821334: Sending { Cmd , MgmtId: 52239450489, via: 1(172.28.52.4), Ver:
v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"
isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName"
:"i-15-199-VM","wait":0}}] }
2015-01-28 10:00:54,056 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-138:ctx-90c00639 job-2709/job-2710 ctx-08257b85) Seq
1-1339820889
142821334: Executing: { Cmd , MgmtId: 52239450489, via: 1(172.28.52.4),
Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand"
:{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmNa
me":"i-15-199-VM","wait":0}}] }
2015-01-28 10:00:54,057 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-49:ctx-44763cb1) Seq 1-1339820889142821334: Executing reques
t
2015-01-28 10:00:54,057 INFO [c.c.h.v.r.VmwareResource]
(DirectAgent-49:ctx-44763cb1 172.28.52.4) Executing resource StopCommand: {
"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName
":"i-15-199-VM","wait":0}
2015-01-28 10:00:54,118 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-15:null) SeqA 3-199070: Processing Seq 3-199070: { C
md , MgmtId: -1, via: 3, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_load
Info":"{\n
\"connections\": []\n}","wait":0}}] }
2015-01-28 10:00:54,123 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-15:null) SeqA 3-199070: Sending Seq 3-199070: { Ans:
, MgmtId: 52239450489, via: 3, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-01-28 10:00:54,139 DEBUG [c.c.h.v.m.HostMO]
(DirectAgent-49:ctx-44763cb1 172.28.52.4) find VM i-15-199-VM on host