If you dashboard is showing 0/0 that means the secondary storage has not been successfully added. What error do you get while adding secondary storage? Is there anything else in the logs besides the stack trace you have shared?
Regards, Devdeep > -----Original Message----- > From: Ashutosh Kelkar [mailto:ashut...@clogeny.com] > Sent: Tuesday, October 21, 2014 11:51 AM > To: cloudstack > Subject: Error while deploying System VMs > > Hello all, > > I set up CS on latest master code, and I observe error while starting the > system VMs. Also, the secondary storage is shown as 0/0 on Dashboard. I > can see the error while mounting secondary storage, could not identify the > cause. > > I have executed cloud-install-sys-tmplt command it successfully seeds the > system templates. > > Please help me in identifying the exact issue, here are the management > server logs. > > WARN [c.c.u.d.Merovingian2] (Work-Job-Executor-19:ctx-0e65266f > job-306/job-336 ctx-b37c0c6e) Was unable to find lock for the key > template_spool_ref126 and thread id 4 > 18267521 > com.cloud.utils.exception.CloudRuntimeException: Was unable to find lock > for the key template_spool_ref126 and thread id 418267521 > at com.cloud.utils.db.Merovingian2.release(Merovingian2.java:274) > at > com.cloud.utils.db.TransactionLegacy.release(TransactionLegacy.java:397) > at > com.cloud.utils.db.GenericDaoBase.releaseFromLockTable(GenericDaoBase. > java:1045) > at sun.reflect.GeneratedMethodAccessor157.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess > orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection( > AopUtils.java:317) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoi > npoint(ReflectiveMethodInvocation.java:183) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > ReflectiveMethodInvocation.java:150) > at > com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContex > tInterceptor.java:34) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > ReflectiveMethodInvocation.java:161) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(E > xposeInvocationInterceptor.java:91) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDyna > micAopProxy.java:204) > at com.sun.proxy.$Proxy73.releaseFromLockTable(Unknown Source) > at > org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImag > eAsync(VolumeServiceImpl.java:514) > at > org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFro > mTemplateAsync(VolumeServiceImpl.java:748) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateV > olume(VolumeOrchestrator.java:1227) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(V > olumeOrchestrator.java:1297) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:974) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:4600) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j > ava:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess > orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHan > dlerProxy.java:107) > at > com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachi > neManagerImpl.java:4756) > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:10 > 2) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn > Context(AsyncJobManagerImpl.java:513) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca > ll(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call > WithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.run > WithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Ma > nagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As > yncJobManagerImpl.java:470) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav > a:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja > va:615) > at java.lang.Thread.run(Thread.java:745) > INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-19:ctx- > 0e65266f > job-306/job-336 ctx-b37c0c6e) Unable to contact resource. > com.cloud.exception.StorageUnavailableException: Resource > [StoragePool:1] is unreachable: Unable to create Vol[2|vm=2|ROOT]:Catch > Exception com.cloud.utils.exception.C loudRuntimeException for template + > due to > com.cloud.utils.exception.CloudRuntimeException: can't mount > 192.168.100.229:/media/usbdrive/nfs4/template/tmpl/1/1 to /var > /run/cloud_mount/98a78ad6-c6ab-4ed5-bdec-28a7a3b61b81 > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateV > olume(VolumeOrchestrator.java:1239) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(V > olumeOrchestrator.java:1297) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:974) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:4600) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j > ava:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess > orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHan > dlerProxy.java:107) > at > com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachi > neManagerImpl.java:4756) > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:10 > 2) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn > Context(AsyncJobManagerImpl.java:513) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca > ll(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call > WithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.run > WithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Ma > nagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As > yncJobManagerImpl.java:470) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav > a:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja > va:615) > at java.lang.Thread.run(Thread.java:745) > ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-19:ctx- > 0e65266f > job-306/job-336 ctx-b37c0c6e) Invocation exception, caused by: > com.cloud.exception.InsufficientS > erverCapacityException: Unable to create a deployment for > VM[ConsoleProxy|v-2-VM]Scope=interface com.cloud.dc.DataCenter; id=1 > INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-19:ctx-0e65266f > job-306/job-336 ctx-b37c0c6e) Rethrow exception > com.cloud.exception.InsufficientServerCapacityEx > ception: Unable to create a deployment for VM[ConsoleProxy|v-2- > VM]Scope=interface com.cloud.dc.DataCenter; id=1 ERROR > [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-19:ctx-0e65266f > job-306/job-336) Unable to complete AsyncJobVO {id:336, userId: 1, > accountId: 1, instanceType: nul > l, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: > rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oA > BGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS > 9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABB > MamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB- > AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXN > pY2FsTmV0d > 29ya0lkcQB-AAJMAAdwbGFubmVycQB- > AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB- > AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbk > lkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29y > a5- > ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZ > XJOYW1lcQB- > AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAAnQAGVZpcnR1YWxNYWN > oaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHB > wcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, > resultCode: > 0, result: null, initMsid: 345049006082, completeMsid: null, lastUpdated: > null, lastPolled: > null, created: Mon Oct 20 18:37:19 IST 2014}, job origin:306 > com.cloud.exception.InsufficientServerCapacityException: Unable to create > a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface > com.cloud.dc.DataCenter; id=1 > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:933) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:4600) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j > ava:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess > orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHan > dlerProxy.java:107) > at > com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachi > neManagerImpl.java:4756) > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:10 > 2) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn > Context(AsyncJobManagerImpl.java:513) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca > ll(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call > WithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.run > WithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Ma > nagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As > yncJobManagerImpl.java:470) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav > a:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja > va:615) > at java.lang.Thread.run(Thread.java:745) > WARN [c.c.v.SystemVmLoadScanner] (consoleproxy-1:ctx-c408ad21) > Unexpected exception Job failed due to exception Unable to create a > deployment for > VM[ConsoleProxy|v-2- > VM] > java.lang.RuntimeException: Job failed due to exception Unable to create a > deployment for VM[ConsoleProxy|v-2-VM] > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:11 > 4) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn > Context(AsyncJobManagerImpl.java:513) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca > ll(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call > WithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.run > WithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Ma > nagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As > yncJobManagerImpl.java:470) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav > a:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja > va:615) > at java.lang.Thread.run(Thread.java:745) > INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-19:ctx-0e65266f > job-306/job-336) Remove job-336 from job monitoring INFO > [o.a.c.s.v.VolumeServiceImpl] (Work-Job-Executor-20:ctx-2f0b969e > job-307/job-337 ctx-3f4b22e9) Unable to acquire lock on > VMTemplateStoragePool 126 ERROR [c.c.v.VirtualMachineManagerImpl] > (Work-Job-Executor-20:ctx-2f0b969e > job-307/job-337 ctx-3f4b22e9) Failed to start instance > VM[SecondaryStorageVm|s-63-VM] > com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock > on > VMTemplateStoragePool: 126 > at > org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImag > eAsync(VolumeServiceImpl.java:489) > at > org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFro > mTemplateAsync(VolumeServiceImpl.java:748) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateV > olume(VolumeOrchestrator.java:1227) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(V > olumeOrchestrator.java:1297) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:974) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:4600) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j > ava:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess > orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHan > dlerProxy.java:107) > at > com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachi > neManagerImpl.java:4756) > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:10 > 2) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn > Context(AsyncJobManagerImpl.java:513) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca > ll(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call > WithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.run > WithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Ma > nagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As > yncJobManagerImpl.java:470) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav > a:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja > va:615) > at java.lang.Thread.run(Thread.java:745) > ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-20:ctx- > 2f0b969e > job-307/job-337 ctx-3f4b22e9) Invocation exception, caused by: > com.cloud.exception.AgentUnavaila > bleException: Resource [Host:1] is unreachable: Host 1: Unable to start > instance due to Unable to acquire lock on VMTemplateStoragePool: 126 > INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-20:ctx-2f0b969e > job-307/job-337 ctx-3f4b22e9) Rethrow exception > com.cloud.exception.AgentUnavailableException: R esource [Host:1] is > unreachable: Host 1: Unable to start instance due to Unable to acquire lock > on VMTemplateStoragePool: 126 ERROR [c.c.v.VmWorkJobDispatcher] > (Work-Job-Executor-20:ctx-2f0b969e > job-307/job-337) Unable to complete AsyncJobVO {id:337, userId: 1, > accountId: 1, instanceType: nul > l, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: > rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oA > BGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS > 9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABB > MamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB- > AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXN > pY2FsTmV0d > 29ya0lkcQB-AAJMAAdwbGFubmVycQB- > AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB- > AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbk > lkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29y > a5- > ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZ > XJOYW1lcQB- > AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAP3QAGVZpcnR1YWxNYWN > oaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHB > wcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, > resultCode: > 0, result: null, initMsid: 345049006082, completeMsid: null, lastUpdated: > null, lastPolled: > null, created: Mon Oct 20 18:37:20 IST 2014}, job origin:307 > com.cloud.exception.AgentUnavailableException: Resource [Host:1] is > unreachable: Host 1: Unable to start instance due to Unable to acquire lock > on VMTemplateStoragePoo > l: 126 > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:1092) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:4600) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j > ava:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess > orImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHan > dlerProxy.java:107) > at > com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachi > neManagerImpl.java:4756) > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:10 > 2) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn > Context(AsyncJobManagerImpl.java:513) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca > ll(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call > WithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.run > WithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Ma > nagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As > yncJobManagerImpl.java:470) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav > a:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja > va:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to > acquire lock on VMTemplateStoragePool: 126 > at > org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImag > eAsync(VolumeServiceImpl.java:489) > at > org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFro > mTemplateAsync(VolumeServiceImpl.java:748) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateV > olume(VolumeOrchestrator.java:1227) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(V > olumeOrchestrator.java:1297) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachine > ManagerImpl.java:974) > ... 20 more > WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-febe1f24) > Exception while trying to start secondary storage vm > java.lang.RuntimeException: Job failed due to exception Resource [Host:1] is > unreachable: Host 1: Unable to start instance due to Unable to acquire lock > on VMTemplateS > toragePool: 126 > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:11 > 4) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn > Context(AsyncJobManagerImpl.java:513) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( > ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca > ll(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call > WithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.run > WithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Ma > nagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(As > yncJobManagerImpl.java:470) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav > a:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja > va:615) > at java.lang.Thread.run(Thread.java:745) > INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-febe1f24) > Unable to start secondary storage vm for standby capacity, secStorageVm > vm Id : 63, will recycl e it and start a new one INFO > [o.a.c.s.PremiumSecondaryStorageManagerImpl] > (secstorage-1:ctx-febe1f24) Primary secondary storage is not even started, > wait until next turn > > -- > Regards, > Ashutosh
