Hello,
I am becoming quite frustrated because I have gone through the cloudstack 4.4
setup about a dozen times with the same result.
I am creating a single management server/KVM host; the cloudstack host is
running CentOS 6.5. The primary and secondary storage are on two separate hosts
running CentOS 7. I have followed the installation instructions exactly and
every time the management server cannot create the system VM's. I have taken
the following steps:
- Set up mysql on Amazon RDS, running cloudstack-setup-databases command works
fine.
- Set up a single NIC on the cloudstack host with one IP Address in the same
subnet, but outside the ranges used for internal/guest networks.
- Created NFS shares on two hosts, one primary one secondary. Can mount both
shares fine on the Management/KVM host and can write to both shares. I unmount
the shares before starting install as it says in the instructions.
- I put all three hosts on the same /25 subnet, using different ranges for
internal/public networks
- I've seeded the systemvm template for KVM to the secondary storage
- I use the IP Addresses for the two storage hosts in the storage setup
Everything sets up fine but when the setup gets to the point of creating the
system vm's, it starts throwing the following exceptions:
2014-08-24 15:04:13,389 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-8dd20a54) There is no secondary storage VM for secondary
storage host nfs://xxx.xxx.xxx.xxx/pool/secondary
2014-08-24 15:04:13,437 DEBUG [c.c.v.VirtualMachineManagerImpl]
(secstorage-1:ctx-94c4ec96) Allocating nics for VM[SecondaryStorageVm|s-29-VM]
2014-08-24 15:04:13,511 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-8dd20a54)
Seq 1-7039407692556795967: Received: { Ans: , MgmtId: 161331704522, via: 1,
Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2014-08-24 15:04:13,537 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(secstorage-1:ctx-94c4ec96) Allocating nic for vm
VM[SecondaryStorageVm|s-29-VM] in network
Ntwk[724c54c5-307c-40d1-91cb-96884d297f6e|Guest|6] with requested profile
NicProfile[0-0-null-null-null
2014-08-24 15:04:13,696 DEBUG [c.c.u.d.T.Transaction]
(secstorage-1:ctx-94c4ec96) Rolling back the transaction: Time = 258 Name =
secstorage-1; called by
-TransactionLegacy.rollback:903-TransactionLegacy.removeUpTo:846-TransactionLegacy.close:670-TransactionContextInterceptor.invoke:36-ReflectiveMethodInvocation.proceed:161-ExposeInvocationInterceptor.invoke:91-ReflectiveMethodInvocation.proceed:172-JdkDynamicAopProxy.invoke:204-$Proxy54.persist:-1-NetworkOrchestrator.allocateNic:821-NetworkOrchestrator$3.doInTransactionWithoutResult:748-TransactionCallbackWithExceptionNoReturn.doInTransaction:25
2014-08-24 15:04:13,701 DEBUG [c.c.a.ApiServlet] (catalina-exec-2:ctx-01698f22)
===START=== 128.84.34.189 -- GET
command=listSystemVms&response=json&sessionkey=pYysvRh9kluVHYYsTC4BihvYJq4%3D&_=1408907056311
2014-08-24 15:04:13,760 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-108:ctx-3db552df job-1/job-117 ctx-78ff9836) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: null
2014-08-24 15:04:13,791 WARN [c.c.v.SystemVmLoadScanner]
(secstorage-1:ctx-94c4ec96) Unexpected exception DB Exception on:
com.mysql.jdbc.JDBC4PreparedStatement@6d760c36: INSERT INTO nics
(nics.instance_id, nics.ip4_address, nics.ip6_address, nics.netmask,
nics.isolation_uri, nics.ip_type, nics.broadcast_uri, nics.gateway,
nics.mac_address, nics.mode, nics.network_id, nics.state, nics.reserver_name,
nics.reservation_id, nics.device_id, nics.update_time, nics.default_nic,
nics.ip6_gateway, nics.ip6_cidr, nics.strategy, nics.vm_type, nics.created,
nics.uuid, nics.secondary_ip) VALUES (29, null, null, null, null, null, null,
null, null, 'Dhcp', 204, 'Allocated', _binary'DirectPodBasedNetworkGuru', null,
2, null, 1, null, null, 'Start', 'SecondaryStorageVm', '2014-08-24 19:04:13',
_binary'7bae40cf-c5db-49c2-8b29-b528727f8057', 0)
com.cloud.utils.exception.CloudRuntimeException: DB Exception on:
com.mysql.jdbc.JDBC4PreparedStatement@6d760c36: INSERT INTO nics
(nics.instance_id, nics.ip4_address, nics.ip6_address, nics.netmask,
nics.isolation_uri, nics.ip_type, nics.broadcast_uri, nics.gateway,
nics.mac_address, nics.mode, nics.network_id, nics.state, nics.reserver_name,
nics.reservation_id, nics.device_id, nics.update_time, nics.default_nic,
nics.ip6_gateway, nics.ip6_cidr, nics.strategy, nics.vm_type, nics.created,
nics.uuid, nics.secondary_ip) VALUES (29, null, null, null, null, null, null,
null, null, 'Dhcp', 204, 'Allocated', _binary'DirectPodBasedNetworkGuru', null,
2, null, 1, null, null, 'Start', 'SecondaryStorageVm', '2014-08-24 19:04:13',
_binary'7bae40cf-c5db-49c2-8b29-b528727f8057', 0)
at com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1400)
at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy54.persist(Unknown Source)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.allocateNic(NetworkOrchestrator.java:821)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator$3.doInTransactionWithoutResult(NetworkOrchestrator.java:748)
..............
2014-08-24 15:04:45,697 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685
FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
2014-08-24 15:04:45,697 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685
FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
2014-08-24 15:04:46,173 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: null
2014-08-24 15:04:46,270 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685) Invocation
exception, caused by: com.cloud.utils.exception.CloudRuntimeException: Unable
to create deployment, no usable volumes found for the VM
2014-08-24 15:04:46,271 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685) Rethrow
exception com.cloud.utils.exception.CloudRuntimeException: Unable to create
deployment, no usable volumes found for the VM
2014-08-24 15:04:46,271 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119) Done with run of VM work
job: com.cloud.vm.VmWorkStart for VM 29, job origin: 2
2014-08-24 15:04:46,271 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119) Unable to complete
AsyncJobVO {id:119, userId: 1, accountId: 1, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAHXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 161331704522, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Sun Aug 24 15:04:40 EDT 2014}, job origin:2
com.cloud.utils.exception.CloudRuntimeException: Unable to create deployment,
no usable volumes found for the VM
at
com.cloud.deploy.DeploymentPlanningManagerImpl.findSuitablePoolsForVolumes(DeploymentPlanningManagerImpl.java:1179)
at
com.cloud.deploy.DeploymentPlanningManagerImpl.checkClustersforDestination(DeploymentPlanningManagerImpl.java:941)
at
com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:481)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:931)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5190)
at sun.reflect.GeneratedMethodAccessor178.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5335)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:503)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:460)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)?
I really can't see anything that I'm doing wrong. Everything seems to be set up
perfectly and yet the system vm's cannot be created. Can someone please provide
some insight into what I need to change??
