Hi, Normally it is not a capacity issue. It might be caused by the systemvm template, VR, etc. Please share the full log (from job-16 is started).
-Wei On Fri, 26 Nov 2021 at 14:12, technologyrss.mail < [email protected]> wrote: > *Hi, * > > Please see error log: > > (logid:9bd01412) Searching all possible resources under this Zone: 1 > 2021-11-26 18:47:42,554 DEBUG [c.c.d.FirstFitPlanner] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Listing clusters in order of aggregate capacity, that have (at least one > host with) enough CPU and RAM capacity under this Zone: 1 > 2021-11-26 18:47:42,561 DEBUG [c.c.d.FirstFitPlanner] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Removing from the clusterId list these clusters from avoid set: [] > 2021-11-26 18:47:42,582 DEBUG [c.c.d.FirstFitPlanner] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Cannot allocate cluster list [1] for vm creation since their allocated > percentage crosses the disable capacity threshold defined at each > cluster/ at global value for capacity Type : 0, skipping these clusters > 2021-11-26 18:47:42,582 DEBUG [c.c.d.FirstFitPlanner] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > No clusters found after removing disabled clusters and clusters in avoid > list, returning. > 2021-11-26 18:47:42,590 DEBUG [c.c.v.UserVmManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Destroying vm VM[User|i-2-3-VM] as it failed to create on Host with Id:null > 2021-11-26 18:47:42,626 DEBUG [c.c.c.CapacityManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > VM state transitted from :Stopped to Error with event: > OperationFailedToErrorvm's original host id: null new host id: null host > id before state transition: null > 2021-11-26 18:47:42,659 DEBUG [c.c.r.ResourceLimitManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Updating resource Type = volume count for Account = 2 Operation = > decreasing Amount = 1 > 2021-11-26 18:47:42,680 DEBUG [c.c.r.ResourceLimitManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Updating resource Type = primary_storage count for Account = 2 Operation > = decreasing Amount = (20.00 GB) 21474836480 > 2021-11-26 18:47:42,714 WARN [c.c.a.AlertManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > AlertType:: 8 | dataCenterId:: 1 | podId:: null | clusterId:: null | > message:: Failed to deploy Vm with Id: 3, on Host with Id: null > 2021-11-26 18:47:42,727 DEBUG [c.c.r.ResourceLimitManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Updating resource Type = user_vm count for Account = 2 Operation = > decreasing Amount = 1 > 2021-11-26 18:47:42,737 DEBUG [c.c.r.ResourceLimitManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Updating resource Type = cpu count for Account = 2 Operation = > decreasing Amount = 1 > 2021-11-26 18:47:42,748 DEBUG [c.c.r.ResourceLimitManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Updating resource Type = memory count for Account = 2 Operation = > decreasing Amount = 1024 > 2021-11-26 18:47:42,768 INFO [o.a.c.a.c.u.v.DeployVMCmd] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > com.cloud.exception.InsufficientServerCapacityException: Unable to > create a deployment for VM[User|i-2-3-VM]Scope=interface > com.cloud.dc.DataCenter; id=1 > 2021-11-26 18:47:42,768 INFO [o.a.c.a.c.u.v.DeployVMCmd] > (API-Job-Executor-8:ctx-dfeedfec job-16 ctx-0f3c8323) (logid:9bd01412) > Unable to create a deployment for VM[User|i-2-3-VM] > com.cloud.exception.InsufficientServerCapacityException: Unable to > create a deployment for VM[User|i-2-3-VM]Scope=interface > com.cloud.dc.DataCenter; id=1 > at > > org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:225) > at > > org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:202) > at > > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:4929) > at > > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:4466) > at > > com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:4455) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > at > > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at > > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) > at > > org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) > at > > com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) > at > > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) > at > > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) > at com.sun.proxy.$Proxy127.startVirtualMachine(Unknown Source) > at > > org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:681) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156) > at > com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108) > at > > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620) > at > > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48) > at > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) > at > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) > at > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) > at > > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45) > at > > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568) > at > > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) > at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > at > > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:829) > 2021-11-26 18:47:42,790 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16) (logid:9bd01412) Complete async > job-16, jobStatus: FAILED, resultCode: 530, result: > org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"533","errortext":"Unable > > to create a deployment for VM[User|i-2-3-VM]"} > 2021-11-26 18:47:42,792 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16) (logid:9bd01412) Publish async > job-16 complete on message bus > 2021-11-26 18:47:42,792 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16) (logid:9bd01412) Wake up jobs > related to job-16 > 2021-11-26 18:47:42,792 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16) (logid:9bd01412) Update db > status for job-16 > 2021-11-26 18:47:42,795 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16) (logid:9bd01412) Wake up jobs > joined with job-16 and disjoin all subjobs created from job- 16 > 2021-11-26 18:47:42,808 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-8:ctx-dfeedfec job-16) (logid:9bd01412) Done executing > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin for job-16 > 2021-11-26 18:47:42,809 INFO [o.a.c.f.j.i.AsyncJobMonitor] > (API-Job-Executor-8:ctx-dfeedfec job-16) (logid:9bd01412) Remove job-16 > from job monitoring > 2021-11-26 18:47:42,943 DEBUG [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-6:null) (logid:) SeqA 6-77: Processing Seq 6-77: > { Cmd , MgmtId: -1, via: 6, Ver: v1, Flags: 11, > > [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"2","_loadInfo":"{ > "connections": [] > }","wait":"0","bypassHostMaintenance":"false"}}] } > 2021-11-26 18:47:42,950 DEBUG [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-6:null) (logid:) SeqA 6-77: Sending Seq 6-77: { > Ans: , MgmtId: 8796752343080, via: 6, Ver: v1, Flags: 100010, > [{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}] > > } > 2021-11-26 18:47:45,285 DEBUG [c.c.a.ApiServlet] > (qtp1136768342-16:ctx-c2542c8a) (logid:73ba66d4) ===START=== > 192.168.0.115 -- GET > > command=queryAsyncJobResult&jobId=9bd01412-a076-47a8-bdea-d2bf3d12333e&response=json&_=1637929789041 > 2021-11-26 18:47:45,298 DEBUG [c.c.a.ApiServer] > (qtp1136768342-16:ctx-c2542c8a ctx-c88e3187) (logid:73ba66d4) CIDRs from > which account 'Acct[0f5b60e0-4eb1-11ec-9240-0800274c7028-admin]' is > allowed to perform API calls: 0.0.0.0/0,::/0 > 2021-11-26 18:47:45,323 DEBUG [c.c.a.ApiServlet] > (qtp1136768342-16:ctx-c2542c8a ctx-c88e3187) (logid:73ba66d4) ===END=== > 192.168.0.115 -- GET > > command=queryAsyncJobResult&jobId=9bd01412-a076-47a8-bdea-d2bf3d12333e&response=json&_=1637929789041 > 2021-11-26 18:47:45,331 DEBUG [c.c.a.ApiServlet] > (qtp1136768342-20:ctx-c2e30369) (logid:fa26a77e) ===START=== > 192.168.0.115 -- GET > > command=listVirtualMachines&id=420857fa-22ec-46ae-9a3e-e014df804905&response=json&_=1637929789042 > 2021-11-26 18:47:45,339 DEBUG [c.c.a.ApiServer] > (qtp1136768342-20:ctx-c2e30369 ctx-7ddc4a57) (logid:fa26a77e) CIDRs from > which account 'Acct[0f5b60e0-4eb1-11ec-9240-0800274c7028-admin]' is > allowed to perform API calls: 0.0.0.0/0,::/0 > 2021-11-26 18:47:45,371 DEBUG [c.c.a.ApiServlet] > (qtp1136768342-20:ctx-c2e30369 ctx-7ddc4a57) (logid:fa26a77e) ===END=== > 192.168.0.115 -- GET > > command=listVirtualMachines&id=420857fa-22ec-46ae-9a3e-e014df804905&response=json&_=1637929789042 > 2021-11-26 18:47:48,149 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] > (Timer-6:ctx-922dbb29) (logid:7a555745) getCommandHostDelegation: class > org.apache.cloudstack.storage.command.DownloadProgressCommand > 2021-11-26 18:47:48,152 DEBUG [c.c.h.XenServerGuru] > (Timer-6:ctx-922dbb29) (logid:7a555745) We are returning the default > host to execute commands because the command is not of Copy type. > > > How can I solve this? please help me. > > KVM network like this > > ifcfg-cloudbr0 > ifcfg-cloudbr1 > ifcfg-enp2s0 //This is my LAN interface. > ifcfg-lo > > > ACS ip : 192.168.0.15 > KVM: 192.168.0.25 > nfs: 192.168.0.35 > > setup basic zone is done SSVM & proxy vm status is ok. > > > -- > > *Thanks & Regards.* >
