[ https://issues.apache.org/jira/browse/CLOUDSTACK-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533269#comment-13533269 ]
Nont Banditwong commented on CLOUDSTACK-581: -------------------------------------------- Sorry David, here is mine 2012-12-16 11:47:06,736 DEBUG [cloud.vm.VirtualMachineManagerImpl] (RouterMonitor-1:null) Cleanup succeeded. Details 2012-12-16 11:47:06,736 DEBUG [agent.manager.AgentManagerImpl] (RouterMonitor-1:null) Details from executing class com.cloud.agent.api.NetworkUsageCommand: 2012-12-16 11:47:06,736 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) Recieved and Sent bytes are both 0. Not updating user_statistics 2012-12-16 11:47:06,738 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-304:null) Seq 33-1252223952: Executing request 2012-12-16 11:47:06,963 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) External load balancer devices stats collector is running... 2012-12-16 11:47:06,969 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 240 is not configured for external networking, so skipping usage check. 2012-12-16 11:47:06,970 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 248 is not configured for external networking, so skipping usage check. 2012-12-16 11:47:06,971 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 256 is not configured for external networking, so skipping usage check. 2012-12-16 11:47:06,972 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 241 is not configured for external networking, so skipping usage check. 2012-12-16 11:47:06,973 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 242 is not configured for external networking, so skipping usage check. 2012-12-16 11:47:06,978 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-5:null) checking health of usage server 2012-12-16 11:47:06,979 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (HA-5:null) usage server running? true, heartbeat: Sun Dec 16 11:46:41 ICT 2012 2012-12-16 11:47:06,988 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-304:null) Seq 33-1252223952: Response Received: 2012-12-16 11:47:06,988 DEBUG [agent.transport.Request] (DirectAgent-304:null) Seq 33-1252223952: Processing: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 10, [{"NetworkUsageAnswer":{"routerName":"r-210-VM","bytesSent":2392605858,"bytesReceived":3619291707,"result":true,"details":"","wait":0}}] } 2012-12-16 11:47:06,988 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-304:null) Cleanup succeeded. Details 2012-12-16 11:47:06,988 DEBUG [agent.transport.Request] (RouterMonitor-1:null) Seq 33-1252223952: Received: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 10, { NetworkUsageAnswer } } 2012-12-16 11:47:06,988 DEBUG [cloud.vm.VirtualMachineManagerImpl] (RouterMonitor-1:null) Cleanup succeeded. Details 2012-12-16 11:47:06,988 DEBUG [agent.manager.AgentManagerImpl] (RouterMonitor-1:null) Details from executing class com.cloud.agent.api.NetworkUsageCommand: 2012-12-16 11:47:07,163 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-120:null) Seq 33-1252223953: Executing request 2012-12-16 11:47:07,397 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-120:null) Seq 33-1252223953: Response Received: 2012-12-16 11:47:07,397 DEBUG [agent.transport.Request] (DirectAgent-120:null) Seq 33-1252223953: Processing: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 10, [{"NetworkUsageAnswer":{"routerName":"r-397-VM","bytesSent":18554677,"bytesReceived":89226442,"result":true,"details":"","wait":0}}] } 2012-12-16 11:47:07,397 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-120:null) Cleanup succeeded. Details 2012-12-16 11:47:07,397 DEBUG [agent.transport.Request] (RouterMonitor-1:null) Seq 33-1252223953: Received: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 10, { NetworkUsageAnswer } } 2012-12-16 11:47:07,397 DEBUG [cloud.vm.VirtualMachineManagerImpl] (RouterMonitor-1:null) Cleanup succeeded. Details 2012-12-16 11:47:07,397 DEBUG [agent.manager.AgentManagerImpl] (RouterMonitor-1:null) Details from executing class com.cloud.agent.api.NetworkUsageCommand: 2012-12-16 11:47:07,905 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-247:null) Seq 38-1377501323: Response Received: 2012-12-16 11:47:07,905 DEBUG [agent.transport.Request] (DirectAgent-247:null) Seq 38-1377501323: Processing: { Ans: , MgmtId: 670059313990, via: 38, Ver: v1, Flags: 110, [{"Answer":{"result":true,"wait":0}}] } 2012-12-16 11:47:07,905 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-247:null) Cleanup succeeded. Details null 2012-12-16 11:47:07,905 DEBUG [agent.manager.AgentAttache] (DirectAgent-247:null) Seq 38-1377501323: No more commands found 2012-12-16 11:47:07,905 DEBUG [agent.transport.Request] (Job-Executor-93:job-213) Seq 38-1377501323: Received: { Ans: , MgmtId: 670059313990, via: 38, Ver: v1, Flags: 110, { Answer } } 2012-12-16 11:47:07,905 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Cleanup succeeded. Details null 2012-12-16 11:47:07,905 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-93:job-213) Asking Ovs to prepare for Nic[554-205-429cf61b-e00a-43f7-9c37-eccffc1341ec-10.1.12.254] 2012-12-16 11:47:07,905 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-93:job-213) Asking ExternalDhcpServer to prepare for Nic[554-205-429cf61b-e00a-43f7-9c37-eccffc1341ec-10.1.12.254] 2012-12-16 11:47:07,907 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-93:job-213) Asking BareMetal to prepare for Nic[554-205-429cf61b-e00a-43f7-9c37-eccffc1341ec-10.1.12.254] 2012-12-16 11:47:07,907 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-93:job-213) Asking SecurityGroupProvider to prepare for Nic[554-205-429cf61b-e00a-43f7-9c37-eccffc1341ec-10.1.12.254] 2012-12-16 11:47:07,909 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-93:job-213) Service SecurityGroup is not supported in the network id=240 2012-12-16 11:47:07,909 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-93:job-213) Checking if we need to prepare 2 volumes for VM[User|i-3-205-VM] 2012-12-16 11:47:07,909 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-93:job-213) No need to recreate the volume: Vol[151|vm=205|DATADISK], since it already has a pool assigned: 214, adding disk to VM 2012-12-16 11:47:07,910 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-93:job-213) No need to recreate the volume: Vol[176|vm=205|ROOT], since it already has a pool assigned: 214, adding disk to VM 2012-12-16 11:47:07,999 DEBUG [agent.transport.Request] (Job-Executor-93:job-213) Seq 33-1252223954: Sending { Cmd , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 100111, [{"StartCommand":{"vm":{"id":205,"name":"i-3-205-VM","bootloader":"PyGrub","type":"User","cpus":1,"speed":500,"minRam":536870912,"maxRam":536870912,"arch":"x86_64","os":"CentOS 5.6 (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"4390fb9eeae3213e","params":{},"disks":[{"id":151,"name":"ownCloudData","mountPoint":"/export/primary","path":"e5f1b71c-bc96-418e-bec5-ab44ef745663","size":107374182400,"type":"DATADISK","storagePoolType":"NetworkFilesystem","storagePoolUuid":"933ec8d2-6d1e-3555-9f5e-f593d95017ee","deviceId":1},{"id":176,"name":"ROOT-205","mountPoint":"/export/primary","path":"7ccb1313-c05f-4e2e-a786-b34cc164fbd4","size":21474836480,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"933ec8d2-6d1e-3555-9f5e-f593d95017ee","deviceId":0},{"id":205,"name":"owncloud template","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"ip":"10.1.12.254","netmask":"255.255.0.0","gateway":"10.1.0.1","mac":"02:00:11:af:00:01","dns1":"203.146.237.237","dns2":"203.146.237.222","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://707","isolationUri":"vlan://707","isSecurityGroupEnabled":false,"name":"cloud-guest"}]},"wait":0}}] } 2012-12-16 11:47:07,999 DEBUG [agent.transport.Request] (Job-Executor-93:job-213) Seq 33-1252223954: Executing: { Cmd , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 100111, [{"StartCommand":{"vm":{"id":205,"name":"i-3-205-VM","bootloader":"PyGrub","type":"User","cpus":1,"speed":500,"minRam":536870912,"maxRam":536870912,"arch":"x86_64","os":"CentOS 5.6 (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"4390fb9eeae3213e","params":{},"disks":[{"id":151,"name":"ownCloudData","mountPoint":"/export/primary","path":"e5f1b71c-bc96-418e-bec5-ab44ef745663","size":107374182400,"type":"DATADISK","storagePoolType":"NetworkFilesystem","storagePoolUuid":"933ec8d2-6d1e-3555-9f5e-f593d95017ee","deviceId":1},{"id":176,"name":"ROOT-205","mountPoint":"/export/primary","path":"7ccb1313-c05f-4e2e-a786-b34cc164fbd4","size":21474836480,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"933ec8d2-6d1e-3555-9f5e-f593d95017ee","deviceId":0},{"id":205,"name":"owncloud template","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"ip":"10.1.12.254","netmask":"255.255.0.0","gateway":"10.1.0.1","mac":"02:00:11:af:00:01","dns1":"203.146.237.237","dns2":"203.146.237.222","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://707","isolationUri":"vlan://707","isSecurityGroupEnabled":false,"name":"cloud-guest"}]},"wait":0}}] } 2012-12-16 11:47:08,000 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-48:null) Seq 33-1252223954: Executing request 2012-12-16 11:47:08,054 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) 1. The VM i-3-205-VM is in Starting state. 2012-12-16 11:47:08,088 DEBUG [xen.resource.XenServer56FP1Resource] (DirectAgent-48:null) Created VM 984ea430-61c2-f703-b398-d8c12e9ecefa for i-3-205-VM 2012-12-16 11:47:08,119 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) VBD d841d9a6-898d-42cd-84ad-d6bd566c396e created for Vol[151|DATADISK|e5f1b71c-bc96-418e-bec5-ab44ef745663|107374182400] 2012-12-16 11:47:08,141 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) VBD bdf32659-b87c-07c3-c762-79c566ed4273 created for Vol[176|ROOT|7ccb1313-c05f-4e2e-a786-b34cc164fbd4|21474836480] 2012-12-16 11:47:08,159 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) VBD e5882216-4713-e075-0bd4-3ea5d18d656c created for Vol[205|ISO|null|0] 2012-12-16 11:47:08,159 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Creating VIF for i-3-205-VM on nic [Nic:Guest-10.1.12.254-vlan://707] 2012-12-16 11:47:08,159 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Looking for network named cloud-guest 2012-12-16 11:47:08,189 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Found a network called cloud-guest on host=172.16.1.101; Network=3415cadd-35ec-11b7-5535-5e3a0252e890; pif=edb07215-1472-5027-1af4-e4dce955f1fa 2012-12-16 11:47:08,201 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Creating VLAN 707 on host 172.16.1.101 on device eth1 2012-12-16 11:47:08,254 DEBUG [storage.snapshot.SnapshotSchedulerImpl] (SnapshotPollTask:null) Snapshot scheduler.poll is being called at 2012-12-16 04:47:08 GMT 2012-12-16 11:47:08,254 DEBUG [storage.snapshot.SnapshotSchedulerImpl] (SnapshotPollTask:null) Got 0 snapshots to be executed at 2012-12-16 04:47:08 GMT 2012-12-16 11:47:08,500 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) VLAN is created for 707. The uuid is 8d2a44e7-5daa-c262-4b59-e69a52015a1f 2012-12-16 11:47:08,518 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Created a vif 19a14855-30e6-72ea-8489-34ec23ec7f94 on 0 2012-12-16 11:47:09,541 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Task failed! Task record: uuid: 3876ded5-6d7c-7062-3ef8-2b5f3f34b985 nameLabel: Async.VM.start_on nameDescription: allowedOperations: [] currentOperations: {} created: Sun Dec 16 11:52:06 ICT 2012 finished: Sun Dec 16 11:52:06 ICT 2012 status: FAILURE residentOn: com.xensource.xenapi.Host@8400546 progress: 1.0 type: <none/> result: errorInfo: [LICENSE_EXPIRED] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] 2012-12-16 11:47:09,545 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Unable to start VM(i-3-205-VM) on host(a9d54d6f-54d5-4d91-b668-00af48da727e) due to Task failed! Task record: uuid: 3876ded5-6d7c-7062-3ef8-2b5f3f34b985 nameLabel: Async.VM.start_on nameDescription: allowedOperations: [] currentOperations: {} created: Sun Dec 16 11:52:06 ICT 2012 finished: Sun Dec 16 11:52:06 ICT 2012 status: FAILURE residentOn: com.xensource.xenapi.Host@8400546 progress: 1.0 type: <none/> result: errorInfo: [LICENSE_EXPIRED] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] Task failed! Task record: uuid: 3876ded5-6d7c-7062-3ef8-2b5f3f34b985 nameLabel: Async.VM.start_on nameDescription: allowedOperations: [] currentOperations: {} created: Sun Dec 16 11:52:06 ICT 2012 finished: Sun Dec 16 11:52:06 ICT 2012 status: FAILURE residentOn: com.xensource.xenapi.Host@8400546 progress: 1.0 type: <none/> result: errorInfo: [LICENSE_EXPIRED] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] at com.cloud.hypervisor.xen.resource.CitrixResourceBase.checkForSuccess(CitrixResourceBase.java:2768) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixResourceBase.java:2880) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1107) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:466) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:69) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-12-16 11:47:09,550 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Catch Exception: class com.cloud.utils.exception.CloudRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(i-3-205-VM) on host(a9d54d6f-54d5-4d91-b668-00af48da727e) due to Task failed! Task record: uuid: 3876ded5-6d7c-7062-3ef8-2b5f3f34b985 nameLabel: Async.VM.start_on nameDescription: allowedOperations: [] currentOperations: {} created: Sun Dec 16 11:52:06 ICT 2012 finished: Sun Dec 16 11:52:06 ICT 2012 status: FAILURE residentOn: com.xensource.xenapi.Host@8400546 progress: 1.0 type: <none/> result: errorInfo: [LICENSE_EXPIRED] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(i-3-205-VM) on host(a9d54d6f-54d5-4d91-b668-00af48da727e) due to Task failed! Task record: uuid: 3876ded5-6d7c-7062-3ef8-2b5f3f34b985 nameLabel: Async.VM.start_on nameDescription: allowedOperations: [] currentOperations: {} created: Sun Dec 16 11:52:06 ICT 2012 finished: Sun Dec 16 11:52:06 ICT 2012 status: FAILURE residentOn: com.xensource.xenapi.Host@8400546 progress: 1.0 type: <none/> result: errorInfo: [LICENSE_EXPIRED] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixResourceBase.java:2891) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1107) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:466) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:69) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-12-16 11:47:09,551 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Unable to start i-3-205-VM due to com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(i-3-205-VM) on host(a9d54d6f-54d5-4d91-b668-00af48da727e) due to Task failed! Task record: uuid: 3876ded5-6d7c-7062-3ef8-2b5f3f34b985 nameLabel: Async.VM.start_on nameDescription: allowedOperations: [] currentOperations: {} created: Sun Dec 16 11:52:06 ICT 2012 finished: Sun Dec 16 11:52:06 ICT 2012 status: FAILURE residentOn: com.xensource.xenapi.Host@8400546 progress: 1.0 type: <none/> result: errorInfo: [LICENSE_EXPIRED] otherConfig: {} subtaskOf: com.xensource.xenapi.Task@aaf13f6f subtasks: [] at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixResourceBase.java:2891) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1107) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:466) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:69) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-12-16 11:47:09,598 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Unable to clean up VBD due to You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given. at com.xensource.xenapi.Types.checkResponse(Types.java:211) at com.xensource.xenapi.Connection.dispatch(Connection.java:372) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:905) at com.xensource.xenapi.VBD.unplug(VBD.java:1058) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:929) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1167) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:466) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:69) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-12-16 11:47:09,609 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Unable to clean up VBD due to You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given. at com.xensource.xenapi.Types.checkResponse(Types.java:211) at com.xensource.xenapi.Connection.dispatch(Connection.java:372) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:905) at com.xensource.xenapi.VBD.unplug(VBD.java:1058) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:929) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1167) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:466) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:69) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-12-16 11:47:09,619 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Unable to clean up VBD due to You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given. at com.xensource.xenapi.Types.checkResponse(Types.java:211) at com.xensource.xenapi.Connection.dispatch(Connection.java:372) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:905) at com.xensource.xenapi.VBD.unplug(VBD.java:1058) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:929) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1167) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:466) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:69) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-12-16 11:47:09,631 WARN [xen.resource.CitrixResourceBase] (DirectAgent-48:null) Unable to cleanup VIF You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given. at com.xensource.xenapi.Types.checkResponse(Types.java:211) at com.xensource.xenapi.Connection.dispatch(Connection.java:372) at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:905) at com.xensource.xenapi.VIF.unplug(VIF.java:808) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:937) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1167) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:466) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:69) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-12-16 11:47:10,038 INFO [xen.resource.XenServer56Resource] (DirectAgent-48:null) Catch com.xensource.xenapi.Types$InvalidValue: failed to destory VLAN eth1 on host a9d54d6f-54d5-4d91-b668-00af48da727e due to The value given is invalid 2012-12-16 11:47:10,038 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-48:null) The VM is in stopped state, detected problem during startup : i-3-205-VM 2012-12-16 11:47:10,038 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-48:null) Seq 33-1252223954: Response Received: 2012-12-16 11:47:10,039 DEBUG [agent.transport.Request] (DirectAgent-48:null) Seq 33-1252223954: Processing: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 110, [{"StartAnswer":{"vm":{"id":205,"name":"i-3-205-VM","bootloader":"PyGrub","type":"User","cpus":1,"speed":500,"minRam":536870912,"maxRam":536870912,"arch":"x86_64","os":"CentOS 5.6 (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"4390fb9eeae3213e","params":{},"disks":[{"id":151,"name":"ownCloudData","mountPoint":"/export/primary","path":"e5f1b71c-bc96-418e-bec5-ab44ef745663","size":107374182400,"type":"DATADISK","storagePoolType":"NetworkFilesystem","storagePoolUuid":"933ec8d2-6d1e-3555-9f5e-f593d95017ee","deviceId":1},{"id":176,"name":"ROOT-205","mountPoint":"/export/primary","path":"7ccb1313-c05f-4e2e-a786-b34cc164fbd4","size":21474836480,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"933ec8d2-6d1e-3555-9f5e-f593d95017ee","deviceId":0},{"id":205,"name":"owncloud template","size":0,"type":"ISO","storagePoolType":"ISO","deviceId":3}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"ip":"10.1.12.254","netmask":"255.255.0.0","gateway":"10.1.0.1","mac":"02:00:11:af:00:01","dns1":"203.146.237.237","dns2":"203.146.237.222","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://707","isolationUri":"vlan://707","isSecurityGroupEnabled":false,"name":"cloud-guest"}]},"result":false,"details":"Unable to start i-3-205-VM due to ","wait":0}}] } 2012-12-16 11:47:10,039 WARN [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-48:null) Cleanup failed due to Unable to start i-3-205-VM due to 2012-12-16 11:47:10,039 DEBUG [agent.transport.Request] (Job-Executor-93:job-213) Seq 33-1252223954: Received: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 110, { StartAnswer } } 2012-12-16 11:47:10,039 WARN [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Cleanup failed due to Unable to start i-3-205-VM due to 2012-12-16 11:47:10,039 DEBUG [agent.manager.AgentAttache] (DirectAgent-48:null) Seq 33-1252223954: No more commands found 2012-12-16 11:47:10,146 INFO [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Unable to start VM on Host[-33-Routing] due to Unable to start i-3-205-VM due to 2012-12-16 11:47:10,213 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Cleaning up resources for the vm VM[User|i-3-205-VM] in Starting state 2012-12-16 11:47:10,214 DEBUG [agent.transport.Request] (Job-Executor-93:job-213) Seq 33-1252223955: Sending { Cmd , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"i-3-205-VM","wait":0}}] } 2012-12-16 11:47:10,214 DEBUG [agent.transport.Request] (Job-Executor-93:job-213) Seq 33-1252223955: Executing: { Cmd , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"i-3-205-VM","wait":0}}] } 2012-12-16 11:47:10,214 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-203:null) Seq 33-1252223955: Executing request 2012-12-16 11:47:10,268 INFO [xen.resource.CitrixResourceBase] (DirectAgent-203:null) VM does not exist on XenServera9d54d6f-54d5-4d91-b668-00af48da727e 2012-12-16 11:47:10,268 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-203:null) Seq 33-1252223955: Response Received: 2012-12-16 11:47:10,268 DEBUG [agent.transport.Request] (DirectAgent-203:null) Seq 33-1252223955: Processing: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"bytesSent":0,"bytesReceived":0,"result":true,"details":"VM does not exist","wait":0}}] } 2012-12-16 11:47:10,268 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-203:null) Cleanup succeeded. Details VM does not exist 2012-12-16 11:47:10,268 DEBUG [agent.transport.Request] (Job-Executor-93:job-213) Seq 33-1252223955: Received: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 110, { StopAnswer } } 2012-12-16 11:47:10,268 DEBUG [agent.manager.AgentAttache] (DirectAgent-203:null) Seq 33-1252223955: No more commands found 2012-12-16 11:47:10,268 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Cleanup succeeded. Details VM does not exist 2012-12-16 11:47:10,339 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-93:job-213) Service SecurityGroup is not supported in the network id=240 2012-12-16 11:47:10,341 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-93:job-213) Changing active number of nics for network id=240 on -1 2012-12-16 11:47:10,413 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Successfully cleanued up resources for the vm VM[User|i-3-205-VM] in Starting state 2012-12-16 11:47:10,414 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Root volume is ready, need to place VM in volume's cluster 2012-12-16 11:47:10,414 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-93:job-213) Vol[176|vm=205|ROOT] is READY, changing deployment plan to use this pool's dcId: 4 , podId: 4 , and clusterId: 5 2012-12-16 11:47:10,415 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) DeploymentPlanner allocation algorithm: random 2012-12-16 11:47:10,415 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Trying to allocate a host and storage pools from dc:4, pod:4,cluster:5, requested cpu: 500, requested ram: 536870912 2012-12-16 11:47:10,415 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Is ROOT volume READY (pool already allocated)?: Yes 2012-12-16 11:47:10,415 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) This VM has last host_id specified, trying to choose the same host: 33 2012-12-16 11:47:10,415 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) The last host of this VM is in avoid set 2012-12-16 11:47:10,415 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Cannot choose the last host to deploy this VM 2012-12-16 11:47:10,415 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Searching resources only under specified Cluster: 5 2012-12-16 11:47:10,417 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Checking resources in Cluster: 5 under Pod: 4 2012-12-16 11:47:10,417 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Calling HostAllocators to find suitable hosts 2012-12-16 11:47:10,418 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-93:job-213 FirstFitRoutingAllocator) Looking for hosts in dc: 4 pod:4 cluster:5 2012-12-16 11:47:10,418 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-93:job-213 FirstFitRoutingAllocator) FirstFitAllocator has 2 hosts to check for allocation: [Host[-33-Routing], Host[-38-Routing]] 2012-12-16 11:47:10,419 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-93:job-213 FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-33-Routing]] 2012-12-16 11:47:10,419 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-93:job-213 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512 2012-12-16 11:47:10,419 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-93:job-213 FirstFitRoutingAllocator) Host name: node01.cloud.dtacnetwork.com, hostId: 33 is in avoid set, skipping this and trying other available hosts 2012-12-16 11:47:10,419 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-93:job-213 FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts 2012-12-16 11:47:10,419 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) No suitable hosts found 2012-12-16 11:47:10,419 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) No suitable hosts found under this Cluster: 5 2012-12-16 11:47:10,419 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Could not find suitable Deployment Destination for this VM under any clusters, returning. 2012-12-16 11:47:10,423 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) DeploymentPlanner allocation algorithm: random 2012-12-16 11:47:10,423 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Trying to allocate a host and storage pools from dc:4, pod:4,cluster:null, requested cpu: 500, requested ram: 536870912 2012-12-16 11:47:10,423 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Is ROOT volume READY (pool already allocated)?: No 2012-12-16 11:47:10,423 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) This VM has last host_id specified, trying to choose the same host: 33 2012-12-16 11:47:10,423 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) The last host of this VM is in avoid set 2012-12-16 11:47:10,423 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Cannot choose the last host to deploy this VM 2012-12-16 11:47:10,423 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Searching resources only under specified Pod: 4 2012-12-16 11:47:10,424 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 4 2012-12-16 11:47:10,424 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) CPUOverprovisioningFactor considered: 1.0 2012-12-16 11:47:10,425 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) Removing from the clusterId list these clusters from avoid set: [5] 2012-12-16 11:47:10,425 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-93:job-213) No clusters found after removing disabled clusters and clusters in avoid list, returning. 2012-12-16 11:47:10,564 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-93:job-213) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: 33 new host id: null host id before state transition: 33 2012-12-16 11:47:10,565 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-93:job-213) Hosts's actual total CPU: 12372 and CPU after applying overprovisioning: 12372 2012-12-16 11:47:10,566 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-93:job-213) release cpu from host: 33, old used: 9600,reserved: 1000, actual total: 12372, total with overprovisioning: 12372; new used: 9100,reserved:1000; movedfromreserved: false,moveToReserveredfalse 2012-12-16 11:47:10,566 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-93:job-213) release mem from host: 33, old used: 8053063680,reserved: 268435456, total: 16164937152; new used: 7516192768,reserved:268435456; movedfromreserved: false,moveToReserveredfalse 2012-12-16 11:47:10,698 INFO [cloud.api.ApiDispatcher] (Job-Executor-93:job-213) Unable to create a deployment for VM[User|i-3-205-VM] 2012-12-16 11:47:10,698 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-93:job-213) Complete async job-213, jobStatus: 2, resultCode: 530, result: com.cloud.api.response.ExceptionResponse@2e0ac41 2012-12-16 11:47:12,221 DEBUG [cloud.async.AsyncJobManagerImpl] (TP-Processor2:null) Async job-213 completed 2012-12-16 11:47:12,463 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-5:null) Ping from 36 2012-12-16 11:47:13,474 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-203:null) Ping from 33 2012-12-16 11:47:14,467 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-104:null) Seq 33-1252065282: Executing request 2012-12-16 11:47:14,659 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-104:null) Seq 33-1252065282: Response Received: 2012-12-16 11:47:14,659 DEBUG [agent.transport.Request] (DirectAgent-104:null) Seq 33-1252065282: Processing: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 10, [{"ClusterSyncAnswer":{"_clusterId":5,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] } 2012-12-16 11:47:17,992 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) StorageCollector is running... 2012-12-16 11:47:18,037 DEBUG [cloud.vm.VirtualMachineManagerImpl] (AgentManager-Handler-6:null) Cleanup succeeded. Details null 2012-12-16 11:47:18,037 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 36-1224719476: Received: { Ans: , MgmtId: 670059313990, via: 36, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2012-12-16 11:47:18,037 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null 2012-12-16 11:47:18,040 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-62:null) Seq 38-1377501325: Executing request 2012-12-16 11:47:18,388 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-62:null) Seq 38-1377501325: Response Received: 2012-12-16 11:47:18,388 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-62:null) Cleanup succeeded. Details null 2012-12-16 11:47:18,388 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 38-1377501325: Received: { Ans: , MgmtId: 670059313990, via: 38, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2012-12-16 11:47:18,388 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null 2012-12-16 11:47:23,810 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) VmStatsCollector is running... 2012-12-16 11:47:23,821 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-211:null) Seq 33-1252223956: Executing request 2012-12-16 11:47:23,994 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-211:null) Vm cpu utilization 0.375 2012-12-16 11:47:23,995 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-211:null) Vm cpu utilization 0.08 2012-12-16 11:47:23,995 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-211:null) Vm cpu utilization 0.53 2012-12-16 11:47:23,995 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-211:null) Vm cpu utilization 1.15 2012-12-16 11:47:23,995 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-211:null) Vm cpu utilization 0.065 2012-12-16 11:47:23,995 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-211:null) Seq 33-1252223956: Response Received: 2012-12-16 11:47:23,995 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-211:null) Cleanup succeeded. Details null 2012-12-16 11:47:23,995 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 33-1252223956: Received: { Ans: , MgmtId: 670059313990, via: 33, Ver: v1, Flags: 10, { GetVmStatsAnswer } } 2012-12-16 11:47:23,995 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null > Unable to create VM Instance after being able to creating small number of VMs. > ------------------------------------------------------------------------------ > > Key: CLOUDSTACK-581 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-581 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: 4.0.0 > Environment: Management Server on Centos 6.3, > Reporter: Adam Kamali > Priority: Critical > > I successfully managed to deploy number of VMs, afterwords I lost the ability > and all what I get: Unable to create a deplyment for VM (user| VM name) > [root@csman ~]# tailf /var/log/cloud/management/catalina.out > INFO [network.vpc.VpcManagerImpl] (VpcChecker-1:) Found 0 removed VPCs to > cleanup > INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-1:) checking health of usage > server > INFO [api.commands.DeployVMCmd] (Job-Executor-32:job-48) > com.cloud.exception.InsufficientServerCapacityException: Unable to create a > deployment for VM[User|one]Scope=interface com.cloud.dc.DataCenter; id=1 > WARN [cloud.api.ApiDispatcher] (Job-Executor-32:job-48) class > com.cloud.api.ServerApiException : Unable to create a deployment for > VM[User|one] > WARN [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:) > unable to find stats for account: 2 > INFO [xen.resource.CitrixResourceBase] (DirectAgent-381:) Removed network > rules for vm i-2-5-VM > INFO [xen.resource.XenServer56Resource] (DirectAgent-381:) Catch > com.xensource.xenapi.Types$VifInUse: failed to destory VLAN eth1 on host > dee52e9f-76a9-44ac-b358-6f1142469b63 due to Network has active VIFs > INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-1:) checking health of usage > server > WARN [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:) > unable to find stats for account: 2 > WARN [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:) > unable to find stats for account: 2 > Trust me, I have enough Space on my primary storage (77% use), lost of > Memory, CPU and IPs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira