[
https://issues.apache.org/jira/browse/CLOUDSTACK-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13654456#comment-13654456
]
Rajesh Battala commented on CLOUDSTACK-2330:
--------------------------------------------
Rayees,
The issue is related to the storage in the KVM.
Looks like the kvm host is already used one and clean up didn't happen when the
same kvm host is used for managing in the new setup.
when the libvirt got restarted, it got reset and so it was working fine.
if the issue is happening with clean host, then its definitely a bug.
please verify the same.
and post the logs of the agent and mgmt server.
enable the agent logging in debug mode,
post the logs from the kvm host from the location ( zip all the log files in
that dir)
/var/log/cloudstack/agent/
> [Automation] Failed to deploy VR in KVM
> ----------------------------------------
>
> Key: CLOUDSTACK-2330
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2330
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Management Server
> Affects Versions: 4.2.0
> Environment: KVM,
> Master build
> Reporter: Rayees Namathponnan
> Assignee: Rajesh Battala
> Priority: Blocker
> Fix For: 4.2.0
>
> Attachments: CLOUDSTACK-2330.rar
>
>
> Automation running on KVM with advanced zone,VR deployment failing during
> automation run
> Observed below error in MS log, attaching MS and agent log
> 2013-05-04 13:43:13,032 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-99:job-369)
> Reapplying vm data (userData and metaData) entries as a part of domR
> VM[DomainRouter|r-155-VM] start...
> 2013-05-04 13:43:13,040 DEBUG [agent.transport.Request]
> (Job-Executor-99:job-369) Seq 4-98894092: Sending { Cmd , MgmtId:
> 29066118877352, via: 4, Ver: v1, Flags: 100111, [{"Sta
> rtCommand":{"vm":{"id":155,"name":"r-155-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os":"Debian
> GNU/
> Linux 5.0 (32-bit)","bootArgs":" template=domP name=r-155-VM
> eth2ip=10.223.122.89 eth2mask=255.255.255.192 gateway=10.223.122.65
> eth0ip=10.1.1.1 eth0mask=255.255.255.0 domain=cs
> 2auto.advanced dhcprange=10.1.1.1 eth1ip=169.254.3.220 eth1mask=255.255.0.0
> type=router disable_rp_filter=true
> dns1=72.52.126.11","rebootOnCrash":false,"enableHA":true,"limitCpu
> Use":false,"vncPassword":"a3b0c243e954e90e","params":{},"uuid":"f114bcc5-1f3f-4fcb-85f7-3ed9d40467dc","disks":[{"id":155,"name":"ROOT-155","size":741212160,"type":"ROOT","storag
> ePoolType":"NetworkFilesystem","storagePoolUuid":"fff90cb5-06dd-33b3-8815-d78c08ca01d9","deviceId":0}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"uuid":"1dee
> a081-1ca4-4af5-ba98-bdac0dac722f","ip":"10.223.122.89","netmask":"255.255.255.192","gateway":"10.223.122.65","mac":"06:31:6c:00:00:52","dns1":"72.52.126.11","broadcastType":"Vla
> n","type":"Public","broadcastUri":"vlan://1221","isolationUri":"vlan://1221","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"uuid":"abb44
> 284-bbc9-41e6-a1d5-53b2a9256ee6","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:71:47:00:02","dns1":"72.52.126.11","broadcastType":"Vlan","type":"Guest","broadcastUri":"
> vlan://2354","isolationUri":"vlan://2354","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"8b060664-4c4f-4f0f-bffc-87871cbab662","ip
> ":"169.254.3.220","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:03:dc","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostI
> p":"10.223.50.66","wait":0}},{"check.CheckSshCommand":{"ip":"169.254.3.220","port":3922,"interval":6,"retries":100,"name":"r-155-VM","wait":0}},{"GetDomRVersionCmd":{"accessDeta
> ils":{"router.ip":"169.254.3.220","router.name":"r-155-VM"},"wait":0}},{},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.223.122.89","sourceNat":true,"a
> dd":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1221","vlanGateway":"10.223.122.65","vlanNetmask":"255.255.255.192","vifMacAddress":"06:bb:60:00:00:52","networkRate":200,"
> trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.3.220","router.name":"r-155-VM"},"wait":0}}]
> }
> 2013-05-04 13:43:13,306 DEBUG [agent.transport.Request]
> (AgentManager-Handler-10:null) Seq 4-98894092: Processing: { Ans: , MgmtId:
> 29066118877352, via: 4, Ver: v1, Flags: 110,
>
> [{"Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException:
> org.libvirt.LibvirtException: invalid argument:
> virStorageVolLookupByName\n\tat com.cloud
> .hypervisor.kvm.storage.LibvirtStorageAdaptor.getVolume(LibvirtStorageAdaptor.java:95)\n\tat
>
> com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getPhysicalDisk(LibvirtStorag
> eAdaptor.java:390)\n\tat
> com.cloud.hypervisor.kvm.storage.LibvirtStoragePool.getPhysicalDisk(LibvirtStoragePool.java:123)\n\tat
> com.cloud.hypervisor.kvm.resource.LibvirtComputin
> gResource.createVbd(LibvirtComputingResource.java:3323)\n\tat
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3214)\n\tat
> com.cl
> oud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1172)\n\tat
> com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat com.clou
> d.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat
> com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecu
> tor.java:1110)\n\tat
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat
> java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result
> ":false,"details":"Stopped by previous
> failure","wait":0}},{"Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}},{"Answer":{"result":false,"details":"Stop
> ped by previous
> failure","wait":0}},{"Answer":{"result":false,"details":"Stopped by previous
> failure","wait":0}}] }
> 2013-05-04 13:43:13,306 DEBUG [agent.manager.AgentAttache]
> (AgentManager-Handler-10:null) Seq 4-98894092: No more commands found
> 2013-05-04 13:43:13,306 DEBUG [agent.transport.Request]
> (Job-Executor-99:job-369) Seq 4-98894092: Received: { Ans: , MgmtId:
> 29066118877352, via: 4, Ver: v1, Flags: 110, { Answ
> er, Answer, Answer, Answer, Answer } }
> 2013-05-04 13:43:13,311 ERROR [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-99:job-369) Failed to start instance VM[DomainRouter|r-155-VM]
> com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is
> of class com.cloud.agent.api.StartAnswer
> at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80)
> at
> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:841)
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:529)
> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2641)
> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1850)
> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouters(VirtualNetworkApplianceManagerImpl.java:1950)
> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.deployVirtualRouterInGuestNetwork(VirtualNetworkApplianceManagerImpl.java:1928)
> at
> com.cloud.network.element.VirtualRouterElement.implement(VirtualRouterElement.java:176)
> at
> com.cloud.network.NetworkManagerImpl.implementNetworkElementsAndResources(NetworkManagerImpl.java:1576)
> at
> com.cloud.network.NetworkManagerImpl.implementNetwork(NetworkManagerImpl.java:1481)
> at
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> Note :
> ------
> 1) This is observed in automation environment, multiple time
> 2) In automation we are running, multiple test cases concurrently
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
