Chandan Purushothama created CLOUDSTACK-200: -----------------------------------------------
Summary: System VMs failed to deploy due to failure in downloading the template from Secondary Storage to Primary Storage. Key: CLOUDSTACK-200 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-200 Project: CloudStack Issue Type: Bug Components: Management Server Affects Versions: pre-4.0.0 Reporter: Chandan Purushothama Priority: Blocker Fix For: pre-4.0.0 Attachments: management-server.zip ================ Steps to Reproduce: ================ 1. Deploy an Advanced Zone Setup with XenServer 6.0.2 hosts and enable the Zone. 2. Observe the Failure of the System VMs deployment. ================================ PrimaryStorageDownloadCommand Failure: ================================ ** Root Cause** destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-cc41ba85-da23-4c19-b14b-e03c453a6b5e 2012-09-25 13:54:28,189 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-1505689610: Sending { Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolUuid":"bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolId":200,"secondaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary","primaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/primary","url":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}] } 2012-09-25 13:54:28,192 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-1505689610: Executing: { Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolUuid":"bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolId":200,"secondaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary","primaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/primary","url":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}] } 2012-09-25 13:54:28,193 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-2:null) Seq 1-1505689610: Executing request 2012-09-25 13:54:30,425 WARN [xen.resource.CitrixResourceBase] (DirectAgent-2:null) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-cc41ba85-da23-4c19-b14b-e03c453a6b5e 2012-09-25 13:54:30,425 WARN [xen.resource.CitrixResourceBase] (DirectAgent-2:null) can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 2012-09-25 13:54:30,426 WARN [xen.resource.CitrixResourceBase] (DirectAgent-2:null) Catch Exception com.cloud.utils.exception.CloudRuntimeException on host:059c5a7b-ef17-4a77-9f73-81538793062d for template: nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/ due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 at com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2672) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2694) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:481) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-09-25 13:54:30,427 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-2:null) Seq 1-1505689610: Response Received: 2012-09-25 13:54:30,428 DEBUG [agent.transport.Request] (DirectAgent-2:null) Seq 1-1505689610: Processing: { Ans: , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 110, [{"storage.PrimaryStorageDownloadAnswer":{"templateSize":0,"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException on host:059c5a7b-ef17-4a77-9f73-81538793062d for template: nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/ due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9","wait":0}}] } 2012-09-25 13:54:30,431 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-1505689610: Received: { Ans: , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 110, { PrimaryStorageDownloadAnswer } } 2012-09-25 13:54:30,431 DEBUG [agent.manager.AgentManagerImpl] (secstorage-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: Catch Exception com.cloud.utils.exception.CloudRuntimeException on host:059c5a7b-ef17-4a77-9f73-81538793062d for template: nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/ due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 2012-09-25 13:54:30,431 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Template 1 download to pool 200 failed due to Catch Exception com.cloud.utils.exception.CloudRuntimeException on host:059c5a7b-ef17-4a77-9f73-81538793062d for template: nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/ due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 2012-09-25 13:54:30,431 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Downloading 1 via 1 2012-09-25 13:54:30,435 DEBUG [agent.manager.AgentAttache] (DirectAgent-2:null) Seq 1-1505689610: No more commands found 2012-09-25 13:54:30,437 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-1505689611: Sending { Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolUuid":"bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolId":200,"secondaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary","primaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/primary","url":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}] } 2012-09-25 13:54:30,438 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-1505689611: Executing: { Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolUuid":"bea72bcf-de5a-38a4-bfad-ec4a966f5f63","poolId":200,"secondaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary","primaryStorageUrl":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/primary","url":"nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}] } 2012-09-25 13:54:30,438 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-6:null) Seq 1-1505689611: Executing request 2012-09-25 13:54:32,647 WARN [xen.resource.CitrixResourceBase] (DirectAgent-6:null) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-f42f3fb6-601b-415f-b5e4-f00b41da19d8 2012-09-25 13:54:32,647 WARN [xen.resource.CitrixResourceBase] (DirectAgent-6:null) can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 2012-09-25 13:54:32,647 WARN [xen.resource.CitrixResourceBase] (DirectAgent-6:null) Catch Exception com.cloud.utils.exception.CloudRuntimeException on host:059c5a7b-ef17-4a77-9f73-81538793062d for template: nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/ due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9 at com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2672) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2694) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:481) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73) at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2012-09-25 13:54:32,648 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-6:null) Seq 1-1505689611: Response Received: 2012-09-25 13:54:32,649 DEBUG [agent.transport.Request] (DirectAgent-6:null) Seq 1-1505689611: Processing: { Ans: , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 110, [{"storage.PrimaryStorageDownloadAnswer":{"templateSize":0,"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException on host:059c5a7b-ef17-4a77-9f73-81538793062d for template: nfs://10.223.110.232/export/home/chandan/asf4-195-103/secondary/template/tmpl/1/1/ due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr aeb2c76d-8fd3-a066-0dec-3a36464439e9","wait":0}}] } ======= Git Info: ======= Git Revision: ae1c48204893941deba928281946d19a285b98cf Git URL: https://git-wip-us.apache.org/repos/asf/incubator-cloudstack.git -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira