Following up on yesterdays message about VDI's not getting created.
My setup has 6 XS6.0.2 hosts using CS 4.0.2 on ubuntu.
When using XenCenter I have no problems creating a VD on the NFS store.
When creating the zone I saw this error go by in the logs. Not sure if it
is related or not:
2013-05-03 04:27:34,005 DEBUG [agent.transport.Request]
(DirectAgent-6:null) Seq 1-570294274: Processing: { Ans: , MgmtId:
159090355471823, via: 1, Ver: v1, Flags:
10,
[{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
}
2013-05-03 04:27:34,378 DEBUG [xen.resource.XenServerConnectionPool]
(DirectAgent-5:null) XmlRpcException for method: host.call_plugin due to
Failed to create input
stream: Read timed out. Reconnecting...retry=1
2013-05-03 04:27:34,378 DEBUG [xen.resource.CitrixResourceBase]
(DirectAgent-5:null) callHostPlugin failed for cmd: setLinkLocalIP with
args brName: xapi7, due to F
ailed to create input stream: Read timed out
2013-05-03 04:27:34,379 WARN [agent.manager.DirectAgentAttache]
(DirectAgent-5:null) Seq 1-570294278: Exception Caught while executing
command
com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for
cmd: setLinkLocalIP with args brName: xapi7, due to Failed to create input
stream: Read t
imed out
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:3745)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.setupLinkLocalNetwork(CitrixResourceBase.java:4413)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2917)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:433)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-05-03 04:27:34,381 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-5:null) Seq 1-570294278: Response Received:
2013-05-03 04:27:34,381 DEBUG [agent.transport.Request]
(DirectAgent-5:null) Seq 1-570294278: Processing: { Ans: , MgmtId:
159090355471823, via: 1, Ver: v1, Flags:
110,
[{"Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException:
callHostPlugin failed for cmd: setLinkLocalIP with args brName: xapi7, d
ue to Failed to create input stream: Read timed out","wait":0}}] }
2013-05-03 04:27:34,382 DEBUG [agent.manager.AgentAttache]
(DirectAgent-5:null) Seq 1-570294278: No more commands found
2013-05-03 04:27:34,382 DEBUG [agent.transport.Request]
(catalina-exec-2:null) Seq 1-570294278: Received: { Ans: , MgmtId:
159090355471823, via: 1, Ver: v1, Flags:
110, { Answer } }
2013-05-03 04:27:34,382 DEBUG [agent.manager.AgentManagerImpl]
(catalina-exec-2:null) Details from executing class
com.cloud.agent.api.ReadyCommand: com.cloud.utils.
exception.CloudRuntimeException: callHostPlugin failed for cmd:
setLinkLocalIP with args brName: xapi7, due to Failed to create input
stream: Read timed out
Here is the error I am getting when the system vms are failing to start:
2013-05-03 04:36:31,194 DEBUG [cloud.template.TemplateManagerImpl]
(secstorage-1:null) Downloading template 1 to pool 206
2013-05-03 04:36:31,213 DEBUG [cloud.template.TemplateManagerImpl]
(secstorage-1:null) Downloading 1 via 6
2013-05-03 04:36:31,221 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 6-85065741: Sending { Cmd , MgmtId: 159090355471823, via: 6, Ver: v1,
Flags: 100111,
[{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/db74fb7a-1647-3599-b751-57658758d8d1","poolUuid":"db74fb7a-1647-3599-b751-57658758d8d1","poolId":206,"s
econdaryStorageUrl":"nfs://192.168.1.150/store/secondary
","primaryStorageUrl":"nfs://192.168.200.1/export/primary","url":"nfs://
192.168.1.150/store/secondary/templat
e/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
}
2013-05-03 04:36:31,221 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 6-85065741: Executing: { Cmd , MgmtId: 159090355471823, via: 6, Ver:
v1, Flags: 1001
11,
[{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/db74fb7a-1647-3599-b751-57658758d8d1","poolUuid":"db74fb7a-1647-3599-b751-57658758d8d1","poolId":206
,"secondaryStorageUrl":"nfs://192.168.1.150/store/secondary
","primaryStorageUrl":"nfs://192.168.200.1/export/primary","url":"nfs://
192.168.1.150/store/secondary/temp
late/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
}
2013-05-03 04:36:31,222 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-88:null) Seq 6-85065741: Executing request
2013-05-03 04:36:31,539 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-89:null) Seq 6-85065740: Response Received:
2013-05-03 04:36:31,539 DEBUG [agent.transport.Request]
(StatsCollector-2:null) Seq 6-85065740: Received: { Ans: , MgmtId:
159090355471823, via: 6, Ver: v1, Flags:
10, { GetStorageStatsAnswer } }
2013-05-03 04:36:31,548 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-87:null) Seq 4-1497628684: Executing request
2013-05-03 04:36:32,327 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-87:null) Seq 4-1497628684: Response Received:
2013-05-03 04:36:32,327 DEBUG [agent.transport.Request]
(StatsCollector-2:null) Seq 4-1497628684: Received: { Ans: , MgmtId:
159090355471823, via: 4, Ver: v1, Flags
: 10, { GetStorageStatsAnswer } }
2013-05-03 04:36:33,789 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-88:null) destoryVDIbyNameLabel failed due to there are 0 VDIs
with name cloud-4a34bd48-1
c39-4d4f-935c-182fd3155e5e
2013-05-03 04:36:33,790 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-88:null) can not create vdi in sr
58c79a5f-9e23-ebdd-6de6-ec99878ab97f
2013-05-03 04:36:33,790 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-88:null) Catch Exception
com.cloud.utils.exception.CloudRuntimeException on
host:2ea5a521-7407-47fd-b095-e91d0711f2c2 for template: nfs://
192.168.1.150/store/secondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
58c79a5f-9e23-ebdd-6de6-ec99878ab97f
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
58c79a5f-9e23-ebdd-6de6-ec99878ab97f
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2672)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2694)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:481)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-05-03 04:36:33,791 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-88:null) Seq 6-85065741: Response Received:
2013-05-03 04:36:33,792 DEBUG [agent.transport.Request]
(DirectAgent-88:null) Seq 6-85065741: Processing: { Ans: , MgmtId:
159090355471823, via: 6, Ver: v1, Flags: 110,
[{"storage.PrimaryStorageDownloadAnswer":{"templateSize":0,"result":false,"details":"Catch
Exception com.cloud.utils.exception.CloudRuntimeException on
host:2ea5a521-7407-47fd-b095-e91d0711f2c2 for template: nfs://
192.168.1.150/store/secondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
58c79a5f-9e23-ebdd-6de6-ec99878ab97f","wait":0}}] }
2013-05-03 04:36:33,792 DEBUG [agent.manager.AgentAttache]
(DirectAgent-88:null) Seq 6-85065741: No more commands found
2013-05-03 04:36:33,792 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 6-85065741: Received: { Ans: , MgmtId: 159090355471823, via: 6, Ver:
v1, Flags: 110, { PrimaryStorageDownloadAnswer } }
2013-05-03 04:36:33,793 DEBUG [agent.manager.AgentManagerImpl]
(secstorage-1:null) Details from executing class
com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: Catch Exception
com.cloud.utils.exception.CloudRuntimeException on
host:2ea5a521-7407-47fd-b095-e91d0711f2c2 for template: nfs://
192.168.1.150/store/secondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
58c79a5f-9e23-ebdd-6de6-ec99878ab97f
2013-05-03 04:36:33,793 DEBUG [cloud.template.TemplateManagerImpl]
(secstorage-1:null) Template 1 download to pool 206 failed due to Catch
Exception com.cloud.utils.exception.CloudRuntimeException on
host:2ea5a521-7407-47fd-b095-e91d0711f2c2 for template: nfs://
192.168.1.150/store/secondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
58c79a5f-9e23-ebdd-6de6-ec99878ab97f