Hey all,
i currently evaluate the usage of multiple hypervisors in one CS advanced
zone:
I tried to create a template from a volume which was created an Vsphere.
The secondary Storage is working. I can create Templates for XenServer, for
KVM, I can launch Instances on all three kinds of hypervisors, I can upload
ISOs / Templates.
The SecStorage is mounted on the VSphere host, I can browse the datastore, I
can create files.
BUT
I still get the following error if I try to create a template from a root
disk which was created with VSphere:
There are no error message in vcenter.
013-12-06 12:07:49,901 DEBUG [cloud.network.NetworkUsageManagerImpl]
(Cluster-Worker-9:null) Disconnected called on 9 with status Alert
2013-12-06 12:07:49,902 DEBUG [agent.manager.AgentManagerImpl]
(Cluster-Worker-9:null) Sending Disconnect to listener:
com.cloud.consoleproxy.ConsoleProxyListener
2013-12-06 12:07:49,900 DEBUG [cloudstack.storage.RemoteHostEndPoint]
(Job-Executor-1:job-35 = [ d7108061-c9ff-479e-9855-40ed6faae9bf ]) Failed to
send command, due to Agent:5,
com.cloud.exception.OperationTimedoutException: Commands 1351352351 to Host
9 timed out after 21600
2013-12-06 12:07:49,902 DEBUG [storage.motion.AncientDataMotionStrategy]
(Job-Executor-1:job-35 = [ d7108061-c9ff-479e-9855-40ed6faae9bf ]) copy
object failed:
com.cloud.utils.exception.CloudRuntimeException: Failed to send command, due
to Agent:5, com.cloud.exception.OperationTimedoutException: Commands
1351352351 to Host 9 timed out after 21600
at
org.apache.cloudstack.storage.RemoteHostEndPoint.sendMessage(RemoteHostEndPo
int.java:104)
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyObject(An
cientDataMotionStrategy.java:196)
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(Anc
ientDataMotionStrategy.java:397)
at
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMot
ionServiceImpl.java:58)
at
org.apache.cloudstack.storage.image.TemplateServiceImpl.copyAsync(TemplateSe
rviceImpl.java:594)
at
org.apache.cloudstack.storage.image.TemplateServiceImpl.createTemplateFromVo
lumeAsync(TemplateServiceImpl.java:607)
at
com.cloud.template.TemplateManagerImpl.createPrivateTemplate(TemplateManager
Impl.java:1385)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDis
patcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.template.CreateTemplateCmd.execute(Cr
eateTemplateCmd.java:263)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
46)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15)
at java.lang.Thread.run(Thread.java:701)
2013-12-06 12:07:49,903 DEBUG [storage.motion.AncientDataMotionStrategy]
(Job-Executor-1:job-35 = [ d7108061-c9ff-479e-9855-40ed6faae9bf ]) copy
failed
com.cloud.utils.exception.CloudRuntimeException:
com.cloud.utils.exception.CloudRuntimeException: Failed to send command, due
to Agent:5, com.cloud.exception.OperationTimedoutException: Commands
1351352351 to Host 9 timed out after 21600
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyObject(An
cientDataMotionStrategy.java:217)
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(Anc
ientDataMotionStrategy.java:397)
at
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMot
ionServiceImpl.java:58)
at
org.apache.cloudstack.storage.image.TemplateServiceImpl.copyAsync(TemplateSe
rviceImpl.java:594)
at
org.apache.cloudstack.storage.image.TemplateServiceImpl.createTemplateFromVo
lumeAsync(TemplateServiceImpl.java:607)
at
com.cloud.template.TemplateManagerImpl.createPrivateTemplate(TemplateManager
Impl.java:1385)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDis
patcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.template.CreateTemplateCmd.execute(Cr
eateTemplateCmd.java:263)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
46)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15)
CS complains that Host with ID=9 (secstorage VM) is not reachable. But the
SSVM is reachable, as I said, it works for all other SecStorage related
tasks, it only fails for the Template creation of a VSphere root disk.
All Datastores are NFS.
The interesting thing is, if I set the global parameter
system.vm.default.hypervisor to vmware and I destroy the SSVM so that she is
created on VMWare. Everything works.
I still have the feeling that multiple hypervisors are leading to problems.
Whats your experience with that? Is there a way to use three Secstorage VMs?
For example one for vsphere one for XEN and one for KVM?