I still meet the same result. In ubuntu 12.04, 1. I install libvirt-dev as below, apt-get install libvirt-dev 2. rebuild libvirt, see detail build log in attach. root@ubuntu:~/install/libvirt-0.10.2# ./autogen.sh running CONFIG_SHELL=/bin/bash /bin/bash ./configure --enable-rbd --no-create --no-recursion configure: WARNING: unrecognized options: --enable-rbd ..... make make install
On Wed, Apr 17, 2013 at 6:25 PM, Wido den Hollander <w...@widodh.nl> wrote: > Hi, > > > On 04/17/2013 11:37 AM, Guangjian Liu wrote: > >> Thanks for your mail, you suggest compile libvirt with RBD enable. >> I already build libvirt-0.10.2.tar.gz as document >> http://ceph.com/docs/master/**rbd/libvirt/<http://ceph.com/docs/master/rbd/libvirt/>in >> my SERVER C(Ubuntu 12.04), >> Shall I build libvirt-0.10.2.tar.gz with RBD enable? use ./configure >> --enable-rbd instead autogen.sh? >> >> > Well, you don't have to add --enable-rbd to configure nor autogen.sh, but > you have to make sure the development libraries for librbd are installed. > > On CentOS do this: > > yum install librbd-devel > > And retry autogen.sh for libvirt, it should tell you RBD is enabled. > > Wido > > cd libvirt >> ./autogen.sh >> make >> sudo make install >> >> >> >> On Wed, Apr 17, 2013 at 4:37 PM, Wido den Hollander <w...@widodh.nl> >> wrote: >> >> Hi, >>> >>> >>> On 04/17/2013 01:44 AM, Guangjian Liu wrote: >>> >>> Create rbd primary storage fail in CS 4.0.1 >>>> Anybody can help about it! >>>> >>>> Environment: >>>> 1. Server A: CS 4.0.1 OS: RHEL 6.2 x86-64 >>>> 2. Server B: Ceph 0.56.4 OS: RHEL 6.2 x86-64 >>>> 3. Server C: KVM/Qemu OS: Ubuntu 12.04 >>>> compile libvirt and Qemu as document >>>> root@ubuntu:/usr/local/lib# virsh version >>>> Compiled against library: libvirt 0.10.2 >>>> Using library: libvirt 0.10.2 >>>> Using API: QEMU 0.10.2 >>>> Running hypervisor: QEMU 1.0.0 >>>> >>>> >>>> Are you sure both libvirt and Qemu are compiled with RBD enabled? >>> >>> On your CentOS system you should make sure librbd-dev is installed during >>> compilation of libvirt and Qemu. >>> >>> The most important part is the RBD storage pool support in libvirt, that >>> should be enabled. >>> >>> In the e-mail you send me directly I saw this: >>> >>> root@ubuntu:~/scripts# virsh pool-define rbd-pool.xml error: Failed to >>> define pool from rbd-pool.xml error: internal error missing backend for >>> pool type 8 >>> >>> That suggest RBD storage pool support is not enabled in libvirt. >>> >>> Wido >>> >>> >>> Problem: >>> >>>> create primary storage fail with rbd device. >>>> >>>> Fail log: >>>> 2013-04-16 16:27:14,224 DEBUG [cloud.storage.****StorageManagerImpl] >>>> >>>> (catalina-exec-9:null) createPool Params @ scheme - rbd storageHost - >>>> 10.0.0.41 hostPath - /cloudstack port - -1 >>>> 2013-04-16 16:27:14,270 DEBUG [cloud.storage.****StorageManagerImpl] >>>> >>>> (catalina-exec-9:null) In createPool Setting poolId - 218 uuid - >>>> 5924a2df-d658-3119-8aba-****f90307683206 zoneId - 4 podId - 4 poolName >>>> - >>>> ceph >>>> 2013-04-16 16:27:14,318 DEBUG [cloud.storage.****StorageManagerImpl] >>>> >>>> (catalina-exec-9:null) creating pool ceph on host 18 >>>> 2013-04-16 16:27:14,320 DEBUG [agent.transport.Request] >>>> (catalina-exec-9:null) Seq 18-1625162275: Sending { Cmd , MgmtId: >>>> 37528005876872, via: 18, Ver: v1, Flags: 100011, >>>> [{"CreateStoragePoolCommand":{****"add":true,"pool":{"id":218,**"** >>>> uuid":"5924a2df-d658-3119-****8aba-f90307683206","host":"10.**** >>>> 0.0.41","path":"cloudstack","****userInfo":":","port":6789,"** >>>> type":"RBD"},"localPath":"/****mnt//3cf4f0e8-781d-39d8-b81c-**** >>>> >>>> 9896da212335","wait":0}}] >>>> } >>>> 2013-04-16 16:27:14,323 DEBUG [agent.transport.Request] >>>> (AgentManager-Handler-2:null) Seq 18-1625162275: Processing: { Ans: , >>>> MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10, >>>> [{"Answer":{"result":true,"****details":"success","wait":0}}] } >>>> >>>> 2013-04-16 16:27:14,323 DEBUG [agent.transport.Request] >>>> (catalina-exec-9:null) Seq 18-1625162275: Received: { Ans: , MgmtId: >>>> 37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } } >>>> 2013-04-16 16:27:14,323 DEBUG [agent.manager.****AgentManagerImpl] >>>> >>>> (catalina-exec-9:null) Details from executing class >>>> com.cloud.agent.api.****CreateStoragePoolCommand: success >>>> 2013-04-16 16:27:14,323 DEBUG [cloud.storage.****StorageManagerImpl] >>>> >>>> (catalina-exec-9:null) In createPool Adding the pool to each of the >>>> hosts >>>> 2013-04-16 16:27:14,323 DEBUG [cloud.storage.****StorageManagerImpl] >>>> >>>> (catalina-exec-9:null) Adding pool ceph to host 18 >>>> 2013-04-16 16:27:14,326 DEBUG [agent.transport.Request] >>>> (catalina-exec-9:null) Seq 18-1625162276: Sending { Cmd , MgmtId: >>>> 37528005876872, via: 18, Ver: v1, Flags: 100011, >>>> [{"ModifyStoragePoolCommand":{****"add":true,"pool":{"id":218,**"** >>>> uuid":"5924a2df-d658-3119-****8aba-f90307683206","host":"10.**** >>>> 0.0.41","path":"cloudstack","****userInfo":":","port":6789,"** >>>> type":"RBD"},"localPath":"/****mnt//3cf4f0e8-781d-39d8-b81c-**** >>>> >>>> 9896da212335","wait":0}}] >>>> } >>>> 2013-04-16 16:27:14,411 DEBUG [agent.transport.Request] >>>> (AgentManager-Handler-6:null) Seq 18-1625162276: Processing: { Ans: , >>>> MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10, >>>> [{"Answer":{"result":false,"****details":"java.lang.** >>>> NullPointerException\n\tat >>>> com.cloud.hypervisor.kvm.****storage.LibvirtStorageAdaptor.**** >>>> createStoragePool(****LibvirtStorageAdaptor.java:****462)\n\tat >>>> com.cloud.hypervisor.kvm.****storage.KVMStoragePoolManager.**** >>>> createStoragePool(****KVMStoragePoolManager.java:57)****\n\tat >>>> com.cloud.hypervisor.kvm.****resource.****LibvirtComputingResource.**** >>>> execute( >>>> **LibvirtComputingResource.**java:**2087)\n\tat >>>> com.cloud.hypervisor.kvm.****resource.****LibvirtComputingResource.** >>>> executeRequest(****LibvirtComputingResource.java:****1053)\n\tat >>>> com.cloud.agent.Agent.****processRequest(Agent.java:518)****\n\tat >>>> com.cloud.agent.Agent$****AgentRequestHandler.doTask(** >>>> Agent.java:831)\n\tat >>>> com.cloud.utils.nio.Task.run(****Task.java:83)\n\tat >>>> java.util.concurrent.****ThreadPoolExecutor.runWorker(**** >>>> ThreadPoolExecutor.java:1146)\****n\tat >>>> java.util.concurrent.****ThreadPoolExecutor$Worker.run(**** >>>> ThreadPoolExecutor.java:615)\****n\tat >>>> java.lang.Thread.run(Thread.****java:679)\n","wait":0}}] } >>>> >>>> 2013-04-16 16:27:14,412 DEBUG [agent.transport.Request] >>>> (catalina-exec-9:null) Seq 18-1625162276: Received: { Ans: , MgmtId: >>>> 37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } } >>>> 2013-04-16 16:27:14,412 DEBUG [agent.manager.****AgentManagerImpl] >>>> >>>> (catalina-exec-9:null) Details from executing class >>>> com.cloud.agent.api.****ModifyStoragePoolCommand: >>>> java.lang.NullPointerException >>>> at >>>> com.cloud.hypervisor.kvm.****storage.LibvirtStorageAdaptor.**** >>>> createStoragePool(****LibvirtStorageAdaptor.java:****462) >>>> at >>>> com.cloud.hypervisor.kvm.****storage.KVMStoragePoolManager.**** >>>> createStoragePool(****KVMStoragePoolManager.java:57) >>>> at >>>> com.cloud.hypervisor.kvm.****resource.****LibvirtComputingResource.**** >>>> execute( >>>> **LibvirtComputingResource.**java:**2087) >>>> at >>>> com.cloud.hypervisor.kvm.****resource.****LibvirtComputingResource.** >>>> executeRequest(****LibvirtComputingResource.java:****1053) >>>> at com.cloud.agent.Agent.****processRequest(Agent.java:518) >>>> at com.cloud.agent.Agent$****AgentRequestHandler.doTask(** >>>> Agent.java:831) >>>> at com.cloud.utils.nio.Task.run(****Task.java:83) >>>> at >>>> java.util.concurrent.****ThreadPoolExecutor.runWorker(**** >>>> ThreadPoolExecutor.java:1146) >>>> at >>>> java.util.concurrent.****ThreadPoolExecutor$Worker.run(**** >>>> ThreadPoolExecutor.java:615) >>>> at java.lang.Thread.run(Thread.****java:679) >>>> >>>> 2013-04-16 16:27:14,451 WARN [cloud.storage.****StorageManagerImpl] >>>> >>>> (catalina-exec-9:null) Unable to establish a connection between >>>> Host[-18-Routing] and Pool[218|RBD] >>>> com.cloud.exception.****StorageUnavailableException: Resource >>>> >>>> [StoragePool:218] >>>> is unreachable: Unable establish connection from storage head to storage >>>> pool 218 due to java.lang.NullPointerException >>>> at >>>> com.cloud.hypervisor.kvm.****storage.LibvirtStorageAdaptor.**** >>>> createStoragePool(****LibvirtStorageAdaptor.java:****462) >>>> at >>>> com.cloud.hypervisor.kvm.****storage.KVMStoragePoolManager.**** >>>> createStoragePool(****KVMStoragePoolManager.java:57) >>>> at >>>> com.cloud.hypervisor.kvm.****resource.****LibvirtComputingResource.**** >>>> execute( >>>> **LibvirtComputingResource.**java:**2087) >>>> at >>>> com.cloud.hypervisor.kvm.****resource.****LibvirtComputingResource.** >>>> executeRequest(****LibvirtComputingResource.java:****1053) >>>> at com.cloud.agent.Agent.****processRequest(Agent.java:518) >>>> at com.cloud.agent.Agent$****AgentRequestHandler.doTask(** >>>> Agent.java:831) >>>> at com.cloud.utils.nio.Task.run(****Task.java:83) >>>> at >>>> java.util.concurrent.****ThreadPoolExecutor.runWorker(**** >>>> ThreadPoolExecutor.java:1146) >>>> at >>>> java.util.concurrent.****ThreadPoolExecutor$Worker.run(**** >>>> ThreadPoolExecutor.java:615) >>>> at java.lang.Thread.run(Thread.****java:679) >>>> >>>> at >>>> com.cloud.storage.****StorageManagerImpl.****connectHostToSharedPool(** >>>> StorageManagerImpl.java:1685) >>>> at >>>> com.cloud.storage.****StorageManagerImpl.createPool(**** >>>> StorageManagerImpl.java:1450) >>>> at >>>> com.cloud.storage.****StorageManagerImpl.createPool(**** >>>> StorageManagerImpl.java:215) >>>> at >>>> com.cloud.api.commands.****CreateStoragePoolCmd.execute(**** >>>> CreateStoragePoolCmd.java:120) >>>> at com.cloud.api.ApiDispatcher.**** >>>> dispatch(ApiDispatcher.java:** >>>> 138) >>>> at com.cloud.api.ApiServer.****queueCommand(ApiServer.java:** >>>> **543) >>>> at com.cloud.api.ApiServer.****handleRequest(ApiServer.java:* >>>> ***422) >>>> at com.cloud.api.ApiServlet.****processRequest(ApiServlet.** >>>> java:304) >>>> at com.cloud.api.ApiServlet.****doGet(ApiServlet.java:63) >>>> at javax.servlet.http.****HttpServlet.service(** >>>> HttpServlet.java:617) >>>> at javax.servlet.http.****HttpServlet.service(** >>>> HttpServlet.java:717) >>>> at >>>> org.apache.catalina.core.****ApplicationFilterChain.**** >>>> internalDoFilter(** >>>> ApplicationFilterChain.java:****290) >>>> at >>>> org.apache.catalina.core.****ApplicationFilterChain.****doFilter(** >>>> ApplicationFilterChain.java:****206) >>>> at >>>> org.apache.catalina.core.****StandardWrapperValve.invoke(** >>>> StandardWrapperValve.java:233) >>>> at >>>> org.apache.catalina.core.****StandardContextValve.invoke(** >>>> StandardContextValve.java:191) >>>> at >>>> org.apache.catalina.core.****StandardHostValve.invoke(** >>>> StandardHostValve.java:127) >>>> at >>>> org.apache.catalina.valves.****ErrorReportValve.invoke(** >>>> ErrorReportValve.java:102) >>>> at >>>> org.apache.catalina.valves.****AccessLogValve.invoke(** >>>> AccessLogValve.java:555) >>>> at >>>> org.apache.catalina.core.****StandardEngineValve.invoke(** >>>> StandardEngineValve.java:109) >>>> at >>>> org.apache.catalina.connector.****CoyoteAdapter.service(** >>>> CoyoteAdapter.java:298) >>>> at >>>> org.apache.coyote.http11.****Http11NioProcessor.process(** >>>> Http11NioProcessor.java:889) >>>> at >>>> org.apache.coyote.http11.****Http11NioProtocol$**** >>>> Http11ConnectionHandler.** >>>> process(Http11NioProtocol.****java:721) >>>> at >>>> org.apache.tomcat.util.net.****NioEndpoint$SocketProcessor.** >>>> run(NioEndpoint.java:2260) >>>> at >>>> java.util.concurrent.****ThreadPoolExecutor.runWorker(**** >>>> ThreadPoolExecutor.java:1110) >>>> at >>>> java.util.concurrent.****ThreadPoolExecutor$Worker.run(**** >>>> ThreadPoolExecutor.java:603) >>>> at java.lang.Thread.run(Thread.****java:679) >>>> 2013-04-16 16:27:14,452 WARN [cloud.storage.****StorageManagerImpl] >>>> >>>> (catalina-exec-9:null) No host can access storage pool Pool[218|RBD] on >>>> cluster 5 >>>> 2013-04-16 16:27:14,504 WARN [cloud.api.ApiDispatcher] >>>> (catalina-exec-9:null) class com.cloud.api.****ServerApiException : >>>> Failed >>>> to >>>> add storage pool >>>> 2013-04-16 16:27:15,293 DEBUG [agent.manager.****AgentManagerImpl] >>>> >>>> (AgentManager-Handler-12:null) Ping from 18 >>>> ^C >>>> [root@RDR02S02 management]# >>>> >>>> >>>> >> >> -- Guangjian
