Woops! Premature send ;-) We're using this:
--- ./etc/udev/rules.d/50-udev.rules 2011-01-07 21:09:25.000000000 +0000 +++ ./etc/udev/rules.d/50-udev.rules 2011-01-07 21:09:18.000000000 +0000 @@ -10,6 +10,8 @@ SUBSYSTEM=="block", GROUP="disk", MODE="0640" KERNEL=="root", GROUP="disk", MODE="0640" +KERNEL=="xvd[c-p]", GROUP="nova", MODE="0660" + # console devices KERNEL=="tty", NAME="%k", GROUP="tty", MODE="0666", OPTIONS="last_rule" KERNEL=="console", NAME="%k", MODE="0600", OPTIONS="last_rule" In our case, xvda is the root device, and xvdb is the CD-ROM drive, so we've given the nova user xvdc-xvdp. Cheers, Ewan. From: Ewan Mellor Sent: 21 January 2011 09:27 To: 'Rick Harris'; Sandy Walsh; openstack-xenapi@lists.launchpad.net Subject: RE: Glance / Nova - Compute required on Dom0? xvdb will be the device that nova-compute just plugged immediately before (at least, it should be). It goes like this: nova-compute calls xapi and asks for the new disk to be plugged into the domU compute instance. xapi does that, choosing the first available block device. udev inside your domU should create a /dev/xvdN node, corresponding to the hotplug event for the device being added. nova-compute asks xapi which device name was used. nova-compute uses that /dev node to write the partition table, etc. Now looking at it, there's a possible race between xapi returning success for the device hotplug, and udev actually creating the device node. We should use udevsettle to make sure that the device is ready before moving on. I'll get someone on our team to look at that ASAP. Either that's the problem, or your domU isn't creating the /dev/xvdN node at all. Could you check this? You can use udevmonitor to watch the udev events, and check that you're getting the hotplug at all. One more thing - if you're expecting to run nova-compute as an unprivileged user inside your domU (we are) then you need to give that user access to the xvdN block devices. We're using this: From: Rick Harris [mailto:rick.har...@rackspace.com] Sent: 21 January 2011 05:47 To: Ewan Mellor; Sandy Walsh; openstack-xenapi@lists.launchpad.net Subject: RE: Glance / Nova - Compute required on Dom0? I'm in the process of getting Nova/Glance running within a DomU instance. When I attempt to build a VM, the nova-compute worker crashes while it attempts to write the partition table. It looks like the DomU compute instance doesn't have a device /dev/xvdb. Here are the relevant parts of the (massive) traceback: http://paste.openstack.org/show/532/ Any ideas? -Rick ________________________________ From: openstack-xenapi-bounces+rick.harris=rackspace....@lists.launchpad.net [openstack-xenapi-bounces+rick.harris=rackspace....@lists.launchpad.net] on behalf of Ewan Mellor [ewan.mel...@eu.citrix.com] Sent: Wednesday, January 19, 2011 2:33 PM To: Sandy Walsh; openstack-xenapi@lists.launchpad.net Subject: Re: [Openstack-xenapi] Glance / Nova - Compute required on Dom0? Cool, so are you OK with running it like this? We were debating here whether we'd need to add a flag for a developers' mode, but that would involve duplicating lots of code, so I'd rather not. When we're working on nova-compute, we're NFS-mounting the nova source repo from our dev boxes into a test VM. That way, we can switch branches at will, and leave the VM running, and so we don't need to keep redeploying nova just to test it. Cheers, Ewan. From: Sandy Walsh [mailto:sandy.wa...@rackspace.com] Sent: 19 January 2011 18:12 To: Ewan Mellor; openstack-xenapi@lists.launchpad.net Subject: RE: Glance / Nova - Compute required on Dom0? Thanks, Andy informed me of this assumption. I was running it on a separate machine. Good to know that /sys/... is available on all Linux VM's. Don't suppose anyone has created any deploy scripts to make this process easier? Between getting compute on a DomU and installing the plugins, it's getting tricky to jump between development branches. Cheers, Sandy ________________________________ From: Ewan Mellor [ewan.mel...@eu.citrix.com] Sent: Wednesday, January 19, 2011 1:59 PM To: Sandy Walsh; openstack-xenapi@lists.launchpad.net Subject: RE: Glance / Nova - Compute required on Dom0? There's an assumption that nova-compute either runs in dom0, or on a VM on the host that it's managing. In either case, there should be /sys/hypervisor/uuid available. Where are you running it? Ewan. From: openstack-xenapi-bounces+ewan.mellor=citrix....@lists.launchpad.net [mailto:openstack-xenapi-bounces+ewan.mellor=citrix....@lists.launchpad.net] On Behalf Of Sandy Walsh Sent: 19 January 2011 17:45 To: openstack-xenapi@lists.launchpad.net Subject: [Openstack-xenapi] Glance / Nova - Compute required on Dom0? Hi guys, With the merge of xenapi-glance-2 into trunk I'm running into a few problems. I can get the images successfully into/out of Glance now, but when starting the instance I'm hitting http://paste.openstack.org/show/495/ The missing file exists on Dom0, but, is there an assumption here that Compute runs on Dom0? Currently I'm running it separately. Is the no way to get this value via XenAPI? (I've been trying all morning, but can't see to get it) If we don't want to run Compute on Dom0 should I extend the plugin to do this query remotely? Thanks in advance, Sandy Confidentiality Notice: This e-mail message (including any attached or embedded documents) is intended for the exclusive and confidential use of the individual or entity to which this message is addressed, and unless otherwise expressly indicated, is confidential and privileged information of Rackspace. Any dissemination, distribution or copying of the enclosed material is prohibited. If you receive this transmission in error, please notify us immediately by e-mail at ab...@rackspace.com, and delete the original message. Your cooperation is appreciated. Confidentiality Notice: This e-mail message (including any attached or embedded documents) is intended for the exclusive and confidential use of the individual or entity to which this message is addressed, and unless otherwise expressly indicated, is confidential and privileged information of Rackspace. Any dissemination, distribution or copying of the enclosed material is prohibited. If you receive this transmission in error, please notify us immediately by e-mail at ab...@rackspace.com, and delete the original message. Your cooperation is appreciated.
_______________________________________________ Mailing list: https://launchpad.net/~openstack-xenapi Post to : openstack-xenapi@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack-xenapi More help : https://help.launchpad.net/ListHelp
