Re: [ceph-users] Infiniband backend OSD communication

2020-01-07 Thread Nathan Stratton
Ok, so ipoib is required... ><> nathan stratton On Mon, Jan 6, 2020 at 4:45 AM Wei Zhao wrote: > From my understanding, the basic idea is that ceph exchange rdma > information(qp,gid and so) through ip address on rdma device, and then > communicate with each other throng rdm

[ceph-users] Infiniband backend OSD communication

2020-01-02 Thread Nathan Stratton
h OSD over RDMA? Do I have to run IPoIB on top of infiniband and use that for OSD addresses? Is there a way to use infiniband on backend without IPoIB and just use rdma verbs? ><> nathan stratton ___ ceph-users mailing list ceph-users@lists

Re: [ceph-users] Ceph in a shared environment

2015-07-10 Thread Nathan Stratton
We do the same, so far no problems. ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com On Fri, Jul 10, 2015 at 6:51 AM, Jan Schermer wrote: > We run CEPH OSDs on the same hosts as QEMU/KVM with OpenStack. You need to > segregate the p

Re: [ceph-users] accept: got bad authorizer

2014-10-09 Thread Nathan Stratton
Yep, that was it. My concern tho is that one node with a bad clock was able to lock the whole 16 node cluster, should that be the case? ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com On Wed, Oct 8, 2014 at 6:48 PM, Gregory Farnum wrote: >

[ceph-users] accept: got bad authorizer

2014-10-08 Thread Nathan Stratton
ot bad authorizer ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Network hardware recommendations

2014-10-08 Thread Nathan Stratton
On Wed, Oct 8, 2014 at 9:25 AM, Massimiliano Cuttini wrote: > > > > Il 08/10/2014 14:39, Nathan Stratton ha scritto: > > On Wed, Oct 8, 2014 at 8:15 AM, Massimiliano Cuttini > wrote: > >> If you want to build up with Viatta. >> And this give you the po

Re: [ceph-users] Network hardware recommendations

2014-10-08 Thread Nathan Stratton
witch and go OpenFlow. ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] RBD on openstack glance+cinder CoW?

2014-10-08 Thread Nathan Stratton
On Tue, Oct 7, 2014 at 5:35 PM, Jonathan Proulx wrote: > Hi All, > > We're running Firefly on the ceph side and Icehouse on the OpenStack > side & I've pulled the recommended nova branch from > https://github.com/angdraug/nova/tree/rbd-ephemeral-clone-stable-icehouse > > according to > http://cep

Re: [ceph-users] libvirt: Driver 'rbd' is not whitelisted

2014-10-06 Thread Nathan Stratton
You need to make sure rbd is in your whitelist when you run ./configure as well as having rbd enabled. --block-drv-rw-whitelist=qcow2,raw,file,host_device,nbd,iscsi,gluster,rbd ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com On Sun, Oct 5,

Re: [ceph-users] Centos 7 qemu

2014-10-06 Thread Nathan Stratton
On Mon, Oct 6, 2014 at 8:22 AM, Ignazio Cassano wrote: > Hi, > but what kernel version you are using ? > I think rbd kernel module is not in centos 7 kernel . > Have you buill it by sources ? > Built kernel via source, I see modules loaded: [root@virt01a secrets]# lsmod Module

Re: [ceph-users] Centos 7 qemu

2014-10-06 Thread Nathan Stratton
Hi, > but what kernel version you are using ? > I think rbd kernel module is not in centos 7 kernel . > Have you buill it by sources ? > > > 2014-10-06 14:08 GMT+02:00 Nathan Stratton : > >> SELinux is already disabled >> >> [root@virt01a /]# setsebool -P

Re: [ceph-users] Network hardware recommendations

2014-10-06 Thread Nathan Stratton
save even more money go with used 10 gig infiniband off eBay, you can do that for under $100 a port. ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Centos 7 qemu

2014-10-06 Thread Nathan Stratton
SELinux is already disabled [root@virt01a /]# setsebool -P virt_use_execmem 1 setsebool: SELinux is disabled. ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com On Mon, Oct 6, 2014 at 1:16 AM, Vladislav Gorbunov wrote: > Try to disable se

Re: [ceph-users] Centos 7 qemu

2014-10-05 Thread Nathan Stratton
\;10.71.0.78\:6789: Driver 'rbd' is not whitelisted I tried with an without auth. ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com On Sun, Oct 5, 2014 at 3:51 PM, Henrik Korkuc wrote: > Hi, > Centos 7 qemu out of the box does not suppor

[ceph-users] libvirt: Driver 'rbd' is not whitelisted

2014-10-05 Thread Nathan Stratton
8d-8bf4-aedcc1549968,cache=none: could not open disk image rbd:volumes/volume-205e6cb4-15c1-4f8d-8bf4-aedcc1549968:id=volumes:key=AQCMrSlUSJvTLxAAO9U+3IZQSkLU8a3iWj7T5Q==:auth_supported=cephx\;none:mon_host=10.71.0.75\:6789\;10.71.0.76\:6789\;10.71.0.77\:6789\;10.71.0.78\:6789: Driver 'rbd' i

[ceph-users] Ovirt

2014-05-07 Thread Nathan Stratton
Now that everyone will be one big happy family, any new on ceph support of ovirt? ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists

Re: [ceph-users] Hardware: SFP+ or 10GBase-T

2013-10-24 Thread Nathan Stratton
ou need longer runs. So I totally understand that its less power, but finding that hard to justify when the cost per port jumps to $300 more per port. With dual ports its going to take a long time to make that up in power savings. -- ><> nathan stratton | vp technology

Re: [ceph-users] Hardware: SFP+ or 10GBase-T

2013-10-24 Thread Nathan Stratton
) Understood, we don't need huge amounts of space, so the 240 Gig SSDs were just a bit more the SAS drives. Tho depending on the code, I guess I could run into wear issues of SSDs over SAS/SATA because of frequent writes. -- ><> nathan stratto

[ceph-users] Hardware: SFP+ or 10GBase-T

2013-10-24 Thread Nathan Stratton
dual rank DDR3 9 - Samsung 840 EVO 120 GB SSD (1 root 8 ceph) Switch is going to be Arista 7050-T for SFP+ or Arista 7050-S for 10GBase-T. -- ><> nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com ___ ceph