[ceph-users] Multicast

2013-11-02 Thread james
Hi All I was wondering whether multicast could be used for the replication traffic? It just seemed that the outbound network bandwidth from the source could be halved. Cheers ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.c

Re: [ceph-users] Multicast

2013-11-02 Thread James Harper
> > Hi All > > I was wondering whether multicast could be used for the replication > traffic? It just seemed that the outbound network bandwidth from the > source could be halved. > Right now I think ceph traffic is all TCP, which doesn't do multicast. You'd either need to make ceph use UDP a

Re: [ceph-users] Multicast

2013-11-02 Thread james
It would be an interesting exercise though. Depending on network layout (no cluster network) the client could multicast to all replicas and potentially reduce latency by half. I suspect that the client participating in the replication goes against the internal workings of ceph though and wou

Re: [ceph-users] Expanding ceph cluster by adding more OSDs

2013-11-02 Thread Guang
Hi Kyle, Thanks for you response. Though I haven't tested it, my gut feeling is the same, changing the PG number may result in re-shuffling of the data. In terms of the strategy you mentioned to expand a cluster, I have a few questions: 1. By adding a LITTLE more weight each time, my understan

Re: [ceph-users] Very frustrated with Ceph!

2013-11-02 Thread Alfredo Deza
On Fri, Nov 1, 2013 at 11:12 PM, Sage Weil wrote: > On Sat, 2 Nov 2013, Trivedi, Narendra wrote: >> >> Hi Sage, >> >> I believe I issued a "ceph-deploy install..." from the admin node as per the >> documentation and that was almost ok as per the output of the command below >> except sometimes ther

Re: [ceph-users] Openstack Instances and RBDs

2013-11-02 Thread Dinu Vlad
I don't know of any guide besides the official install docs from grizzly/havana, but I'm running openstack grizzly on top of rbd storage using glance & cinder and it makes (almost) no use of /var/lib/nova/instances. Live migrations also work. The only files there should be "config.xml" and "cons

Re: [ceph-users] ceph cluster performance

2013-11-02 Thread Dinu Vlad
Any other options or ideas? Thanks, Dinu On Oct 31, 2013, at 6:35 PM, Dinu Vlad wrote: > > I tested the osd performance from a single node. For this purpose I deployed > a new cluster (using ceph-deploy, as before) and on fresh/repartitioned > drives. I created a single pool, 1800 pgs. I

Re: [ceph-users] Ceph nodes info

2013-11-02 Thread Joao Eduardo Luis
On 10/31/2013 01:09 AM, Raghavendra Lad wrote: Hi, How to install a Ceph node? http://ceph.com/docs/master/start/ -Joao Please let me know the install steps, preparing node in Ubuntu 12.04 LTS. Do we need a separate Server / Admin node and what needs to be installed for Ceph. I would i

Re: [ceph-users] Openstack Instances and RBDs

2013-11-02 Thread Haomai Wang
Now OpenStack H needs a new RBD installation guide. But there exists some confusing problem may disturb newers: 1. OpenStack H can make use of RBD as the backend of Nova(/var/lib/nova/instances) 2. A critical patch is missing(https://review.openstack.org/#/c/46879/) which is used to integrate Glan