Re: [Openstack] Swift generating thousands of rsyncs per second on a small cluster

2014-07-01 Thread Clay Gerrard
Ah, your part power is too high for that few devices. I would have recommend 14 rather than 18. Which is good enough to scale up to ~500 devices before you might worry about maybe running into balancing issues that *could* make it difficult to run your cluster more than 70-80% full, but at that p

Re: [Openstack] Swift generating thousands of rsyncs per second on a small cluster

2014-07-01 Thread Pete Zaitcev
On Tue, 1 Jul 2014 10:50:15 +0100 Diogo Vieira wrote: > Can you tell me if this is normal behaviour? If so, how will > this scale when I add more objects? Will it keep getting more > and more CPU usage? Dunno if it's normal or not, but clusters installed with default parameters do that. My nodes

Re: [Openstack] Swift generating thousands of rsyncs per second on a small cluster

2014-07-01 Thread Diogo Vieira
> The object servers should only be talking to each other during replication. > They should not talk to the proxy, and probably not the load balancer. Can > you provide the output of "swift-ring-builder /etc/swift/object.builder" and > more details on the network configuration of this system.

Re: [Openstack] Swift generating thousands of rsyncs per second on a small cluster

2014-06-30 Thread Clay Gerrard
The object servers should only be talking to each other during replication. They should not talk to the proxy, and probably not the load balancer. Can you provide the output of "swift-ring-builder /etc/swift/object.builder" and more details on the network configuration of this system. Generally

[Openstack] Swift generating thousands of rsyncs per second on a small cluster

2014-06-30 Thread Diogo Vieira
Hello, I have a small cluster consisting on a physical machine running a Proxy and a Storage Node and 4 virtual machines running one Storage node each. Each Storage Node has only one device and the cluster has 5 zones and 3 replicas all configured with packstack. Between the real machine (Prox