Re: [ceph-users] Upper limit of MONs and MDSs in a Cluster

2017-05-25 Thread Gregory Farnum
You absolutely cannot do this with your monitors -- as David says every node would have to participate in every monitor decision; the long tails would be horrifying and I expect it would collapse in ignominious defeat very quickly. Your MDSes should be fine since they are indeed just a bunch of st

Re: [ceph-users] Upper limit of MONs and MDSs in a Cluster

2017-05-25 Thread David Turner
For the MDS, the primary doesn't hold state data that needs to be replayed to a standby. The information exists in the cluster. Your setup would be 1 Active, 100 Standby. If the active went down, 1 of the standby's would be promoted and read the information from the cluster. With Mons, it's int

[ceph-users] Upper limit of MONs and MDSs in a Cluster

2017-05-25 Thread Wes Dillingham
How much testing has there been / what are the implications of having a large number of Monitor and Metadata daemons running in a cluster. Thus far I have deployed all of our Ceph clusters as a single service type per physical machine but I am interested in a use case where we deploy dozens/hundr