On Wed, Nov 15, 2017 at 1:07 PM Ronny Aasen <ronny+ceph-us...@aasen.cx> wrote:
> On 15.11.2017 13:50, Gandalf Corvotempesta wrote: > > As 10gb switches are expansive, what would happen by using a gigabit > cluster network and a 10gb public network? > > Replication and rebalance should be slow, but what about public I/O ? > When a client wants to write to a file, it does over the public network > and the ceph automatically replicate it over the cluster network or the > whole IO is made over the public? > > > > public io would be slow. > each write goes from client to primary osd on public network, then is > replicated 2 times to the secondary osd's over the cluster network, then > the client is informed the block is written. > since cluster network would see 2x write traffic compared to public > network when things a OK. and many times the traffic of the public network > when things are recovering or backfilling. i would prioritize the > clusternetwork for the highest speed if one could not have 10Gbps on > everything. > I would seriously consider combining the cluster and public network. It will simplify your configuration. It really takes a lot to saturate a 10G network with Ceph. If you find that you need to separate your public and cluster networks later, you can do that in the future. Jake >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
