Hi, Just curious if anyone has any best practices/experiences/thoughts to share on network configurations for cassandra setups with tens to hundreds of nodes and high traffic (thousands of requests/sec)?
For instance: - Do you just "hook it all together"? - If you have 2 interfaces, do you prefer separating thrift and gossip or bond the interfaces to get more redundancy (but less bandwidth and traffic isolation)? - Issues with network bandwidth. For instance if you have major events occurring such as adding a new replica or if parts if a ring goes offline and you need to resync when it comes up again? Especially considering if you have the nodes on several switches, the trunks between these switches could get quite busy? - As the ring increases in size, you also need more and more switches (lets try to avoid big expensive network stuff...) and potential bottlenecks on the trunks. Any thoughts on scaling this? (tree like structures of switches, big single switch with loads of ports, more flat network layout) Terje
