Hulloa all, I read a thing re. adding new nodes where the recommendation was to run cleanup on the nodes after adding a new node to remove redundant token ranges.
I timed this way back when we only had ~20G of data per node and it took approx. 5 mins per node. After adding a node on Tuesday, I figured I'd run cleanup. Per node, it is taking 6+ hours now as we have 2-2.5T per node. Should we be running cleanup regularly regardless of whether or not new nodes have been added? Would it reduce cleanup times for when we do add new nodes? If we double the network bandwidth can we effectively reduce this lengthy cleanup? Maybe just ignore cleanup entirely? I appreciate that cleanup will increase the load but running cleanup on one node at a time seems impractical. How many simultaneous nodes (per rack) should we limit cleanup to? More experienced suggestions would be most appreciated. Marc