Re: StochasticLoadBalancer contra-productive

2024-08-29 Thread Wellington Chevreuil
The balancer logs shared suggest it's deciding to move regions because of the following factors: - Data locality (hdfs blocks for the regions files) - Read/Write load - Memstore size/utilisation So you need to look into those stats. It could be that the cluster is under a "hotspot" situa

Re: StochasticLoadBalancer contra-productive

2024-08-29 Thread Frens Jan Rumph
Hi Wellington, I see. Thanks for the pointer. I guess I was staring too much at the region count skew and the overall costs. I would still expect that with a weight of 500 vs 5 the region count function would quickly dominate; but that was just a gut feeling We have a lot of tables which are h