So, this is my ring, the third node ran out of disk space:
Address Status State Load Owns Token
139315361777093290765734121398073449298
192.168.68.76 Up Normal 37.83 GB 39.03%
35588525726498188223628193834394222094
192.168.68.80 Up Normal 56.13 GB 24.65%
77536499411085694672769767983714006803
192.168.68.69 Down Normal 70.62 GB 24.66%
119490787523049504815252019414532364540
192.168.68.233 Up Normal 52.92 GB 5.83%
129401794004285600053753090610420021554
192.168.68.70 Up Normal 32.8 GB 5.83%
139315361777093290765734121398073449298
And the data could be more evenly balanced, obviously. However the nodes fails
to startup because due of lacking disk space (instead of starting up and denies
further writes it appears to try to process the [6.6G!] commit logs). So, I
cannot perform any actions on it no more like re-balancing the ring or reading
old data from it and rotating it somewhere else. So, what to do now?
BTW what precisely does the Owns column mean?
