One of our clusters had a strange thing happen tonight. It's a 3 node cluster, running 2.1.10. The primary keyspace has RF 3, vnodes with 256 tokens.
This evening, over the course of about 6 hours, disk usage increased from around 700GB to around 900GB on only one node. I was at a loss as to what was happening and, on a whim, decided to run nodetool cleanup on the instance. I had no reason to believe that it was necessary, as no nodes were added or tokens moved (not intentionally, anyhow). But it immediately cleared up that extra space. I'm pretty lost as to what would have happened here. Any ideas where to look? Thanks!