I have been playing around with Cassandra 1.0.0 in our test environment it
seems pretty sweet so far. I have however come across what appears to be a
bug tracking node load. I have enabled compression and levelled compaction
on all CFs (scrub + snapshot deletion) and the nodes have been operating
normally for a day or two. I started getting concerned when the load as
reported by nodetool ring kept increasing (it seems monotonically) despite
seeing a compression ratio of ~2.5x (as a side note, I find it strange
Cassandra does not provide the compression ratio via jmx or in the logs). I
initially thought there might be a bug in cleaning up obsolete SSTables but
I then noticed the following discrepancy:
Nodetool ring reports:
10.112.27.65 datacenter1 rack1 Up Normal 8.64
GB 50.00% 170141183460469231731687303715884105727
Yet du . -h reports: only 2.4G in the data directory.
After restarting the node, nodetool ring reports a more accurate:
10.112.27.65 datacenter1 rack1 Up Normal 2.35 GB
50.00% 170141183460469231731687303715884105727
Again, both compression and levelled compaction have been enabled on all
CFs. Is this a known issue or has anybody else observed a similar pattern?
Dan Hendry
(403) 660-2297