Nodes Timing Out

[James Golick]

Hey,

I put our first cluster in to production (writing but not reading) a couple
of days ago. Right now, it's got two pretty sizeable nodes taking about 200
writes per second each and virtually no reads.

Eventually, though, (and this has happened twice), both nodes seem to start
timing out. If I run nodetool cfstats, I get:

[ja...@cassandra1 ~]# /opt/cassandra/bin/nodetool -h
cassandra1.fetlife.comcfstats
Keyspace: system
        Read Count: 39
        Read Latency: 0.35925641025641025 ms.
        Write Count: 3
        Write Latency: 0.166 ms.
        Pending Tasks: 66
                Column Family: HintsColumnFamily
                SSTable count: 0
                Space used (live): 0
                Space used (total): 0

and then it just hangs there.

Any ideas?

- James