I saw this once when my servers ran out of file descriptors. This caused totally weird problems.
Make sure all nodes in the cluster are listening on the gossip port (7000 by default). Also check out http://www.datastax.com/docs/0.7/troubleshooting/index#view-of-ring-differs-between-some-nodesor http://www.datastax.com/docs/0.6/troubleshooting/index#view-of-ring-differs-between-some-nodes depending on your version. On Wed, Mar 23, 2011 at 11:39 AM, Aaron Morton <aa...@thelastpickle.com>wrote: > First thing is check the logs on host 1. Check the view of the ring from > all other nodes in the cluster, do they think nodes 2 and 3 are also down? > Then confirm all nodes have the same config for listen port and all nodes > can telnet to the listen port for the other nodes. > > I'm guessing the insert fails for some inserts because you are working at > Quorum and your replication factor is less than 5. > > Aaron > On 23/03/2011, at 11:31 PM, pob <peterob...@gmail.com> wrote: > > > Hello, > > > > what kind of bug is it? > > > > > > If I do nodetool host1 ring, the output is: > > > > Address Status State Load Owns Token > > > 141784319550391026443072753096570088105 > > 1.174 Up Normal 4.14 GB 16.67% 0 > > 1.173 Down Normal 4.07 GB 16.67% > 28356863910078205288614550619314017621 > > 1.172 Down Normal 4.1 GB 16.67% > 56713727820156410577229101238628035242 > > 1.179 Up Normal 4.05 GB 16.67% > 85070591730234615865843651857942052863 > > 1.175 Up Normal 4.13 GB 16.67% > 113427455640312821154458202477256070484 > > 1.177 Up Normal 4.12 GB 16.67% > 141784319550391026443072753096570088105 > > > > > > but if I do nodetool host3 ring, the output is: > > > > Address Status State Load Owns Token > > > 141784319550391026443072753096570088105 > > 1.174 Up Normal 4.14 GB 16.67% 0 > > 1.173 Up Normal 4.07 GB 16.67% > 28356863910078205288614550619314017621 > > 1.172 Up Normal 4.1 GB 16.67% > 56713727820156410577229101238628035242 > > 1.179 Up Normal 4.05 GB 16.67% > 85070591730234615865843651857942052863 > > 1.175 Up Normal 4.13 GB 16.67% > 113427455640312821154458202477256070484 > > 1.177 Up Normal 4.12 GB 16.67% > 141784319550391026443072753096570088105 > > > > > > Some nodes see some nodes Down, and its impossible to do correct insert. > The cassandra is running on nodes that is matched "down". > > > > > > Any ideas? Thanks > > > > > > Best, > > Peter > > > > >
