Re: electricity outage problem

2016-01-15 Thread Adil
our case is not about accepting connection, some nodes receives gossip generation number greater the local one, a looked at the tables peers and local and can't found where local one is stored. 2016-01-15 17:54 GMT+01:00 daemeon reiydelle : > Nodes need about 60-90 second delay before it can star

Re: electricity outage problem

2016-01-15 Thread daemeon reiydelle
Nodes need about 60-90 second delay before it can start accepting connections as a seed node. Also a seed node needs time to accept a node starting up, and syncing to other nodes (on 10gbit the max new nodes is only 1 or 2, on 1gigabit it can handle at least 3-4 new nodes connecting). In a large cl

Re: electricity outage problem

2016-01-15 Thread Adil
Hi, we did full restart of the cluster but nodetool status still giving incoerent info from different nodes, some nodes appers UP from a node but appers DOWN from another, and in the log as is said still having the message "received an invalid gossip generation for peer /x.x.x.x" cassandra version

Re: electricity outage problem

2016-01-12 Thread Jack Krupansky
Sometimes you may have to clear out the saved Gossip state: https://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_gossip_purge.html Note the instruction about bringing up the seed nodes first. Normally seed nodes are only relevant when initially joining a node to a cluster (and then

Re: electricity outage problem

2016-01-12 Thread daemeon reiydelle
This happens when there is insufficient time for nodes coming up to join a network. It takes a few seconds for a node to come up, e.g. your seed node. If you tell a node to join a cluster you can get this scenario because of high network utilization as well. I wait 90 seconds after the first (i.e.

electricity outage problem

2016-01-12 Thread Adil
Hi, we have two DC with 5 nodes in each cluster, yesterday there was an electricity outage causing all nodes down, we restart the clusters but when we run nodetool status on DC1 it results that some nodes are DN, the strange thing is that running the command from diffrent node in DC1 doesn't give