One of our node in a 3 node cluster drifted by ~ 20-25 seconds. While I figured
this pretty quickly, I had few questions that am looking for some answers.
We can always be proactive in keeping the time sync. But, Is there any way to
recover from a time drift (in a reactive manner)? Since it was a lab
environment, I dropped the KS (deleted data directory).Are there any other
scenarios that would lead a cluster look like below? Note:Actual topology of
the cluster - ONE Cassandra node and TWO Analytic nodes.
On 192.168.2.100Address DC Rack Status State Load
Owns Token
113427455640312821154458202477256070485 192.168.2.100 Cassandra rack1
Up Normal 601.34 MB 33.33% 0
192.168.2.101 Analytics rack1 Down Normal
149.75 MB 33.33% 56713727820156410577229101238628035242
192.168.2.102 Analytics rack1 Down Normal ? 33.33%
113427455640312821154458202477256070485
On 192.168.2.101Address DC Rack Status State Load
Owns Token
113427455640312821154458202477256070485 192.168.2.100 Analytics rack1
Down Normal ? 33.33% 0
192.168.2.101 Analytics rack1 Up Normal
158.59 MB 33.33% 56713727820156410577229101238628035242
192.168.2.102 Analytics rack1 Down Normal ? 33.33%
113427455640312821154458202477256070485
On 192.168.2.102Address DC Rack Status State Load
Owns Token
113427455640312821154458202477256070485 192.168.2.100 Analytics rack1
Down Normal ? 33.33% 0
192.168.2.101 Analytics rack1 Down Normal ?
33.33% 56713727820156410577229101238628035242
192.168.2.102 Analytics rack1 Up Normal 117.02 MB 33.33%
113427455640312821154458202477256070485
Appreciate your valuable inputs.
Thanks,SC
