Re: Blocking while a node finishes joining the cluster after restart.

2014-09-19 Thread James Briggs
riggs Sent: Friday, September 19, 2014 11:30 AM Subject: Re: Blocking while a node finishes joining the cluster after restart. This is great feedback… I think it could actually be even easier than this… You could have an ansible (or whatever cluster management system you’re using) role for j

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-19 Thread Tyler Hobbs
On Fri, Sep 19, 2014 at 1:26 PM, Kevin Burton wrote: > We’re using ansible so I’d like something that integrates with that… I'm not familiar with Ansible, so I don't know if it's useful, but OpsCenter has a REST api you can use to do anything you can do from the UI. For example, a rolling rest

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-19 Thread Jonathan Haddad
>> >> OpsCenter is flaky at doing rolling restart in my test cluster, >> so an alternative is needed. >> >> Also, the free OpsCenter doesn't have rolling repair option enabled. >> >> ccm has the options to do drain, stop and start, but a bash >>

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-19 Thread Kevin Burton
-- > *From:* Duncan Sands > *To:* user@cassandra.apache.org > *Sent:* Tuesday, September 16, 2014 11:09 AM > *Subject:* Re: Blocking while a node finishes joining the cluster after > restart. > > Hi Kevin, if you are using the latest version of opscenter, then even t

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-19 Thread Kevin Burton
> Hi Kevin, if you are using the latest version of opscenter, then even the community (= free) edition can do a rolling restart of your cluster. It's pretty convenient. We’re using ansible so I’d like something that integrates with that… On Tue, Sep 16, 2014 at 11:09 AM, Duncan Sands wrote: >

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-16 Thread James Briggs
Hi Robert. I just did a test (shutdown all nodes, start one non-seed node.) You're correct that an old non-seed node can start by itself. So startup scripts don't have to be intelligent, but apps need to wait until there's enough nodes up to serve the whole keyspace: cqlsh:my_keyspace> consis

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-16 Thread Robert Coli
On Tue, Sep 16, 2014 at 12:21 PM, James Briggs wrote: > I haven't noticed if they do anything special with seeds. > (At least one seed needs to be running before you restart other nodes.) > If the nodes have all seen each other before ("the cluster has coalesced once") then AFAIK this statement

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-16 Thread James Briggs
014 11:09 AM Subject: Re: Blocking while a node finishes joining the cluster after restart. Hi Kevin, if you are using the latest version of opscenter, then even the community (= free) edition can do a rolling restart of your cluster. It's pretty convenient. Ciao, Duncan. On 16/09/14

Re: Blocking while a node finishes joining the cluster after restart.

2014-09-16 Thread Duncan Sands
Hi Kevin, if you are using the latest version of opscenter, then even the community (= free) edition can do a rolling restart of your cluster. It's pretty convenient. Ciao, Duncan. On 16/09/14 19:44, Kevin Burton wrote: Say I want to do a rolling restart of Cassandra… I can’t just restart a

Blocking while a node finishes joining the cluster after restart.

2014-09-16 Thread Kevin Burton
Say I want to do a rolling restart of Cassandra… I can’t just restart all of them because they need some time to gossip and for that gossip to get to all nodes. What is the best strategy for this. It would be something like: /etc/init.d/cassandra restart && wait-for-cassandra.sh … or something