Re: Long joining node

It was suggested to me that I try running scrub on the other nodes in the cluster, as the runtime exceptions I was seeing might be relevant to some bad data. I am going to try that this morning and see how things go. Not sure how long is long enough for nodetool scrub to run on a box though. As fo

Re: Long joining node

What's your average data per node? Is 230gb close? All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Long joining node

I set the stream timeout to 1 hour this morning and started fresh trying to join this node. It took about an hour to stream over 230gb of data, and then into hour 2 I wound up back where I was yesterday, the node's load is slowly reducing and the netstats does not show sending or receiving anythin

Re: Long joining node

That's the one. I set it to an hour to be safe (if a stream goes above the timeout it will get restarted) but it can probably be lower. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [im

Re: Long joining node

Sebastian, You're referring to streaming_socket_timeout_in_ms correct? What value do you recommend? All of my nodes are currently at the default 0. Thanks, Stan On Tue, Aug 4, 2015 at 2:16 PM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > It helps to set stream socket timeout i

Re: Long joining node

I'm running 2.0.11. These nodes are on bare metal at Soft Layer. So after I sent my first post logs a RuntimeException popped up in the logs, not sure if this might be related? ERROR 14:13:17,648 Exception in thread Thread[CompactionExecutor:505,1,main] java.lang.RuntimeException: Last written ke

Re: Long joining node

It helps to set stream socket timeout in the yaml so that you don't hang forever on a lost / broken stream. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: Long joining node

On Tue, Aug 4, 2015 at 11:02 AM, Stan Lemon wrote: > I am attempting to add a 13th node in one of the datacenters. I have been > monitoring this process from the node itself with nodetool netstats and > from one of the existing nodes using nodetool status. > > On the existing node I see the new n

Long joining node

Hello, I have a a cluster with 12 nodes each in 2 datacenters for a total of 24 nodes. I am attempting to add a 13th node in one of the datacenters. I have been monitoring this process from the node itself with nodetool netstats and from one of the existing nodes using nodetool status. On the exi