Re: nodetool repair stalled

2014-11-12 Thread venkat sam
Hi Eric, The data are stored in JBOD. Only one of the disk got crashed other 3 disk still holds the old data . That's why I didn't clean the whole node and issue a fresh restart Thanks Rob. Will do try that way. From: Eric Stevens Sent: ‎Wednesday‎, ‎November‎ ‎12‎, ‎2014 ‎8‎:‎21‎ ‎PM To

Re: nodetool repair stalled

2014-11-12 Thread Robert Coli
On Wed, Nov 12, 2014 at 6:50 AM, Eric Stevens wrote: > Wouldn't it be a better idea to issue removenode on the crashed node, wipe > the whole data directory (including system) and let it bootstrap cleanly so > that it's not part of the cluster while it gets back up to > Yes, with replace_node. I

Re: nodetool repair stalled

2014-11-12 Thread Eric Stevens
Wouldn't it be a better idea to issue removenode on the crashed node, wipe the whole data directory (including system) and let it bootstrap cleanly so that it's not part of the cluster while it gets back up to speed? On Tue, Nov 11, 2014, 12:32 PM Robert Coli wrote: > On Tue, Nov 11, 2014 at 10:

Re: nodetool repair stalled

2014-11-11 Thread Robert Coli
On Tue, Nov 11, 2014 at 10:48 AM, venkat sam wrote: > > I have a 5 node cluster. In one node one of the data directory partition > got crashed. After disk replacement I restarted the Cassandra daemon and > gave nodetool repair to restore the missing replica’s. But nodetool repair > is getting stu

nodetool repair stalled

2014-11-11 Thread venkat sam
I have a 5 node cluster. In one node one of the data directory partition got crashed. After disk replacement I restarted the Cassandra daemon and gave nodetool repair to restore the missing replica’s. But nodetool repair is getting stuck after syncing one of the columnfamily

Re: nodetool repair stalled

2014-01-14 Thread Paolo Crosato
I was able to complete the repair, repairing one keyspace and cf each time. However the last session is still shown as an active process, even if the session has been successfully completed, this is the log: INFO [CompactionExecutor:252] 2014-01-14 03:10:13,105 CompactionTask.java (line 275)

Re: nodetool repair stalled

2014-01-08 Thread sankalp kohli
Hi, Can you attach the logs around repair. Please do that for node which triggered it and nodes involved in repair. I will try to find something useful. Thanks, Sankalp On Wed, Jan 8, 2014 at 10:18 AM, Robert Coli wrote: > On Wed, Jan 8, 2014 at 8:52 AM, Paolo Crosato < > paolo.cros...@tar

Re: nodetool repair stalled

2014-01-08 Thread Robert Coli
On Wed, Jan 8, 2014 at 8:52 AM, Paolo Crosato wrote: > I have two nodes with Cassandra 2.0.3, where repair sessions hang for an > undefinite time. I'm running nodetool repair once a week on every node, on > different days. Currently I have like 4 repair sessions running on each > node, one since

nodetool repair stalled

2014-01-08 Thread Paolo Crosato
Hi, I have two nodes with Cassandra 2.0.3, where repair sessions hang for an undefinite time. I'm running nodetool repair once a week on every node, on different days. Currently I have like 4 repair sessions running on each node, one since 3 weeks and none has finished. Reading the logs I didn