hints for a node that was removed from cluster

2021-09-12 Thread Gil Ganz
Hey What should happen to hints that were generated for a node that has been removed from the cluster, before hints were sent? I'm seeing old hint files that are not handled, they are not sent anywhere and not being deleted. Version is 3.11.9 gil

Re: hints for a node that was removed from cluster

2021-09-12 Thread Erick Ramirez
Hints for a removed node should have been dropped. Out of curiosity, how do you know they belong to the removed node?

Re: hints for a node that was removed from cluster

2021-09-12 Thread Gil Ganz
Looks like it's not happening, seen a couple of cases like this, in all cases the files belonged to nodes that died and had to be removed, and I can see this behaviour on all the nodes in the relevant data center. All these nodes had to be removed with force (not by choice..), I wonder if that has

Hints streaming of dead node

2021-09-12 Thread Roy Burstein
Hi , In case of a dead node in the cluster (3.11) with hints. Let's say that the node was dead for 4 Hours(during this time hints are kept for it) and now we are removing the node,does all nodes stream the hints in addition to the sstables? Thanks, Roy

Re: Hints streaming of dead node

2021-09-12 Thread Bowen Song
Hi Roy, I assume you are talking about "nodetool removenode", not "nodetool decommission". In the case of "removenode", The SSTables are streamed from the remaining live replica nodes (if RF>1), not the dead node. Because of that, the hints for the dead node is irrelevant. I hope that answer

Re: Hints streaming of dead node

2021-09-12 Thread Roy Burstein
Hi It answers my question,another question is It the same for node replacement? On Sun, Sep 12, 2021, 21:21 Bowen Song wrote: > Hi Roy, > > > I assume you are talking about "nodetool removenode", not "nodetool > decommission". In the case of "removenode", The SSTables are streamed > from the rem

Re: Hints streaming of dead node

2021-09-12 Thread Bowen Song
Hi Roy, For replacing a dead node via the "-Dcassandra.replace_address=..." parameter, Cassandra will also stream the SSTables from live replica nodes, not the dead node itself. Cheers, Bowen On 12/09/2021 20:02, Roy Burstein wrote: Hi It answers my question,another question is It the sa