The environment is built using established images for Cassandra 3.10. Unfortunately the debug log does not indicate any errors before I start seeing the WARN for missing hints folder. I understand that hints file will be deleted after replay is complete, but not sure of the root cause of why the hints folder is getting deleted. When I look at the nodetool status or nodetool ring - it indicates that all nodes are up and running in normal state, no node went down. Also, I do not see anything the debug logs indicating that a node went down. In such a scenario, I am not sure why would HintsWriterExecutor would get triggered.
Regards, Cassandra User On Wed, Feb 7, 2018 at 11:25 AM, Rahul Singh <rahul.xavier.si...@gmail.com> wrote: > Do you have any automation being applied via chef or likewise? Was the > environment built using automation or using established images ? > > -- > Rahul Singh > rahul.si...@anant.us > > Anant Corporation > > On Feb 7, 2018, 10:37 AM -0600, test user <casst...@gmail.com>, wrote: > > The directory */var/lib/cassandra/hints* was created, when I brought up > the cluster. I am running into this issue until after the cluster is up and > running for about 2 weeks. > > Regards, > Cassandra User > > On Wed, Feb 7, 2018 at 1:28 AM, Kyrylo Lebediev <kyrylo_lebed...@epam.com> > wrote: > >> Hi, >> >> Not sure what could be the reason, but the issue is obvious: directory >> */var/lib/cassandra/hints* is missing or cassandra user doesn't have >> enough permissions on it. >> >> >> Regards, >> >> Kyrill >> ------------------------------ >> *From:* test user <casst...@gmail.com> >> *Sent:* Wednesday, February 7, 2018 8:14:59 AM >> *To:* user@cassandra.apache.org >> *Subject:* Fwd: Hints folder missing in Cassandra >> >> >> Has anyone run into the issue mentioned below? >> >> >> ---------- Forwarded message ---------- >> From: *test user* <casst...@gmail.com> >> Date: Tue, Feb 6, 2018 at 3:28 PM >> Subject: Hints folder missing in Cassandra >> To: user-subscr...@cassandra.apache.org >> >> >> Hello All, >> >> >> >> I am using Cassandra 3.10. I have 3-node cluster (say node0, node1, >> node2). >> >> I have been using nodetool utility to monitor the cluster. >> >> nodetool status – indicates all nodes are up and in normal state >> >> nodetool ring – indicates all nodes are up >> >> >> >> Running into following issue: >> >> *WARN [HintsWriteExecutor:1] 2018-02-05 06:57:09,607 CLibrary.java:295 - >> open(/var/lib/cassandra/hints, O_RDONLY) failed, errno (2).* >> >> For some reason, the hints folder on node1 is missing. Not sure how it >> got deleted. One node in the cluster always seems to run into this issue. >> >> The other two nodes node0 and node2 do not have this issue, and the hints >> folder is present. >> >> >> >> The debug logs do not seem to indicate the root cause. >> >> >> >> Please let me know how to debug this further to understand the root cause. >> >> >> >> Regards, >> >> Cassandra User >> >> >> >> >
