Re: Huge amounts of hinted handoffs for counter table

2015-09-24 Thread Björn Hachmann
Thank you for your time! Our replication factor is 'DC1': '2', 'DC2': '2'. Consistency is set to LOCAL_ONE for these queries. Indeed timeouts might be a problem as some of the nodes in DC2 are under high load from time to time. Is there some counter (eg. JMX or so) I could monitor to verify this

Re: Huge amounts of hinted handoffs for counter table

2015-09-23 Thread Robert Coli
On Wed, Sep 23, 2015 at 7:28 AM, Björn Hachmann wrote: > Today I realized that one of the nodes in our Cassandra cluster (2.1.7) is > storing a lot of hints (>80GB) and I fail to see a convincing way to deal > with them. > ... > We had a look into the table system.hints and from there we learnt t

Re: Huge amounts of hinted handoffs for counter table

2015-09-23 Thread Venkatesh Arivazhagan
What is your replication factor and write consistency? :) On Sep 23, 2015 7:28 AM, "Björn Hachmann" wrote: > Today I realized that one of the nodes in our Cassandra cluster (2.1.7) is > storing a lot of hints (>80GB) and I fail to see a convincing way to deal > with them. > > From the system.log:

Huge amounts of hinted handoffs for counter table

2015-09-23 Thread Björn Hachmann
Today I realized that one of the nodes in our Cassandra cluster (2.1.7) is storing a lot of hints (>80GB) and I fail to see a convincing way to deal with them. >From the system.log: INFO [ScheduledTasks:1] 2015-09-23 14:27:06,692 StatusLogger.java:115 - system.hints 276,10109