Tomstones impact on repairs both anti-entropy and read repair

2016-11-14 Thread K F
Hi Folks, I have a table that has lot of tombstones generated and has caused inconsistent data across various datacenters. we run anti-entropy repairs and also have read_repair_chance tuned-up during our non busy hours. But yet when we try to compare data residing in various replicas across DCs,

Seeing wierd exceptions

2015-08-05 Thread K F
Hi, In 2 of our clusters running 2.0.14 version we are seeing following exception, 15-08-05 16:11:32,723 [FlushWriter:268358] ERRORCassandraDaemon Exception in thread Thread[FlushWriter:268358,5,main]FSReadError in/opt/cassandra/data/ks1/cf1/ks1-cf1-jb-231142-Index.db     atorg.apache.cassa

Should maintenance repairs be run on system related keyspaces?

2015-08-11 Thread K F
Hi, I have a question in general with regards to repairs on system related keyspaces. Is it necessary in maintenance repair kicked of via cron should also repair system related keyspaces? Regards,Ken

sstableloader in version 2.0.14 doesn't honor thrift_framed_transport_size_in_mb set on server side

2015-08-14 Thread K F
While using sstableloader in 2.0.14 we have discovered that setting the  thrift_framed_transport_size_in_mb to 16 in cassandra.yaml doesn't honor it. Did anybody see similar issue? So, this is the exception seen, org.apache.thrift.transport.TTransportException: Frame size (16165888) larger than m

Seeing null pointer exception 2.0.14 after purging gossip state

2015-09-14 Thread K F
Hi, I have cassandra 2.0.14 deployed and after following the method described in  Apache Cassandra™ 2.0 to clear the gossip state of the node in one of the dc of my cluster |   | |   |   |   |   |   | | Apache Cassandra™ 2.0Correcting a problem in the gossip state. | Version 2.0 | | | | View on d

Question about addition of node in a DC while a node is down in another DC

2015-09-30 Thread K F
Hi Cassandra users, I had a question where I have my cassandra cluster running in vnodes. And we would like to add some nodes in DC1 while there is a node down in DC2. So, my question to you all is it ok to add nodes to DC1 while there is a node down in DC2? Thanks for the response.

addition of nodes with auth enabled on a datacenter causes existing nodes to loose their permissions

2015-10-01 Thread K F
Hi, I have 3 DCs out of which in one of the DC, I added 20 nodes. All of the DCs had auth enabled, it was functioning fine. But after addition of 20 nodes in one of the DC, the permissions just got messed-up on the existing nodes. My application started getting errors while querying using the us

G1 GC settings

2015-10-13 Thread K F
Hi, has anyone started to use G1 collector. If so, how is the experience. Can you share your insights into some of the important tune up you had to do for cassandra. We are planning to use G1 collector with the latest version of jre 1.8.x Thanks.

Re: G1 GC settings

2015-10-13 Thread K F
Adding to the below thread planning to use stable 2.1.x release of cassandra From: K F To: User Sent: Tuesday, October 13, 2015 5:03 PM Subject: G1 GC settings Hi, has anyone started to use G1 collector. If so, how is the experience. Can you share your insights into some of the

Re: G1 GC settings

2015-10-13 Thread K F
Excellent, thanks Jonathan. From: Jon Haddad To: user@cassandra.apache.org; K F Sent: Tuesday, October 13, 2015 5:09 PM Subject: Re: G1 GC settings You may want to read Al Tobey’s Cassandra tuning guide.  It’s got a section on G1.  It’s being widely used, successfully, at massive

Work-around needed for issue seen as mentioned in CASSANDRA-8072

2015-11-02 Thread K F
Hi folks, We are hitting similar issue described in  https://issues.apache.org/jira/browse/CASSANDRA-8072When we try to bootstrap a node it doesn't bootstrap due to issues encountered in JIRA ticket above. We are using version of cassandra 2.0.14. Is there a work-around for the situation? Please n

Does nodetool cleanup clears tombstones in the CF?

2015-11-04 Thread K F
Hi, Quick question, in order for me to purge tombstones on particular nodes if I run nodetool cleanup will that help in purging the tombstones from that node? Thanks.

Re: Does nodetool cleanup clears tombstones in the CF?

2015-11-05 Thread K F
Thanks Rob, I will look into checksstablegarbage utility. However, I don't want to run major compaction as that would result in too big of a sstable. Regards,K F From: Robert Coli To: "user@cassandra.apache.org" ; K F Sent: Thursday, November 5, 2015 1:53 PM Su

Unable to bootstrap another DC in my cluster

2015-11-09 Thread K F
Hi folks, As I am trying to bring up a new DC in my cluster, my first seed node that I bring-up in the new DC that I am adding to the existing cluster. It's not able to receive reply back for the GossipDigestSyn request sent to other seeds in the cluster. This is causing the first node to come-u

Want to run repair on a node without it taking traffic

2015-12-02 Thread K F
Hi Folks, How can I run repair on a node without it taking any coordinator/client traffic. So, I can complete the repair on the node without it taking any traffic, except the streams from other nodes. Is that possible? Thanks.

ntpd clock sync

2016-03-09 Thread K F
Hi, I have question about ntpd. In certain clusters where new datacenters were added since 1 week we stood-up those machines didn't have ntpd running on them. Will it cause any problem if we enable or start ntpd now on those newly added datacenters.  Thanks.

Re: ntpd clock sync

2016-03-09 Thread K F
has drifted significantly into the future, when you start NTP you may be writing data with timestamps lower than timestamps on data that already exists. In this case, the existing data (with timestamps in the future) may take precedence over new writes (with correct timestamps). From: K F

Question about consistency in cassandra 2.0.9

2015-06-11 Thread K F
Hi, I am running a cassandra cluster with 4 dcs. Out of 4 dcs, I have 3 DCs returning right data but 1 dc where I had 1 node down, the data didn't return correct records. So, e.g. DC1 - 386 records (single-token based DC)DC2 - 386 records (vnode based DC)DC3 - 386 records (vnode based DC)DC4 - 1

Re: Question about consistency in cassandra 2.0.9

2015-06-11 Thread K F
cassandra. Regards,Ken From: graham sanderson To: user@cassandra.apache.org; K F Sent: Thursday, June 11, 2015 8:14 PM Subject: Re: Question about consistency in cassandra 2.0.9 It looks (I’m guessing with entirely not enough info) that you only have two nodes in DC4, and are probably