Re: Questions about cleaning up/purging Hinted Handoffs

2014-09-09 Thread Rahul Menon
to 1.2.x in a few weeks) > > What's the procedure to drop via JMX? > > - Rahul > 1-678-451-4545 (US) > +91 99018-06625 (India) > > > On Sep 9, 2014, at 9:23 AM, Rahul Menon wrote: > > Yep, the hinted handoff in 1.0.8 is abysmal at best. What is your > repli

Re: Questions about cleaning up/purging Hinted Handoffs

2014-09-09 Thread Rahul Menon
Yep, the hinted handoff in 1.0.8 is abysmal at best. What is your replication facter, i have had huge hints pile up, where i had to drop the entire coloumn family and then run a repair. Either that or you can use the JMX HintedHandoffManager and delete hints per endpoint. Also it maybe worthwhile t

Re: A question about using 'update keyspace with strategyoptions' command

2014-08-05 Thread Rahul Menon
Try the show keyspaces command and look for "Options" under each keyspace. Thanks Rahul On Tue, Aug 5, 2014 at 2:01 PM, Lu, Boying wrote: > Hi, All, > > > > I want to run ‘update keyspace with strategy_options={dc1:3, dc2:3}’ from > cassandra-cli to update the strategy options of some keyspace

Re: Authentication exception

2014-07-21 Thread Rahul Menon
I could you perhaps check your ntp? On Tue, Jul 22, 2014 at 3:35 AM, Jeremy Jongsma wrote: > I routinely get this exception from cqlsh on one of my clusters: > > cql.cassandra.ttypes.AuthenticationException: > AuthenticationException(why='org.apache.cassandra.exceptions.ReadTimeoutException: >

Re: Dead node seen as UP by replacement node

2014-03-14 Thread Rahul Menon
Since the older node is not available i would ask you to assassinate the old node and then get the node new node to bootstrap. On Thu, Mar 13, 2014 at 10:56 PM, Paulo Ricardo Motta Gomes < paulo.mo...@chaordicsystems.com> wrote: > Yes, exactly. > > > On Thu, Mar 13, 2014 at 1:

Re: Dead node seen as UP by replacement node

2014-03-13 Thread Rahul Menon
And the token value as suggested is tokenvalueoddeadnode-1 ? On Thu, Mar 13, 2014 at 9:29 PM, Paulo Ricardo Motta Gomes < paulo.mo...@chaordicsystems.com> wrote: > Nope, they have different IPs. I'm using the procedure described here to > replace a dead node: > http://www.datastax.com/docs/1.1/c

Re: Dead node seen as UP by replacement node

2014-03-13 Thread Rahul Menon
Are you replacing the node with the same token and the same IP? On Thu, Mar 13, 2014 at 4:36 AM, Paulo Ricardo Motta Gomes < paulo.mo...@chaordicsystems.com> wrote: > Some further info: > > I'm not using Vnodes, so I'm using the 1.1 replace node trick of setting > the initial_token in the cassan

Re: Opscenter help?

2014-03-13 Thread Rahul Menon
I have seen the conflicts with sudo error but that was with 3.X rpm on the amazon ami, i was how ever able to install it from the tar ball. As Nick has pointed out, the versions of OS and Opscenter will help in looking at this. Thanks Rahul On Thu, Mar 13, 2014 at 7:56 PM, Nick Bailey wrote: >

Re: Possibly losing data with corrupted SSTables

2014-01-30 Thread Rahul Menon
> Sessions-Users-ic-2933-Statistics.db > -rw-r--r-- 1 cassandra cassandra 574K Jan 15 10:50 > Sessions-Users-ic-2933-Summary.db > -rw-r--r-- 1 cassandra cassandra 79 Jan 15 10:50 > Sessions-Users-ic-2933-TOC.txt > > Should I delete those 3 files? Should I run nodetool refr

Re: Possibly losing data with corrupted SSTables

2014-01-30 Thread Rahul Menon
eTask.java:262) > ... 3 more > Caused by: java.io.IOException: dataSize of 3622081913630118729 starting > at 32906 would be larger than file > /mnt/cassandra/data/Sessions/Users/Sessions-Users-ib-2516-Data.db length > 1038893416 > at > org.apache.cassandra.io

Re: Possibly losing data with corrupted SSTables

2014-01-29 Thread Rahul Menon
Francisco, the sstables with *-ib-* is something that was from a previous version of c*. The *-ib-* naming convention started at c* 1.2.1 but 1.2.10 onwards im sure it has the *-ic-* convention. You could try running a nodetool sstableupgrade which should ideally upgrade the sstables with the *-ib

Re: Latest Stable version of cassandra in production

2014-01-09 Thread Rahul Menon
You should refer to this https://engineering.eventbrite.com/what-version-of-cassandra-should-i-run/ Thanks Rahul On Thu, Jan 9, 2014 at 8:06 AM, Sanjeeth Kumar wrote: > Hi all, > What is the latest stable version of cassandra you have in production ? > We are migrating a large chunk of our

Re: Crash with TombstoneOverwhelmingException

2013-12-25 Thread Rahul Menon
Sanjeeth, Looks like the error is being populated from the hintedhandoff, what is the size of your hints cf? Thanks Rahul On Wed, Dec 25, 2013 at 8:54 PM, Sanjeeth Kumar wrote: > Hi all, > One of my cassandra nodes crashes with the following exception > periodically - > ERROR [HintedHandoff

Re: Offline migration: Random->Murmur

2013-12-23 Thread Rahul Menon
Christian, I have been planning to migrate my cluster from random to murmur3 in a similar manner. I intend to use pycassa to read and then write to the newer cluster. My only concern would be ensuring the consistency of already migrated data as the cluster ( with random ) would be constantly servi

Re: Bulkoutputformat

2013-12-13 Thread Rahul Menon
Here you go http://thelastpickle.com/blog/2013/01/11/primary-keys-in-cql.html On Fri, Dec 13, 2013 at 7:19 AM, varun allampalli wrote: > Hi Aaron, > > It seems like you answered the question here. > > https://groups.google.com/forum/#!topic/nosql-databases/vjZA5vdycWA > > Can you give me the li

Re: Write performance with 1.2.12

2013-12-12 Thread Rahul Menon
Quote from http://www.datastax.com/dev/blog/performance-improvements-in-cassandra-1-2 *"Murmur3Partitioner is NOT compatible with RandomPartitioner, so if you’re upgrading and using the new cassandra.yaml file, be sure to change the partitioner back to RandomPartitioner"* On Thu, Dec 12, 2013 at

Re: nodetool repair keeping an empty cluster busy

2013-12-11 Thread Rahul Menon
Sven So basically when you run a repair you are essentially telling your cluster to run a validation compaction, which generates a merkle tree on all the nodes. These trees are used to identify the inconsistencies. So there is quite a bit of streaming which you see as your network traffic. Rahul

Re: How to monitor the progress of a HintedHandoff task?

2013-12-06 Thread Rahul Menon
lating in the first place might be a > spike in CF writes that must be replicated to a node in another data > center. The available bandwidth to that data center might not be able to > handle the data quickly enough, resulting in stored hints. The > HintedHandoff task that is started i

Re: cassandra backup

2013-12-06 Thread Rahul Menon
You should look at this - https://github.com/amorton/cassback i dont believe its setup to use 1.2.10 and above but i believe is just small tweeks to get it running. Thanks Rahul On Fri, Dec 6, 2013 at 7:09 PM, Michael Theroux wrote: > Hi Marcelo, > > Cassandra provides and eventually consisten

Re: How to monitor the progress of a HintedHandoff task?

2013-12-03 Thread Rahul Menon
ess the only way to see learn the progress is to look inside the > 'hints' column family then.I'll give that a try. > > > Thanks, > Tom > > > On Tue, Dec 3, 2013 at 1:43 PM, Rahul Menon wrote: > >> Tom, >> >> You should check the size of

Re: How to monitor the progress of a HintedHandoff task?

2013-12-03 Thread Rahul Menon
Tom, You should check the size of the hints column family to determine how much are present. The hints are a super column family and its keys are destination tokens. You could look at it if you would like. Hints send and timedouts are logged, you should be seeing something like Timed out replayi

Re: What is listEndpointsPendingHints?

2013-11-27 Thread Rahul Menon
Tom, Here is the definition List all the endpoints that this node has hints for, and count the number of hints for each such endpoint. Returns:map of endpoint -> hint count I would suggest looking at at the gossipinfo to validate if there are any nodes which have that token value. If there is (

Re: 1.1.11: system keyspace is filling up

2013-11-21 Thread Rahul Menon
Oleg, The system keyspace is not replicated it is local to the node. You should check your logs to see if there are Timeouts from streaming hints, i believe the default value to stream hints it 10 seconds. When i ran into this problem i truncated hints to clear out the space and then ran a repair