Side effects of hinted handoff lead to consistency problem

2013-10-07 Thread Jason Tang
I have a 3 nodes cluster, replicate_factor is 3 also. Consistency level is Write quorum, Read quorum. Traffic has three major steps Create: Rowkey: Column: status=new, requests="x" Update: Rowkey: Column: status=executing, requests="x" Delete: Rowkey:

Re: Question about info returned from 'nodetool gossipinfo'

2013-10-07 Thread ravi prasad
Not sure about vnodes setup. looks like the output shows only the first token. if you are looking for all tokens assigned,  'nodetool info -T' might help. On Monday, October 7, 2013 6:22 PM, Sameer Farooqui wrote: A quick follow up question - If my node is configured with Virtual Nodes an

Re: Question about info returned from 'nodetool gossipinfo'

2013-10-07 Thread Sameer Farooqui
A quick follow up question - If my node is configured with Virtual Nodes and 256 tokens are assigned to it, how does the STATUS line only show one token value? In this case the -12331...#. On Mon, Oct 7, 2013 at 9:00 PM, Sameer Farooqui wrote: > Thanks, Ravi! > > > On Mon, Oct 7, 2013 at 2:40 AM

Question about SizeTieredCompactionStrategy in C* 2.0: not all SSTables are being compacted

2013-10-07 Thread Sameer Farooqui
Hi, I have a fresh 1-node C* 2.0 install with a demo keyspace created with the SizeTiered compaction strategy. I've noticed that in the beginning this keyspace has just one SSTable: demodb-users-jb-1-Data.db But as I add more data to the table and do some flushes, the # of SSTables builds up. Af

Re: Question about info returned from 'nodetool gossipinfo'

2013-10-07 Thread Sameer Farooqui
Thanks, Ravi! On Mon, Oct 7, 2013 at 2:40 AM, ravi prasad wrote: > the output of "nodetool gossipinfo" are the application states of each > endpoint/node in the cluster that are exchanged b/w the nodes during > gossiping. > > "Severity" is basically a measure of compaction activity/events in a

gossip settling and bootstrap problems

2013-10-07 Thread Chris Burroughs
I've been running into a variety of tricky to diagnose problems recently that could be summarized as "bootstrap & related tasks fail without extra hacky sleep time". This is a sample edited log file for bootstrapping a node that captures the general dynamics: http://pastebin.com/yeN9USLt This

Cassandra-cql read error

2013-10-07 Thread Martin Arrowsmith
Hi all, We are using the Ruby gem wrapper for Cassandra: "cassandra-cql" I was wondering if anyone has come across this error before: Error #, /usr/local/rvm/gems/ruby-1.9.3-p448-turbo/gems/thrift-0.8.0/lib/thrift/transport/socket.rb:109:in `read': We seem to get this when there is a heavy loa

Re:

2013-10-07 Thread Robert Coli
On Sun, Oct 6, 2013 at 9:18 AM, Ran Tavory wrote: > Not sure that's related, but the changes I performed were to disable > hinted handoff and disable auto snapshot. I'll try to reverte these, see if > the picture changes. > It is difficult to imagine how these config changes might be related.

Re: Disappearing index data.

2013-10-07 Thread Janne Jalkanen
https://issues.apache.org/jira/browse/CASSANDRA-5732 There is now a reproducible test case. /Janne On Oct 7, 2013, at 16:29 , Michał Michalski wrote: > I had similar issue (reported many times here, there's also a JIRA issue, but > people reporting this problem were unable to reproduce it).

Re: DELETE does not delete :)

2013-10-07 Thread Jon Haddad
I haven't used VMWare but it seems odd that it would lock up the ntp port. try "ps aux | grep ntp" to see if ntpd it's already running. On Oct 7, 2013, at 12:23 AM, Alexander Shutyaev wrote: > Hi Michał, > > I didn't notice your message at first.. Well this seems like a real cause > candidat

Re: Disappearing index data.

2013-10-07 Thread Keith Freeman
We use Jmxterm: http://wiki.cyclopsgroup.org/jmxterm On 10/07/2013 07:53 AM, Tom van den Berge wrote: Thanks, I'll give that a try. Is there a way to do this without JMX? I wouldn't know now to run a JMX console on my production servers without a graphical interface. On Mon, Oct 7, 2013 at

How to test code using Java DataStax CQL client

2013-10-07 Thread Aleksandra Nowak
Hi all, I want to move to new Cassandra version and use Java DataStax CQL client with it. For now on I've been using Hector as a Java client and cassandra-unit to run junit test. What should I use to test the code now? Is there a special library for testing code using Datastax driver? I wasn't able

Re: Disappearing index data.

2013-10-07 Thread Tom van den Berge
Thanks, I'll give that a try. Is there a way to do this without JMX? I wouldn't know now to run a JMX console on my production servers without a graphical interface. On Mon, Oct 7, 2013 at 3:29 PM, Michał Michalski wrote: > I had similar issue (reported many times here, there's also a JIRA iss

Re: Disappearing index data.

2013-10-07 Thread Michał Michalski
I had similar issue (reported many times here, there's also a JIRA issue, but people reporting this problem were unable to reproduce it). What I can say is that for me the solution was to run major compaction on the index CF via JMX. To be clear - we're not talking about compacting the CF that

Disappearing index data.

2013-10-07 Thread Tom van den Berge
On a 2-node cluster with replication factor 2, I have a column family with an index on one of the columns. Every now and then, I notice that a lookup of the record through the index on node 1 produces the record, but the same lookup on node 2 does not! If I do a lookup by row key, the record is fo

Any suggestions about running Cassandra on Windows servers for production use?

2013-10-07 Thread Vassilis Bekiaris
Hello all, we are planning a Cassandra 1.2 installation at a client site; the client will run operations themselves and based on their IT team's experience they are more inclined towards running Cassandra nodes on Windows servers, however given proper arguments they would also consider using linux

Re: DELETE does not delete :)

2013-10-07 Thread Alexander Shutyaev
Hi Michał, I didn't notice your message at first.. Well this seems like a real cause candidate.. I'll add an explicit consistency level QUORUM and see if that helps. Thanks 2013/10/7 Alexander Shutyaev > Hi Nick, > > Thanks for the note! We have our cassanra instances installed on virtual > ho