Re: MUTATION messages dropped

2013-12-19 Thread Jared Biel
I can't comment on your specific issue, but I don't know if running 2.0.0 in production is a good idea. At the very least I'd try upgrading to the latest 2.0.X (currently 2.0.3.) https://engineering.eventbrite.com/what-version-of-cassandra-should-i-run/ On 20 December 2013 06:08, Alexander Shuty

Re: MUTATION messages dropped

2013-12-19 Thread Alexander Shutyaev
Thanks for you answers. *srmore*, We are using v2.0.0. As for GC I guess it does not correlate in our case, because we had cassandra running 9 days under production load and no dropped messages and I guess that during this time there were a lot of GCs. *Ken*, I've checked the values you indicat

Re: Occasional NPE using DataStax Java driver

2013-12-19 Thread David Tinker
Done. https://datastax-oss.atlassian.net/browse/JAVA-231 On Thu, Dec 19, 2013 at 10:42 AM, Sylvain Lebresne wrote: > Mind opening a ticket on https://datastax-oss.atlassian.net/browse/JAVA? > It's almost surely a bug. > > -- > Sylvain > > > On Thu, Dec 19, 2013 at 8:21 AM, David Tinker > wrote:

RE: Issue upgrading from 1.2 to 2.0.3

2013-12-19 Thread Parag Patel
Thanks for that link. Our 1.2 version is 1.2.12 Our 2.0.3 nodes were restarted once. Before restart, it was the 1.2.12 binary, after it was the 2.0.3. Immediately after the node was back in the cluster, we ran nodetool upgradesstables. We haven't restarted since. Is a restart required for e

Re: Improving write performance in Cassandra and a few related issues...

2013-12-19 Thread Aaron Morton
> Thanks for the reply. By packet drops I mean, the client is not able to read > the shared memory as fast as the software switch is writing into it.. > > What is the error you are getting on the client ? >Also, I would like to know if in general , distribution of write requests > to dif

Re: Issue upgrading from 1.2 to 2.0.3

2013-12-19 Thread Robert Coli
On Thu, Dec 19, 2013 at 1:03 PM, Parag Patel wrote: > We are in the process of upgrading 1.2 to 2.0.3. > ... > Please help as this will prevent us from pushing into production. > (as a general commentary : https://engineering.eventbrite.com/what-version-of-cassandra-should-i-run/ ) specific f

WriteTimeoutException on Lightweight transactions

2013-12-19 Thread Demian Berjman
Hi. I am using Cassandra 2.0.3 with Datastax Java client. I execute an insert query: Insert insert = QueryBuilder.insertInto("demo_cl","demo_table").value("id", id).value("col1", "transactions").ifNotExists(); session.execute(insert.setConsistencyLevel(ConsistencyLevel.QUORUM); Then, i force a

Issue upgrading from 1.2 to 2.0.3

2013-12-19 Thread Parag Patel
Hi, We are in the process of upgrading 1.2 to 2.0.3. We have a four node cluster and we're upgrading one node at a time. After upgrading two of the nodes, we encountered a problem. We observed that if we run nodetool status on the 2.0.3 hosts, they would show 2 nodes down and 2 nodes up. If

Re: Cassandra pytho pagination

2013-12-19 Thread Kumar Ranjan
Rob - I got a question following your advice. This is how, I define my column family validators = { 'approved':'UTF8Type', 'tid': 'UTF8Type', 'iid': 'UTF8Type', 'score': 'IntegerType', 'likes': 'Intege

Re: Paging error after upgrade from C* 2.0.1 to 2.0.3 , Driver from 2.0.0-rc1 to 2.0.0-rc2

2013-12-19 Thread Sylvain Lebresne
> > > > I'll note that while far from idea, you can also disable assertion with > 2.0.3. > > Is there a way to do that without patching/recompiling?? You make it sound > as if there is... > > Comment the following line in cassandra-env.sh: JVM_OPTS="$JVM_OPTS -ea"

Re: MUTATION messages dropped

2013-12-19 Thread Ken Hancock
We had issues where the number of CF families that were being flushed would align and then block writes for a very brief period. If that happened when a bunch of writes came in, we'd see a spike in Mutation drops. Check nodetool tpstats for FlushWriter all time blocked. On Thu, Dec 19, 2013 at 7

Re: Paging error after upgrade from C* 2.0.1 to 2.0.3 , Driver from 2.0.0-rc1 to 2.0.0-rc2

2013-12-19 Thread Jan Algermissen
On 19.12.2013, at 14:09, Sylvain Lebresne wrote: > > > Is there anything I can do except waiting for a fix? > > Disable paging (which might imply having to do some manual paging if the > result set you were querying were really big). Yes, that was my original code - might do that. > > I'

Re: MUTATION messages dropped

2013-12-19 Thread srmore
What version of Cassandra are you running ? I used to see them a lot with 1.2.9, I could correlate the dropped messages with the heap usage almost every time, so check in the logs whether you are getting GC'd. In this respect 1.2.12 appears to be more stable. Moving to 1.2.12 took care of this for

Re: Paging error after upgrade from C* 2.0.1 to 2.0.3 , Driver from 2.0.0-rc1 to 2.0.0-rc2

2013-12-19 Thread Sylvain Lebresne
> > Is there anything I can do except waiting for a fix? > Disable paging (which might imply having to do some manual paging if the result set you were querying were really big). > > I moved to 2.0.3 because I think I experienced missing rows in 2.0.1 > paging - is this related to the 2.0.3 bug?

MUTATION messages dropped

2013-12-19 Thread Alexander Shutyaev
Hi all! We've had a problem with cassandra recently. We had 2 one-minute periods when we got a lot of timeouts on the client side (the only timeouts during 9 days we are using cassandra in production). In the logs we've found corresponding messages saying something about MUTATION messages dropped.

Re: cassandra performance problems

2013-12-19 Thread Alexander Shutyaev
Thanks all for your responses. We've downgraded from 2.0.3 to 2.0.0 and everything became normal. 2013/12/8 Nate McCall > If you are really set on using Cassandra as a cache, I would recommend > disabling durable writes for the keyspace(s)[0]. This will bypass the > commitlog (the flushing/rota

Re: Paging error after upgrade from C* 2.0.1 to 2.0.3 , Driver from 2.0.0-rc1 to 2.0.0-rc2

2013-12-19 Thread Jan Algermissen
Sylvain, thanks. Is there anything I can do except waiting for a fix? Could I do something to my data? Or data model? I moved to 2.0.3 because I think I experienced missing rows in 2.0.1 paging - is this related to the 2.0.3 bug? Meaning: going back to 2.0.1 will fix the exception, but leave

Re: Paging error after upgrade from C* 2.0.1 to 2.0.3 , Driver from 2.0.0-rc1 to 2.0.0-rc2

2013-12-19 Thread Sylvain Lebresne
https://issues.apache.org/jira/browse/CASSANDRA-6447 On Thu, Dec 19, 2013 at 11:16 AM, Jan Algermissen < jan.algermis...@nordsc.com> wrote: > Hi all, > > after upgrading C* and the java-driver I am running into problems with > paging. Maybe someone can provide a quick clue. > > Upgrading was >

org.apache.thrift.TApplicationException: get_range_slices failed: out of sequence response

2013-12-19 Thread Jason Wee
Hi, In regards to recv_get_range_slices(), in my cassandra client code, it always throw new org.apache.thrift.TApplicationException(org.apache.thrift.TApplicationException.BAD_SEQUENCE_ID, "get_range_slices failed: out of sequence response"); Full source code here https://raw.github.com/apache/

Paging error after upgrade from C* 2.0.1 to 2.0.3 , Driver from 2.0.0-rc1 to 2.0.0-rc2

2013-12-19 Thread Jan Algermissen
Hi all, after upgrading C* and the java-driver I am running into problems with paging. Maybe someone can provide a quick clue. Upgrading was C* from 2.0.1 to 2.0.3 Java Driver from 2.0.0-rc1 to 2.0.0-rc2 Client side, I get the following messages (apparently during a call to resultSet.on

Re: Occasional NPE using DataStax Java driver

2013-12-19 Thread Mikhail Stepura
I would suggest to file an issue at https://datastax-oss.atlassian.net/browse/JAVA -Mikhail On 12/18/13, 23:21, David Tinker wrote: We are using Cassandra 2.0.3-1 installed on Ubuntu 12.04 from the DataStax repo with the DataStax Java driver version 2.0.0-rc1. Every now and then we get the fol

Re: Occasional NPE using DataStax Java driver

2013-12-19 Thread Mikhail Stepura
I would suggest to file an issue at https://datastax-oss.atlassian.net/browse/JAVA -Mikhail On 12/18/13, 23:21, David Tinker wrote: We are using Cassandra 2.0.3-1 installed on Ubuntu 12.04 from the DataStax repo with the DataStax Java driver version 2.0.0-rc1. Every now and then we get the fol

Re: Occasional NPE using DataStax Java driver

2013-12-19 Thread Sylvain Lebresne
Mind opening a ticket on https://datastax-oss.atlassian.net/browse/JAVA? It's almost surely a bug. -- Sylvain On Thu, Dec 19, 2013 at 8:21 AM, David Tinker wrote: > We are using Cassandra 2.0.3-1 installed on Ubuntu 12.04 from the > DataStax repo with the DataStax Java driver version 2.0.0-rc1.

Re: Setting up Cassandra to store on a specific node and not replicate

2013-12-19 Thread Sylvain Lebresne
On Wed, Dec 18, 2013 at 7:31 PM, Robert Coli wrote: > On Wed, Dec 18, 2013 at 2:44 AM, Sylvain Lebresne wrote: > >> As Janne said, you could still have hint being written by other nodes if >> the one storage node is dead, but you can use the system >> property cassandra.maxHintTTL to 0 to disable

Re: Setting up Cassandra to store on a specific node and not replicate

2013-12-19 Thread Janne Jalkanen
Probably yes, if you also disabled any sort of failovers from the token-aware client… (Talking about this makes you realize how many failsafes Cassandra has. And still you can lose data… :-P) /Janne On 18 Dec 2013, at 20:31, Robert Coli wrote: > On Wed, Dec 18, 2013 at 2:44 AM, Sylvain Lebr