write timeouts when saving a big object

2015-04-22 Thread Alexander Shutyaev
Hi all! We have a problem with cassandra. We're getting write timeouts when saving a big object. The object size is approx. 30 Mb which is big but not enormous as (if I'm not wrong) cassandra can handle up to 2Gb in theory. We tried increasing write timeout but that didn't help - 10 minutes that w

Re: MUTATION messages dropped

2013-12-19 Thread Alexander Shutyaev
od. If that happened > when a bunch of writes came in, we'd see a spike in Mutation drops. > > Check nodetool tpstats for FlushWriter all time blocked. > > > On Thu, Dec 19, 2013 at 7:12 AM, Alexander Shutyaev wrote: > >> Hi all! >> >> We've had a

MUTATION messages dropped

2013-12-19 Thread Alexander Shutyaev
Hi all! We've had a problem with cassandra recently. We had 2 one-minute periods when we got a lot of timeouts on the client side (the only timeouts during 9 days we are using cassandra in production). In the logs we've found corresponding messages saying something about MUTATION messages dropped.

Re: cassandra performance problems

2013-12-19 Thread Alexander Shutyaev
yan Earl wrote: > >> On Thu, Dec 5, 2013 at 6:33 AM, Alexander Shutyaev wrote: >> >>> We've plugged it into our production environment as a cache in front of >>> postgres. Everything worked fine, we even stressed it by explicitly >>> propagating about 30

Re: cassandra performance problems

2013-12-05 Thread Alexander Shutyaev
obert Coli > On Thu, Dec 5, 2013 at 4:33 AM, Alexander Shutyaev wrote: > >> Cassandra version is 2.0.3. ... We've plugged it into our production >> environment as a cache in front of postgres. >> > > https://engineering.eventbrite.com/what-version-of-cassandra-sho

cassandra performance problems

2013-12-05 Thread Alexander Shutyaev
Hi all, We have a 3 node cluster setup, single keyspace, about 500 tables. The hardware is 2 cores + 16 GB RAM (Cassandra chose to have 4GB). Cassandra version is 2.0.3. Our replication factor is 3, read/write consistency is QUORUM. We've plugged it into our production environment as a cache in fr

Re: DELETE does not delete :)

2013-10-17 Thread Alexander Shutyaev
the select query a couple of times in a row right after > deletion, do you see the data appear again? > > > On Wed, Oct 16, 2013 at 12:12 AM, Alexander Shutyaev > wrote: > >> Hi all, >> >> Unfortunately, we still have a problem. I've modified my code, so that it

Re: DELETE does not delete :)

2013-10-15 Thread Alexander Shutyaev
| grep ntp" to see if ntpd it's already running. > > On Oct 7, 2013, at 12:23 AM, Alexander Shutyaev > wrote: > > Hi Michał, > > I didn't notice your message at first.. Well this seems like a real cause > candidate.. I'll add an explicit consistency level

Re: DELETE does not delete :)

2013-10-07 Thread Alexander Shutyaev
Hi Michał, I didn't notice your message at first.. Well this seems like a real cause candidate.. I'll add an explicit consistency level QUORUM and see if that helps. Thanks 2013/10/7 Alexander Shutyaev > Hi Nick, > > Thanks for the note! We have our cassanra instances i

Re: DELETE does not delete :)

2013-10-06 Thread Alexander Shutyaev
t; > my two cents - before doing anything else, make sure clocks are > synchronized to the millisecond. > ntp will do so. > > Nick. > > > On Mon, Oct 7, 2013 at 9:02 AM, Alexander Shutyaev wrote: > >> Hi all, >> >> We have encountered the following proble

DELETE does not delete :)

2013-10-06 Thread Alexander Shutyaev
Hi all, We have encountered the following problem with cassandra. * We use *cassandra v2.0.0* from *Datastax* community repo. * We have *3 nodes* in a cluster, all of them are seed providers. * We have a *single keyspace* with *replication factor = 3*: *CREATE KEYSPACE bof WITH replication = {

datastax ops center shows a lot of activity when idle

2013-09-18 Thread Alexander Shutyaev
Hi all! We have experienced a strange issue with datastax opscenter. It showed much more write requests that we should actually have. We've set everything up on an isolated node and there without any activity it showed 100+ writes per second. Is this some opscenter bug? Does it maybe count some in

cassandra not responding, log full of gc invocations

2013-09-18 Thread Alexander Shutyaev
Hi all! We have a problem with cassandra 2.0. We have installed cassandra from datastax community respository. We haven't changed any java options from the default ones. De-facto Xmx is 1GB. Recently we have encountered a couple of cases when cassandra stopped responding and the log was showing so

Re: mysterious 'column1' in cql describe

2013-08-30 Thread Alexander Shutyaev
> CQL3 interprets thrift table, and why your saw what you saw). > > -- > Sylvain > > > On Fri, Aug 30, 2013 at 9:50 AM, Alexander Shutyaev wrote: > >> Hi all! >> >> We have encountered the following problem. We create our column families >>

mysterious 'column1' in cql describe

2013-08-30 Thread Alexander Shutyaev
Hi all! We have encountered the following problem. We create our column families via hector like this: ColumnFamilyDefinition cfdef = HFactory.createColumnFamilyDefinition(* "mykeyspace"*, *"mycf"*); cfdef.setColumnType(ColumnType.*STANDARD*); cfdef.setComparatorType(ComparatorType.*UTF8TYPE*); c

Re: CorruptSSTableException in system keyspace

2013-04-02 Thread Alexander Shutyaev
ses. > > https://issues.apache.org/jira/browse/CASSANDRA-5225 > https://issues.apache.org/jira/browse/CASSANDRA-5365 > > Cheers > > - > Aaron Morton > Freelance Cassandra Consultant > New Zealand > > @aaronmorton > http://www.thelastpickle.com &g

CorruptSSTableException in system keyspace

2013-04-01 Thread Alexander Shutyaev
Hi all! Our app currently moves from *hibernate* to *cassandra+solr* combination (we use our own storage abstraction for this). We have a lot of junit integration tests that use database. Now we've decided to use these tests to test our *cassandra+solr* storage implementation (given that on * hibe

Re: force gc?

2012-09-02 Thread Alexander Shutyaev
Hi Derek, I'm using size-tiered compaction. 2012/9/3 Derek Williams > On Fri, Aug 31, 2012 at 7:03 AM, Alexander Shutyaev wrote: > >> Does anyone have any suggestions on how can I analyze my problem? Or >> maybe I'm doing something wrong and there is another way t

Re: force gc?

2012-09-02 Thread Alexander Shutyaev
Hi Peter, I don't compare it with PosgreSQL size, I just make some estimations.. This table / column family stores some xml documents with average raw size of 2Mb each and total size about 5Gb. However the space cassandra occupies on disc is 70Gb (after gc_grace was set to 0 and major compaction w

Re: force gc?

2012-09-02 Thread Alexander Shutyaev
; collection, the same is true of the finalizer. You are > not guaranteed when, if ever, it will run. > > > On Fri, Aug 31, 2012 at 9:03 AM, Alexander Shutyaev wrote: > >> Hi All! >> >> I have a problem with using cassandra. Our application does a lot of >> ov

force gc?

2012-08-31 Thread Alexander Shutyaev
Hi All! I have a problem with using cassandra. Our application does a lot of overwrites and deletes. If I understand correctly cassandra does not actually delete these objects until gc_grace seconds have passed. I tried to "force" gc by setting gc_grace to 0 on an existing column family and runnin