Re: Pending ReadStage is exploding on only one node

2011-11-23 Thread Shotaro Kamio
Even if your query contains multiple columns which have secondary index on each, current cassandra uses only one of them as a hash lookup. Other columns are for filtering out from matched results. If a part of your secondary index query has a lot of matches in data, cassandra has to iterate over ma

Re: Forcing Cassandra to free up some space

2011-06-15 Thread Shotaro Kamio
ctually >>>>>> invoke a full collection. >>>>>> >>>>>> On Thu, May 26, 2011 at 2:18 PM, Jeffrey Kesselman >>>>>> wrote: >>>>>>> Actually this is no gaurantee.   Its a common misunderstanding that >>>>>>> System.gc "forces" gc.  It does not. It is a suggestion only. The vm >>>>>>> always >>>>>>> has the option as to when and how much it gcs >>>>>>> >>>>>>> On May 26, 2011 2:51 PM, "Jonathan Ellis" wrote: >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Jonathan Ellis >>>>>> Project Chair, Apache Cassandra >>>>>> co-founder of DataStax, the source for professional Cassandra support >>>>>> http://www.datastax.com >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> It's always darkest just before you are eaten by a grue. >>>>> >>>> >>>> >>>> >>>> -- >>>> Jonathan Ellis >>>> Project Chair, Apache Cassandra >>>> co-founder of DataStax, the source for professional Cassandra support >>>> http://www.datastax.com >>>> >>> >>> >>> >>> -- >>> It's always darkest just before you are eaten by a grue. >>> >> >> >> >> -- >> Jonathan Ellis >> Project Chair, Apache Cassandra >> co-founder of DataStax, the source for professional Cassandra support >> http://www.datastax.com >> > > > > -- > It's always darkest just before you are eaten by a grue. > -- Shotaro Kamio

Re: Compacting single file forever

2011-04-21 Thread Shotaro Kamio
apache.org/cassandra/StorageConfiguration > It seems like compaction is running continually, are their pending tasks in > the o.a.c.db.CompactionManager MBean ? > How bad is you disk space problem ? > For the code change, AFAIK it's not possible for cassandra to know if there >

Re: How to repair HintsColumnFamily?

2011-03-28 Thread Shotaro Kamio
and can remove it. > > On Sun, Mar 27, 2011 at 12:17 AM, Shotaro Kamio wrote: >> Hi, >> >> Our cluster uses cassandra 0.7.4 (upgraded from 0.7.3) with >> replication = 3. I found that error occurs on one node during hinted >> handoff with following error (log #1 bel

Re: How to repair HintsColumnFamily?

2011-03-26 Thread Shotaro Kamio
here http://www.mail-archive.com/user@cassandra.apache.org/msg11358.html > Suggestion was to run repair if scrub raises an error. > Aaron > On 27 Mar 2011, at 16:17, Shotaro Kamio wrote: > > Hi, > > Our cluster uses cassandra 0.7.4 (upgraded from 0.7.3) with > replication = 3.

How to repair HintsColumnFamily?

2011-03-26 Thread Shotaro Kamio
Hi, Our cluster uses cassandra 0.7.4 (upgraded from 0.7.3) with replication = 3. I found that error occurs on one node during hinted handoff with following error (log #1 below). When I tried out "scrub system HintsColumnFamily", I saw an ERROR in log (log #2 below). Do you think these errors are c

HintedHandoff increases in read?

2011-03-18 Thread Shotaro Kamio
Hi, When I looking at "countPendingHints" in HintedHandoffManager via jmx, I found that pending hints increases even when my cluster handles only reads with quorum from clients. The count decreases when I see it in long period (e.g., in an hour). But it can increase in several thousands in short p

Re: Inconsistent result in super range slice query (reversed order)

2011-02-21 Thread Shotaro Kamio
gt;     print "col='%s' \tlen = %d" % (supercol, len(subcols)) > > start = 0 > for end in [0,3,5,7]: >     print "\nstart %d, end %d + 'z'" % (start, end) >     get_cols(columns[start], columns[end] + 'z', False) > > end = 0

Re: Inconsistent result in super range slice query (reversed order)

2011-02-17 Thread Shotaro Kamio
case the choice of partitioner is not important. The comparator and > sub comparator as specified in the CF definition control the ordering of > colums. If possible i would suggest using the random partitioner. > > Could you provide examples of how you are doing the queries using pycassa we > ma

Inconsistent result in super range slice query (reversed order)

2011-02-17 Thread Shotaro Kamio
Hi, We are in trouble with a strange behavior in cassandra 0.7.2 (also happened in 0.7.0). Could someone help us? The problem happens on a column family of super column type named "Order". Data structure is something like: Order[ a_key ][ date + "/" + order_id + "/" (+ suffix) ][attribute] = va

Re: Cassandra memtable and GC

2010-11-11 Thread Shotaro Kamio
thing to figure out is what CPU time is > spent on. If it is GC it should almost certainly be fixable as long as > one knows *why* (it should be due to heap usage, although I don't see > anything in your numbers that would indicate to me why the heap would > have so much live data as to cause problems given your 16 gig heap > size). > > -- > / Peter Schuller > -- Shotaro Kamio