CASSANDRA-2863

2011-11-15 Thread Ian Danforth
Re: https://issues.apache.org/jira/browse/CASSANDRA-2863 All, I encountered this NPE during a node move. Everything seemed to complete (no streaming, no further compactions, no further errors in system.log) however the move command never returned. After several hours I then cancelled that comman

Bug?

2011-11-10 Thread Ian Danforth
All, In 0.8.6 I got myself into a bit of a fix. First I tried to drop a column family. This failed because I didn't have JNA installed (known and documented). To fix this I drained the node, stopped the process, installed JNA, and restarted C*. Unfortunately this lead to an inconsistency in sche

Re: Second Cassandra users survey

2011-11-07 Thread Ian Danforth
> > > Wish list: A decent GUI to explore data kept in Cassandra would be much > valuable. It should also be extendable to > provide viewers for custom data. > > +1 to that. @jonathan - This is what google moderator is really good at. Perhaps start one and move the idea creation / voting there.

Read perf investigation

2011-11-03 Thread Ian Danforth
All, I've done a bit more homework, and I continue to see long 200ms to 300ms read times for some keys. Test Setup EC2 M1Large sending requests to a 5 node C* cluster also in EC2, also all M1Large. RF=3. ReadConsistency = ONE. I'm using pycassa from python for all communication. Data Model On

Specific Question, General Problem

2011-10-21 Thread Ian Danforth
All, I have a specific question which I think highlights a general problem. ===Specific Question=== I'm seeing read times of 2-300ms for getting a single row. This seems slow, but is it unusual? Stack 5 node cluster Version .86 EC2 m1large machines ebs drives for all data (I know, I know) Da

Shrinking cluster with counters ...

2011-10-04 Thread Ian Danforth
All, If I have a 3 node cluster storing counters and RF3, is it possible to shrink back down to a single node cluster? If so should I change replication factor, disable a node, wait for streaming to complete, and repeat for the other node? Should I assume that the cluster will be unavailable duri

Re: Storing (python) objects

2011-09-23 Thread Ian Danforth
Good feedback from all. Thanks! Ian On Fri, Sep 23, 2011 at 7:48 AM, Tristan Seligmann wrote: > On Fri, Sep 23, 2011 at 1:09 AM, Alexis Lê-Quôc wrote: > > For data accessed through a single path, I use the same trick: pickle, > bz2 > > and insert. > > Note that unpickling a pickle in Python inv

Storing (python) objects

2011-09-22 Thread Ian Danforth
All, I find myself considering storing serialized python dicts in Cassandra. I'd like to store fairly complex, nested dicts, and it's just easier to do this rather than work out a lot of super columns / columns etc. Do others find themselves storing serialized data structures in Cassandra or is

Re: [BETA RELEASE] Apache Cassandra 1.0.0-beta1 released

2011-09-15 Thread Ian Danforth
Congrats! Thanks for all the hard work! On Thu, Sep 15, 2011 at 11:01 AM, Sylvain Lebresne wrote: > The Cassandra team is pleased to announce the release of the first beta for > the future Apache Cassandra 1.0. > > Let me first stress that this is beta software and as such is *not* ready > for >

Re: Replicate On Write behavior

2011-09-02 Thread Ian Danforth
That ticket explains a lot, looking forward to a resolution on it. (Sorry I don't have a patch to offer) Ian On Fri, Sep 2, 2011 at 12:30 AM, Sylvain Lebresne wrote: > On Thu, Sep 1, 2011 at 8:52 PM, David Hawthorne wrote: >> I'm curious... digging through the source, it looks like replicate on

Re: Fun with Heap Dump ...

2011-09-01 Thread Ian Danforth
Awesome, thanks for the quick response! Ian On Thu, Sep 1, 2011 at 5:27 PM, Jonathan Ellis wrote: > On Thu, Sep 1, 2011 at 6:54 PM, Ian Danforth wrote: >> 1. What operation is C* performing during lines like these: >> >>  INFO 22:38:34,710 Opening /cassandra/data/Keyspac

Fun with Heap Dump ...

2011-09-01 Thread Ian Danforth
All, I need help interpreting the results of my investigation. I'm encountering this error: "Unable to reduce heap usage since there are no dirty column families". My heap sits near max and occasionally OOMs. (4GB heap) Following Mr. Ellis's instructions here: http://cassandra-user-incubator-apa

Re: Replicate On Write behavior

2011-09-01 Thread Ian Danforth
I'm not sure I understand the scalability of this approach. A given column family can be HUGE with millions of rows and columns. In my cluster I have a single column family that accounts for 90GB of load on each node. Not only that but column family is distributed over the entire ring. Clearly I'm

Re: 15 seconds to increment 17k keys?

2011-09-01 Thread Ian Danforth
lient. > > -- > Richard Low > Acunu | http://www.acunu.com | @acunu > > On Thu, Sep 1, 2011 at 2:31 AM, Yang wrote: >> 1ms per add operation is the general order of magnitude I have seen with my >> tests. >> >> >> On Wed, Aug 31, 2011 at 6:04 PM, Ia

15 seconds to increment 17k keys?

2011-08-31 Thread Ian Danforth
All, I've got a 4 node cluster (ec2 m1.large instances, replication = 3) that has one primary counter type column family, that has one column in the family. There are millions of rows. Each operation consists of doing a batch_insert through pycassa, which increments ~17k keys. A majority of these

Node out of sync

2011-08-18 Thread Ian Danforth
All, One node in my cluster returns a different answer for nodetool ring. It seems to be ignorant of one of the other nodes. I've verified that all nodes can ping each other without difficulty. Here is the proper response: Address DC RackStatus State LoadO

Re: Max heap not sticking?

2011-08-15 Thread Ian Danforth
False alarm, typo further down in cassandra-env.sh was removing all the opts. Ian On Mon, Aug 15, 2011 at 6:08 PM, Ian Danforth wrote: > All, > > When I connect to a node through jconsole it's telling me that my max > heap is only 1.7gb. (eg http://screencast.com/t/7DP

Max heap not sticking?

2011-08-15 Thread Ian Danforth
All, When I connect to a node through jconsole it's telling me that my max heap is only 1.7gb. (eg http://screencast.com/t/7DP8ovdUv) However I believe I have properly specified that it should be 4GB in cassandra-env.sh. Total memory is 7.5GB I see greatly increased GC activity as the heap appr

Re: tpstats confusion

2011-08-12 Thread Ian Danforth
and N=3 the closest node is always the local one. > > > Cheers > >- > Aaron Morton > Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > > On 12 Aug 2011, at 10:10, Ian Danforth wrote: > > I'm writing at QUORUM

Re: tpstats confusion

2011-08-11 Thread Ian Danforth
2011 at 2:56 PM, Jonathan Ellis wrote: > https://issues.apache.org/jira/browse/CASSANDRA-2889 > > On Thu, Aug 11, 2011 at 2:55 PM, Ian Danforth > wrote: > > I don't think so, perhaps more succinctly, why would ROW actions only be > > performed on a single node? >

Re: tpstats confusion

2011-08-11 Thread Ian Danforth
I don't think so, perhaps more succinctly, why would ROW actions only be performed on a single node? Ian On Wed, Aug 10, 2011 at 8:12 PM, Jonathan Ellis wrote: > are you i/o bound? I believe counter ROW needs to perform a read of > the old value. > > On Wed, Aug 10, 201

Re: [RELEASE] Apache Cassandra 0.8.4 released

2011-08-11 Thread Ian Danforth
Would you be so kind as to announce the rpm release as well? On Thu, Aug 11, 2011 at 10:52 AM, Sylvain Lebresne wrote: > The Cassandra team is pleased to announce the release of Apache Cassandra > version 0.8.4. > > Cassandra is a highly scalable second-generation distributed database, > bringing

tpstats confusion

2011-08-10 Thread Ian Danforth
Hello all! Thanks for taking the time to read this, I'm new to Cassandra and really want to get it working :) Below you'll find the output from tpstats on the three nodes in my .8.1 cluster. As you'll note from ring (also below), my cluster appears balanced. However, please note that NODE1 is the