Ruby, CQL and client libraries

2011-12-05 Thread Matthew Stump
Howdy, I'm working on transferring an existing Ruby on Rails project from Postgres to Cassandra and I have a couple questions about the Ruby client libraries and client libraries in general. 1.) Is it the opinion of the community and the Datastax engineers that client libraries should migrate

Re: DyanmicCompositeType bug?

2011-12-05 Thread Sylvain Lebresne
On Mon, Dec 5, 2011 at 8:19 AM, Boris Yen wrote: > Hi, > > I am using 0.8.7. > > I was trying to use DynamicComposite column. After I intentional added a > column (string:string:uuid) into a record which has previous columns > inserted with comparator (string:uuid:uuid). I got an exception on the

Re: Re: Cassandra DataModeling recommendations

2011-12-05 Thread pcohen
Hi Thanks for the answer, as I read the book on Cassandra, I was not aware at that time on Composite Key which I recently discovered. You mentioned a TTL and let the database remove the date for me. I never read about that. Is it possible without an external batch ? I will try to rephra

Re: DyanmicCompositeType bug?

2011-12-05 Thread Boris Yen
It looks like using the dynamicComposite is a dangerous action. However, one mistaken insertion causes the database to corrupt seems a little bit too much. Is there anyway to just skip the wrong column. On Mon, Dec 5, 2011 at 5:31 PM, Sylvain Lebresne wrote: > On Mon, Dec 5, 2011 at 8:19 AM, Bori

Re: Re: Cassandra DataModeling recommendations

2011-12-05 Thread Boris Yen
I think most of the book for cassandra are outdated, try to get information from http://www.datastax.com/docs/1.0/index As for ttl, you could read http://www.datastax.com/dev/blog/whats-new-cassandra-07-expiring-columns for more information. for composite type, you could read http://www.slideshar

Re: Re: Cassandra DataModeling recommendations

2011-12-05 Thread samal
On Mon, Dec 5, 2011 at 3:06 PM, wrote: > Hi > Thanks for the answer, as I read the book on Cassandra, I was not aware at > that time on Composite Key which I recently discovered. > *Composite Type's are useful for handling data-versions. * * * > * *You mentioned a TTL and let the database remov

Re: OutOfMemory Exception during bootstrap

2011-12-05 Thread Harald Falzberger
I don't think that this is the problem because I'm testing on a supercomputer with 16T RAM. Is it possible, that cassandra runs into this bug of the jvm? http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6399443 On Mon, Dec 5, 2011 at 06:29, samal wrote: > Lower your heap size, if you are testi

Strange problem with cassandra

2011-12-05 Thread Konstantin Chernyakov
Hi. We are faced with strange problem where Cassandra nodes lose each other only one day of week, on friday, in exactly 14:50 PM, within several months. On that time each node periodically reports that other nodes are dead. At same time nodes are working fine. This continues about one hour, aft

Re: Strange problem with cassandra

2011-12-05 Thread Riyad Kalla
Konstantin, Have you checked the weekly cron job list on the servers or looked at the system logs at those rough times to see what the servers are doing? I doubt Cassandra has any time-sensitive code in it to kill off connections at 14:50pm, so my guess is something on the host causing the problem

Re: Ruby, CQL and client libraries

2011-12-05 Thread hani elabed
Hi Matt, This is definitely not at all an authoritative opinion... I am still figuring things out with Cassandra... Others may want to correct me... Charles Maxwood(sp?) started a 'Sandra' project on github to make access to Cassandra, more or less, similar to Active Record... it is very early sta

Re: Ruby, CQL and client libraries

2011-12-05 Thread Robert Jackson
From: "Matthew Stump" To: user@cassandra.apache.org Sent: Monday, December 5, 2011 2:59:34 AM Subject: Ruby, CQL and client libraries Howdy, I'm working on transferring an existing Ruby on Rails project from Postgres to Cassandra and I have a couple questions about the Ruby client librar

node.js library?

2011-12-05 Thread Joe Stein
Hey folks, so I have been noodling on using node.js as a new front end for the system I built for doing real time aggregate metrics within our distributed systems. Does anyone have experience or background story on this lib? http://code.google.com/a/apache-extras.org/p/cassandra-node/ it seems to

Re: node.js library?

2011-12-05 Thread Norman Maurer
As far as I know its the library that was developed by "rackspace". See https://github.com/racker/node-cassandra-client As rackspace is using node.js + cassandra I would expect it works ;) Bye, Norman 2011/12/5 Joe Stein > Hey folks, so I have been noodling on using node.js as a new front

Modeling Bi-temporal data in Cassandra

2011-12-05 Thread Vigo, Jornei A
Hello, We currently have data stored in a bi-temporal fashion using a DBRMS. I've been trying to find recommendations on how to model bi-temporal using a NoSQL database such as Cassandra but without much success. Does anybody in the list have had success in doing such thing in Cassandra

Re: node.js library?

2011-12-05 Thread samal
On Mon, Dec 5, 2011 at 7:59 PM, Norman Maurer wrote: > As far as I know its the library that was developed by "rackspace". > > See > https://github.com/racker/node-cassandra-client > *No longer maintained. it is moved as separate project in apache-extras * 2011/12/5 Joe Stein > Hey folks, so

Setting Key Validation Class

2011-12-05 Thread Dinusha Dilrukshi
Hi, I am using apache-cassandra-1.0.0 and I tried to insert/retrieve data in a column family using cassandra-jdbc program. Here is how I created 'USER' column family using cassandra-cli. create column family USER with comparator=UTF8Type and column_metadata=[{column_name: user_id, validation_clas

Re: Strange problem with cassandra

2011-12-05 Thread Konstantin Chernyakov
Thank you for reply. Yes, we have checked windows event logs and task scheduler, but haven't seen anything special. In addition, We have deployed one more cluster on same machines without any data and problem haven't reproduced on same time. It's very strange. On Mon, Dec 5, 2011 at 7:45 PM, Riya

Increase replication factor

2011-12-05 Thread A J
If I update a keyspace to increase the replication factor; what happens to existing data for that keyspace ? Does the existing data get automatically increase its replication ? Or only on a RR or node repair does the existing data increase its replication factor ? Thanks.

Re: Setting Key Validation Class

2011-12-05 Thread Filipe Gonçalves
Cassandra's data model is NOT table based. The key is not a column, it is a separate value. "index_type: KEYS" means you are creating an index on that column, and that index can only be acessed in an equality query ( column = x ). You should probably read http://www.datastax.com/docs/1.0/ddl/inde

Re: Setting Key Validation Class

2011-12-05 Thread samal
key_validation_class is different from validation_class validation are BytesType by default. key_valdation_class => key default_validation_class=>column_values comparator=>column_name default_validation_class is global scope of validation_class On Mon, Dec 5, 2011 at 10:10 PM, Dinusha Dilrukshi

Re: Ruby, CQL and client libraries

2011-12-05 Thread Matthew Stump
Ah yes, I should clarify. What I should have said was an ORM type library which uses cassandra-cql as it's base. What I was looking for was someone that had wrapped cassandra-cql with an active record or data mapper compatibility layer. My concern is that it i'm looking for a ruby client th

Re: Increase replication factor

2011-12-05 Thread Alain RODRIGUEZ
http://www.datastax.com/docs/1.0/operations/cluster_management#changing-the-replication-factor It looks like a nodetool repair is needed after increasing your RF. I guess that a cleanup has to be performed after decreasing the RF to remove useless replica. Alain 2011/12/5 A J > If I update a k

Re: Setting Key Validation Class

2011-12-05 Thread Dinusha Dilrukshi
Hi Filipe/ Samal, Thanks for clarifications. Regards, ~Dinusha~ On Mon, Dec 5, 2011 at 10:28 PM, samal wrote: > key_validation_class is different from validation_class > validation are BytesType by default. > > key_valdation_class => key > default_validation_class=>column_values > comparator

Re: [RELEASE] Apache Cassandra 1.0.5 released

2011-12-05 Thread Zhong Li
You may run "stress -d " to create Standard1 CF and data. On Dec 3, 2011, at 3:44 PM, wrote: > Hi Zhong Li, > > When I used stress tool to test, I got: > > Operation [15] retried 10 times - error inserting key 0015 > ((InvalidRequestException): unconfigured columnfamily Standard1) > > Op

CQL Install for 0.8.X?

2011-12-05 Thread Joe Stein
Hey, trying to grab cqlsh for a 0.8.6 cluster but all the online docs I am finding are pointing to http://www.apache.org/dist/cassandra/drivers/py or say it moved to the source and checked there in the 0.8 branch and nothing either... also saw something about about 2.0 not being compatible with 0.8

best practices for simulating transactions in Cassandra

2011-12-05 Thread John Laban
Hello, I'm building a system using Cassandra as a datastore and I have a few places where I am need of transactions. I'm using ZooKeeper to provide locking when I'm in need of some concurrency control or isolation, so that solves that half of the puzzle. What I need now is to sometimes be able t

Pig Output

2011-12-05 Thread Aaron Griffith
Using PigStorage() my pig script output gets put into partial files on the hadoop file system. When I use the copyToLocal fuction from Hadoop it creates a local directory with all the partial files. Is there a way to copy the partial files from hadoop into a single local file? Thanks

Re: Repair failure under 0.8.6

2011-12-05 Thread Maxim Potekhin
Basically I tweaked the phi, put in more verbose GC reporting and decided to do a compaction before I proceed. I'm getting this on the node where compaction is being run. And the system log for the other two nodes follows. It's obvious that the cluster is sick, but I can't determine why -- ther

Re: Pig Output

2011-12-05 Thread Aaron Griffith
i think getmerge will work.

Re: Ruby, CQL and client libraries

2011-12-05 Thread Aaron Turner
On Sun, Dec 4, 2011 at 11:59 PM, Matthew Stump wrote: > > 3.) Other than the fauna/twitter client what are other people using for Ruby? I'm probably the only person using JRuby + Hector. This ended up being a big win since to get high performance with Cassandra you either need many clients or a

Could not reach schema agreement... 0.8.6

2011-12-05 Thread Maxim Potekhin
Hello, upon startup, in my cluster of 3 machines, I see similar messages in system.log on each node (below). I start nodes one by one, after I ascertain the previous one is online. So they can't reach schema agreement, all of them. Why? No unusual load visible in Ganglia plots. ERROR [Hinted

Re: CQL Install for 0.8.X?

2011-12-05 Thread Eric Evans
On Mon, Dec 5, 2011 at 1:40 PM, Joe Stein wrote: > Hey, trying to grab cqlsh for a 0.8.6 cluster but all the online docs I am > finding are pointing to http://www.apache.org/dist/cassandra/drivers/py or > say it moved to the source and checked there in the 0.8 branch and nothing > either... Right