Re: live ratio counting

2012-05-15 Thread Radim Kolar
Try reducing memtable_total_space_in_mb config setting. If the problem is incorrect memory metering that should help. it does not helps much because difference in correct and cassandra assumed calculation is way too high. It would require me to shrink memtables to about 10% of their correct si

Re: live ratio counting

2012-05-15 Thread Radim Kolar
here is part of log. actually record is 419. ponto:(admin)log/cassandra>grep "to maximum of 64" system.log.1 WARN [MemoryMeter:1] 2012-02-03 00:00:19,444 Memtable.java (line 181) setting live ratio to maximum of 64 instead of 64.9096047648211 WARN [MemoryMeter:1] 2012-02-08 00:00:17,379 Memtabl

Re: How can I implement 'LIKE operation in SQL' on values while querying a column family in Cassandra

2012-05-15 Thread Abhijit Chanda
Tamar, Can you please illustrate little bit with some sample code. It highly appreciable. Thanks, On Tue, May 15, 2012 at 10:48 AM, Tamar Fraenkel wrote: > I don't think this is possible, the best you can do is prefix, if your > order is alphabetical. For example I have a CF with comparator UTF

Re: How can I implement 'LIKE operation in SQL' on values while querying a column family in Cassandra

2012-05-15 Thread selam
Mapreduce jobs may solve your problem for batch processing On Tue, May 15, 2012 at 12:49 PM, Abhijit Chanda wrote: > Tamar, > > Can you please illustrate little bit with some sample code. It highly > appreciable. > > Thanks, > > > On Tue, May 15, 2012 at 10:48 AM, Tamar Fraenkel wrote: > >> I do

Re: How can I implement 'LIKE operation in SQL' on values while querying a column family in Cassandra

2012-05-15 Thread samal
You cannot extract via relative column value. It can only extract via value if it has secondary index but exact column value need to match. as tamar suggested you can put value as column "name" , UTF8 comparator. { 'name_abhijit'=>'abhijit' 'name_abhishek'=>'abhiskek' 'name_atul'=>'atul' } here

Re: Composite Column

2012-05-15 Thread samal
I have not used CC but yes you can. Below is not composite column. It is not not column with JSON hash value. Column value can be anything you like. date inside value are not indexed. On Tue, May 15, 2012 at 9:27 AM, Abhijit Chanda wrote: > Is it possible to create this data model with the help o

Re: Composite Column

2012-05-15 Thread samal
It is just column with JSON value On Tue, May 15, 2012 at 4:00 PM, samal wrote: > I have not used CC but yes you can. > Below is not composite column. It is not not column with JSON hash value. > Column value can be anything you like. > date inside value are not indexed. > > > On Tue, May 15, 20

Re: How can I implement 'LIKE operation in SQL' on values while querying a column family in Cassandra

2012-05-15 Thread Tamar Fraenkel
Do you still need the sample code? I use Hector, well here is an example: *This is the Column Family definition:* (I have a composite, but if you like you can have only the UTF8Type). CREATE COLUMN FAMILY title_indx with comparator = 'CompositeType(UTF8Type,UUIDType)' and default_validatio

Re: How can I implement 'LIKE operation in SQL' on values while querying a column family in Cassandra

2012-05-15 Thread Abhijit Chanda
Thanks so much Guys, specially Tamar, thank you so much man. Regards, Abhijit On Tue, May 15, 2012 at 4:26 PM, Tamar Fraenkel wrote: > Do you still need the sample code? I use Hector, well here is an example: > *This is the Column Family definition:* > (I have a composite, but if you like you c

Couldn't find cfId

2012-05-15 Thread Daning Wang
We got exception "UnserializableColumnFamilyException: Couldn't find cfId=1075" in the log of one node, describe cluster showed all the nodes in same schema version. how to fix this problem? did repair but looks does not work, haven't try scrub yet. We are on v1.0.3 ERROR [HintedHandoff:1631] 201

Re: How do I add a custom comparator class to a cassandra cluster ?

2012-05-15 Thread Mohit Anchlia
I agree with Brandon. We only use it for enhancing authz and authn modules to use LDAP that C* currently doesn't provide. On Mon, May 14, 2012 at 11:08 PM, Brandon Williams wrote: > On Tue, May 15, 2012 at 12:53 AM, Ertio Lew wrote: > > @Brandon : I just created a jira issue to request this typ

Re: How can I implement 'LIKE operation in SQL' on values while querying a column family in Cassandra

2012-05-15 Thread Tamar Fraenkel
Actually woman ;-) *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, May 15, 2012 at 3:45 PM, Abhijit Chanda wrote: > Thanks so much Guys, specially Tamar, thank you so

Tuning cassandra (compactions overall)

2012-05-15 Thread Alain RODRIGUEZ
Hi, I'm using a 2 node cluster in production ( 2 EC2 c1.medium, CL.ONE, RF = 2, using RP) 1 - I got this kind of message quite often (let's say every 30 seconds) : WARN [ScheduledTasks:1] 2012-05-15 15:44:53,083 GCInspector.java (line 145) Heap is 0.8081418550931491 full. You may need to reduce

cassandra upgrade to 1.1 - migration problem

2012-05-15 Thread Casey Deccio
I recently upgraded from cassandra 1.0.10 to 1.1. Everything worked fine in one environment, but after I upgraded in another, I can't find my keyspace. When I run, e.g., cassandra-cli with 'use KeySpace;' It tells me that the keyspace doesn't exist. In the log I see this: ERROR [MigrationStage:

Re: cassandra upgrade to 1.1 - migration problem

2012-05-15 Thread Casey Deccio
Here's something new in the logs: ERROR 12:21:09,418 Exception in thread Thread[SSTableBatchOpen:2,5,main] java.lang.RuntimeException: Cannot open /var/lib/cassandra/data/system/Versions/system-Versions-hc-35 because partitioner does not match org.apache.cassandra.dht.ByteOrderedPartitioner

"no snappyjava in java.library.path" (JDK 1.7 issue?)

2012-05-15 Thread Stephen McKamey
I'm getting a org.xerial.snappy.SnappyError when creating my first column family after blowing away my Cassandra installation and trying to run the latest release. I'm undoubtably making some silly mistake but cannot seem to find it. I even commented out my "sstable_compression=SnappyCompressor" se

Re: cassandra upgrade to 1.1 - migration problem

2012-05-15 Thread Oleg Dulin
Did you check cassandra.yaml to make sure partitioner there matches what was in your old cluster ? Regards, Oleg Dulin Please note my new office #: 732-917-0159 On May 15, 2012, at 3:22 PM, Casey Deccio wrote: > Here's something new in the logs: > > ERROR 12:21:09,418 Exception in thread Threa

Re: cassandra upgrade to 1.1 - migration problem

2012-05-15 Thread Casey Deccio
cassandra.yaml on all nodes had ByteOrderedPartitioner with both the previous version and upgraded version. That being said, when I first started up cassandra after upgrading (with the updated .yaml, including ByteOrderedPartitioner) all nodes in the ring appeared to be up. But the load they car

Re: "no snappyjava in java.library.path" (JDK 1.7 issue?)

2012-05-15 Thread Stephen McKamey
Reverting to JDK 1.6 appears to fix the issue. Is JDK 1.7 not yet supported by Cassandra? java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04-415-11M3635) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01-415, mixed mode) On Tue, May 15, 2012 at 12:55 PM, Stephen McKamey

Snapshot failing on JSON files in 1.1.0

2012-05-15 Thread Bryan Fernandez
Greetings, We recently upgraded from 1.0.8 to 1.1.0. Everything has been running fine with the exception of snapshots. When attempting to snapshot any of the nodes in our six node cluster we are seeing the following error. [root@cassandra-n6 blotter]# /opt/apache-cassandra-1.1.0/bin/nodetool -h 1

Re: need some clarification on recommended memory size

2012-05-15 Thread Tyler Hobbs
On Tue, May 15, 2012 at 3:19 PM, Yiming Sun wrote: > Hello, > > I was reading the Apache Cassandra 1.0 Documentation PDF dated May 10, > 2012, and had some questions on what the recommended memory size is. > > Below is the snippet from the PDF. Bullet 1 suggests to have 16-32GB of > RAM, yet Bul

Re: Snapshot failing on JSON files in 1.1.0

2012-05-15 Thread Brandon Williams
Probably https://issues.apache.org/jira/browse/CASSANDRA-4230 On Tue, May 15, 2012 at 4:08 PM, Bryan Fernandez wrote: > Greetings, > > We recently upgraded from 1.0.8 to 1.1.0. Everything has been running fine > with the exception of snapshots. When attempting to snapshot any of the > nodes in ou

Re: cassandra upgrade to 1.1 - migration problem

2012-05-15 Thread Casey Deccio
Sorry to reply to my own message (again). I took a closer look at the logs and realized that the partitioner errors aren't what kept the daemon to stop; those errors are in the logs even before I upgraded. This one seems to be the culprit. java.lang.reflect.InvocationTargetException at s

Re: need some clarification on recommended memory size

2012-05-15 Thread Yiming Sun
Thanks Tyler... so my understanding is, even if Cassandra doesn't do off-heap caching, by having a large-enough memory, it minimize the chance of swapping the java heap to a disk. Is that correct? -- Y. On Tue, May 15, 2012 at 6:26 PM, Tyler Hobbs wrote: > On Tue, May 15, 2012 at 3:19 PM, Yimi

Re: "no snappyjava in java.library.path" (JDK 1.7 issue?)

2012-05-15 Thread Roshni Rajagopal
Hi Stephen, Cassandra's wiki says Cassandra requires the most stable version of Java 1.6 you can deploy. http://wiki.apache.org/cassandra/GettingStarted Regards, Roshni From: Stephen McKamey mailto:step...@mckamey.com>> Reply-To: "user@cassandra.apache.org"

Re: cassandra upgrade to 1.1 - migration problem

2012-05-15 Thread Dave Brosius
The replication factor for a keyspace is stored in the system.schema_keyspaces column family. Since you can't view this with cli as the server won't start, the only way to look at it, that i know of is to use the sstable2json tool on the *.db file for that column family... So for instance on

Is nodetool upgradesstables a necessary step for upgrading from 0.8 to 1.0.

2012-05-15 Thread Boris Yen
Hi, Our cluster is currently running on 0.8.10, we plan on upgrading it to 1.0.x. We read the document from the datastax website, the final step is to use nodetool upgradesstables. Since this command might take time to finish, I wonder if this step could be skip? if I do not upgrade the sstables w

how do remove default_validation_class using cassandra-cli?

2012-05-15 Thread Yuhan Zhang
Hi all, Is there a way to remove default_validation_class after assigned it to a column family? I'd like to have a column family storing both string and long. looks like it throws error at me for "String didn't validate". Thank you. Yuhan

Using EC2 ephemeral 4disk raid0 cause high iowait trouble

2012-05-15 Thread koji Lin
Hi Our service already run cassandra 1.0 on 1x ec2 instances(with ebs), and we saw lots of discussion talk about using ephemeral raid for better performance and consistent performance. So we want to create new instance using 4 ephemeral raid0, and copy the data from ebs to finally replace the ol

Re: how do remove default_validation_class using cassandra-cli?

2012-05-15 Thread Yuhan Zhang
to answer my own question: set default_validation_class = BytesType; On Tue, May 15, 2012 at 7:09 PM, Yuhan Zhang wrote: > Hi all, > > Is there a way to remove default_validation_class after assigned it to a > column family? > > I'd like to have a column family storing both string and long. look

Re: How can I implement 'LIKE operation in SQL' on values while querying a column family in Cassandra

2012-05-15 Thread Abhijit Chanda
Sorry for the confusion Tamar. Any ways thanks dear. Regards, Abhijit On Tue, May 15, 2012 at 9:36 PM, Tamar Fraenkel wrote: > Actually woman ;-) > > *Tamar Fraenkel * > Senior Software Engineer, TOK Media > > [image: Inline image 1] > > ta...@tok-media.com > Tel: +972 2 6409736 > Mob: +972

Re: cassandra upgrade to 1.1 - migration problem

2012-05-15 Thread Casey Deccio
On Tue, May 15, 2012 at 5:41 PM, Dave Brosius wrote: > The replication factor for a keyspace is stored in the > system.schema_keyspaces column family. > > Since you can't view this with cli as the server won't start, the only way > to look at it, that i know of is to use the > > sstable2json tool