Re: Why so many SSTables?

2012-04-12 Thread Romain HARDOUIN
I've just opened a new JIRA: CASSANDRA-4142 I've double checked numbers, 7747 seems to be array list object's capacity (Eclipse Memory Analyzer displays "java.lang.Object[7747] @ 0x7d3f3f798"). Actually there are 5757 browsable entries in EMA therefore each object is about 140 KB (size varies be

super column

2012-04-12 Thread puneet loya
Can a super column contain a super column? I mean is nesting of supercolumns possible? Regards, Puneet :)

Re: super column

2012-04-12 Thread Paolo Bernardi
No. Maybe that a super column can contain composite columns but I'm not sure. Paolo On Apr 12, 2012 12:15 PM, "puneet loya" wrote: > Can a super column contain a super column? > > I mean is nesting of supercolumns possible? > > Regards, > > Puneet :) >

Re: super column

2012-04-12 Thread puneet loya
what is composite columns? super column under it can contain just multiple columns.. will composite columns be useful? On Thu, Apr 12, 2012 at 3:50 PM, Paolo Bernardi wrote: > No. > Maybe that a super column can contain composite columns but I'm not sure. > > Paolo > On Apr 12, 2012 12:15 PM, "

Re: super column

2012-04-12 Thread Maki Watanabe
http://www.datastax.com/dev/blog/introduction-to-composite-columns-part-1 hope this help. maki 2012/4/12 puneet loya : > what is composite columns? > > super column under it can contain just multiple columns.. will composite > columns be useful? > > > On Thu, Apr 12, 2012 at 3:50 PM, Paolo Bernar

Re: Repair Process Taking too long

2012-04-12 Thread Frank Ng
I also noticed that if I use the -pr option, the repair process went down from 30 hours to 9 hours. Is the -pr option safe to use if I want to run repair processes in parallel on nodes that are not replication peers? thanks On Thu, Apr 12, 2012 at 12:06 AM, Frank Ng wrote: > Thank you for conf

Re: Cassandra running out of memory?

2012-04-12 Thread Vasileios Vlachos
Hello Aaron, Thank you for getting back to me. I will change to m1.large first to see how long it will take Cassandra node to die (if at all). If again not happy I will try more memory. I just want to test it step by step and see what the differences are. I will also change the cassandra-env file

Re: Repair Process Taking too long

2012-04-12 Thread Sylvain Lebresne
On Thu, Apr 12, 2012 at 4:06 PM, Frank Ng wrote: > I also noticed that if I use the -pr option, the repair process went down > from 30 hours to 9 hours.  Is the -pr option safe to use if I want to run > repair processes in parallel on nodes that are not replication peers? There is pretty much two

Re: solr query for string match in CQL

2012-04-12 Thread A J
Never mind. Double quotes within the single quotes worked: select * from solr where solr_query='body:"sixty eight million nine hundred forty three thousand four hundred twenty four"'; On Thu, Apr 12, 2012 at 11:42 AM, A J wrote: > What is the syntax for a string match in CQL for solr_query ? > >

Off-heap row cache and mmapped sstables

2012-04-12 Thread Omid Aladini
Hi, Cassandra issues an mlockall [1] before mmap-ing sstables to prevent the kernel from paging out heap space in favor of memory-mapped sstables. I was wondering, what happens to the off-heap row cache (saved or unsaved)? Is it possible that the kernel pages out off-heap row cache in favor of res

Trying to avoid super columns

2012-04-12 Thread Philip Shon
I am currently working on a data model where the purpose is to look up multiple products for given days of the year. Right now, that model involves the usage of a super column family. e.g. "2012-04-12": { "product_id_1": { price: 12.44, tax: 1.00, fees: 3.00, }, "product_id_2":

Re: Trying to avoid super columns

2012-04-12 Thread Dave Brosius
If you want to reduce the number of columns, you could pack all the data for a product into one column, as in composite column name-> product_id_1:12.44:1.00:3.00 On 04/12/2012 03:03 PM, Philip Shon wrote: I am currently working on a data model where the purpose is to look up multiple produ

Re: Repair Process Taking too long

2012-04-12 Thread Frank Ng
Thanks for the clarification. I'm running repairs as in case 2 (to avoid deleted data coming back). On Thu, Apr 12, 2012 at 10:59 AM, Sylvain Lebresne wrote: > On Thu, Apr 12, 2012 at 4:06 PM, Frank Ng wrote: > > I also noticed that if I use the -pr option, the repair process went down > > from

Re: Why so many SSTables?

2012-04-12 Thread Thorsten von Eicken
>From my experience I would strongly advise against leveled compaction for your use-case. But you should certainly test and see for yourself! I have ~1TB on a node with ~13GB of heap. I ended up with 30k SSTables. I raised the SSTable size to 100MB but that didn't prove to be sufficient and I did i

RMI/JMX errors, weird

2012-04-12 Thread Maxim Potekhin
Hello, I'm doing compactions under 0.8.8. Recently, I started seeing a stack trace like one below, and I can't figure out what causes this to appear. The cluster has been in operation for mode than half a year w/o errors like this one. Any help will be appreciated, Thanks Maxim WARNING: F

Re: Cassandra running out of memory?

2012-04-12 Thread aaron morton
It depends on a lot of things: schema size, caches, work load etc. If your are just starting out I would recommend using a machine with 8gb or 16gb total ram. By default cassandra will take about 4gb or 8gb (respectively) for the JVM. Once you have a feel for how things work you should be able

Re: Trying to avoid super columns

2012-04-12 Thread aaron morton
If this is write once read many data you may get some benefit from packing all the info for a product into one column, using something like JSON for the column value. >> The one thing that stands out to me with this approach is the number of >> additonal columns that will be created for a sing

Re: RMI/JMX errors, weird

2012-04-12 Thread aaron morton
Look at the server side logs for errors. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 13/04/2012, at 11:47 AM, Maxim Potekhin wrote: > Hello, > > I'm doing compactions under 0.8.8. > > Recently, I started seeing a stack trace like one

insert data in cassandra from .net..

2012-04-12 Thread puneet loya
I m able to connect cassandra and fetch rows from the cassandra database. Now i want to insert the data from .net on to cassandra but using insert query of cql is not working because i have fields in my table which has null values for the columns and cassandra would not take null values. So now