Re: Cassandra memory usage

2012-01-03 Thread Narendra Sharma
See http://wiki.apache.org/cassandra/FAQ#mmap Also, the discussion on http://comments.gmane.org/gmane.comp.db.cassandra.user/14080 Hopefully these will answer your question. -Naren On Tue, Jan 3, 2012 at 12:53 PM, Daning Wang wrote: > I have Cassandra server which has JVM setting -Xms4G -Xmx4

Re: Replacing supercolumns with composite columns; Getting the equivalent of retrieving a list of supercolumns by name

2012-01-03 Thread Asil Klin
@Stephan: in that case, you can easily tell the names of all columns you want to retrieve, so you can make a query to retrieve those list of composite columns. @Jeremiah, So where is my best bet ? Should I leave the supercolumns as it is as of now, since I can find a good way to use them incase I

Re: Strange OOM when doing "list" in CLI

2012-01-03 Thread Edward Capriolo
What you are probably running into is that list from the cli can bring all the columns of a key into memory. I have counters using composite keys and about 1k columns causes this to happen. We should have some paging support with list. On Tuesday, January 3, 2012, Maxim Potekhin wrote: > I came b

Strange OOM when doing "list" in CLI

2012-01-03 Thread Maxim Potekhin
I came back from Xmas vacation only to see that what always was an innocuous procedure in CLI now reliably results in OOM -- does anyone have ideas why? It never happened before. Version of Cassandra is 0.8.8. 2956 java -ea -javaagent:/home/cassandra/cassandra/bin/../lib/jamm-0.2.2.jar -XX:+

Re: Cassandra WebUI with Sources released

2012-01-03 Thread Maxim Potekhin
Congrats on what seems to be a nice piece of work, need to check it out. Nicely complements other tools. Maxim On 1/2/2012 12:48 PM, Markus Wiesenbacher | Codefreun.de wrote: Hi, I wish you all a happy and healthy new year! As you may remember, I coded a little GUI for Apache Cassandra. Now

TimedOutException()

2012-01-03 Thread Daning Wang
Hi All, We are getting TimedOutException() when inserting data into Cassandra, it was working fine for a few months, but suddenly got this problem. I have increase rpc_timout_in_ms to 3, but it still timed out in 30 secs. I turned on debug, I saw many of this error in the log DEBUG [pool-2-t

Re: rename column family

2012-01-03 Thread Jim Newsham
Thanks that's very helpful. I'm assuming there's no requirement to stop or restart Cassandra? Thanks, Jim On 1/2/2012 12:07 AM, aaron morton wrote: Renaming a CF is not directly supported. You can: 1) Add the new CF using the CLI or CQL 2) On each node copy the SSTable files and use the ne

RE: Replacing supercolumns with composite columns; Getting the equivalent of retrieving a list of supercolumns by name

2012-01-03 Thread Stephen Pope
The bonus you're talking about here, how do I apply that? For example, my columns are in the form of number.id such as 4.steve, 4.greg, 5.steve, 5.george. Is there a way to query a slice of numbers with a list of ids? As in, I want all the columns with numbers between 4 and 10 which have ids

Cassandra memory usage

2012-01-03 Thread Daning Wang
I have Cassandra server which has JVM setting -Xms4G -Xmx4G, but why top reports 15G RES memory and 11G SHR memory usage? I understand that -Xmx4G is only for the heap size. but it is strange that OS reports 2.5 times memory usage. Are there a lot of memory used by JNI? Please help to explain this.

Re: Consistency Level

2012-01-03 Thread Kamal Bahadur
Hi Peter, To test, I wiped out all the data from Cassandra and inserted just one record. The row key is "7a7a32323636373030303438303031". I used getendpoints to see where my data is and double checked the same using sstable2json command. Since the RF is 2, the data is currently on Node 1 and Node

Re: Dealing with "Corrupt (negative) value length encountered"

2012-01-03 Thread Philippe
I was able to scrub the node the repair that failed was running on. Are you saying the error could be displayed on that node but the bad data coming from another node ? Log inspection also showed many of these, they seem to happen around when a stream transfer finishes. ERROR [Thread-550876] 2012-

Re: Replacing supercolumns with composite columns; Getting the equivalent of retrieving a list of supercolumns by name

2012-01-03 Thread Jeremiah Jordan
The main issue with replacing super columns with composite columns right now is that if you don't know all your sub-column names you can't select multiple "super columns" worth of data in the same query without getting extra stuff. You have to use a slice to get all subcolumns of a given super

Replacing supercolumns with composite columns; Getting the equivalent of retrieving a list of supercolumns by name

2012-01-03 Thread Asil Klin
I have a super columns family which I always use to retrieve a list of supercolumns(with all subcolumns) by name. I am looking forward to replace all SuperColumns in my schema with the composite columns. How could I design schema so that I could do the equivalent of retrieving a list of supercolum

Re: emptying my cluster

2012-01-03 Thread aaron morton
Running a time based rolling window of data can be done using the TTL. Backing up the nodes for disaster recover can be done using snapshots. Restoring any point in time will be tricky because to may restore columns where the TTL has expired. > Will I get a single copy of the data in the remot

Re: Cassandra OOM

2012-01-03 Thread aaron morton
The DynamicSnitch can result in less read operations been sent to a node, but as long as a node is marked as UP mutations are sent to all replicas. Nodes will shed load when they pull messages off the queue that have expired past rpc_timeout, but they will not feed back flow control to the other

Re: cassandra site wsod's /mysql site functions

2012-01-03 Thread Tim Dunphy
Awesome! Thank you Sasha, I will give that a try! It may be a day or two before I can get to this again, but I will definitely let you know how it goes. Thanks, Tim Sent from my iPhone On Jan 3, 2012, at 8:23 AM, Sasha Dolgy wrote: > Have you looked at PHPCassa [ https://github.com/thobbs/ph

Re: cassandra site wsod's /mysql site functions

2012-01-03 Thread Sasha Dolgy
Have you looked at PHPCassa [ https://github.com/thobbs/phpcassa ] instead of using Thrift direct? I've had no issues with getting it to work with versions 0.7.x, 0.8.x and now 1.x ... it adds better error handling and overall, is fairly easy to get going. Some information to get you running: ht

Re: cassandra site wsod's /mysql site functions

2012-01-03 Thread Tim Dunphy
unfortunately not .. :( thanks for checking. still looking for advice on this! tx On Tue, Jan 3, 2012 at 3:47 AM, aaron morton wrote: > Tim, > Did you get this sorted out ? > > Cheers > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 2

Re: emptying my cluster

2012-01-03 Thread Alexandru Sicoe
Hi, I need to build a system that stores data for years, so yes, I am backing up data in another mass storage system from where it could be later accessed. The data that I successfully back up has to be deleted from my cluster to make space for new data coming in. I was aware about the snapshotti

Cassandra OOM

2012-01-03 Thread Віталій Тимчишин
Hello. We are using cassandra for some time in our project. Currently we are on 1.1 trunk (it was accidental migration, but since it's hard to migrate back and it's performing nice enough we are currently on 1.1). During New Year holidays one of the servers've produces a number of OOM messages in

Re: Accessing expired data

2012-01-03 Thread Thibaut Britz
Thanks Sylvain! That's exactly what I needed to know. On Mon, Jan 2, 2012 at 12:49 PM, Sylvain Lebresne wrote: > On Mon, Jan 2, 2012 at 11:51 AM, Thibaut Britz > wrote: > > Hi, > > > > due to a misconfiguration on our site, some parts of our data got saved > with > > a wrong expiration date,

Re: cassandra site wsod's /mysql site functions

2012-01-03 Thread aaron morton
Tim, Did you get this sorted out ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 28/12/2011, at 3:11 PM, Tim Dunphy wrote: > hello, > > I am new to the world of non-relational databases. Cassandra is > refreshingly easy to se

Re: emptying my cluster

2012-01-03 Thread aaron morton
That sounds a little complicated. Do you want to get the data out for an off node backup or is it for processing in another system ? You may get by using: * TTL to expire data via compaction * snapshots for backups Cheers - Aaron Morton Freelance Developer @aaronmorton http: