Cassandra 0.8 Counters Inverted Index?

2011-09-30 Thread Mike Peters
Hi, We're using Cassandra 0.8 counters in production and loving it! One issue we're running into is we need an efficient mechanism to retrieve the "top 100" results, sorted by count values. We have tens of thousands of counters growing rapidly (one counter per each combination of date.source

Re: assertion error on Hinted hand off

2011-09-30 Thread Jonathan Ellis
Sounds like this bug to me: https://issues.apache.org/jira/browse/CASSANDRA-3291 On Fri, Sep 30, 2011 at 8:18 PM, Yang wrote: > at start up, I see these errors in system.log, after all the commitlog > has been replayed. > > > > >  INFO [HintedHandoff:1] 2011-10-01 01:14:58,127 > HintedHandOffMana

assertion error on Hinted hand off

2011-09-30 Thread Yang
at start up, I see these errors in system.log, after all the commitlog has been replayed. INFO [HintedHandoff:1] 2011-10-01 01:14:58,127 HintedHandOffManager.java (line 259) Started hinted handoff for token: 801411834 60469231731687303715884105728 with IP: /10.71.21.46 ERROR [HintedHandoff:1]

Re: [RELEASE CANDIDATE] Apache Cassandra 1.0.0-rc1 released

2011-09-30 Thread Jonathan Ellis
Thanks for testing this, Radim. We have a fix posted now to https://issues.apache.org/jira/browse/CASSANDRA-3288. On Fri, Sep 30, 2011 at 3:30 PM, Radim Kolar wrote: > also some exceptions on cassandra side: > > Caused by: java.lang.IllegalArgumentException: value already present: 0 >        at

Re: [RELEASE CANDIDATE] Apache Cassandra 1.0.0-rc1 released

2011-09-30 Thread Radim Kolar
bad news. using old hector breaks cassandra and it no longer boots. ERROR [main] 2011-09-30 22:31:43,914 AbstractCassandraDaemon.java (line 354) Exc eption encountered during startup java.lang.IllegalArgumentException: value already present: 0 at com.google.common.base.Preconditions.ch

Re: [RELEASE CANDIDATE] Apache Cassandra 1.0.0-rc1 released

2011-09-30 Thread Radim Kolar
also some exceptions on cassandra side: Caused by: java.lang.IllegalArgumentException: value already present: 0 at com.google.common.base.Preconditions.checkArgument(Preconditions.java :115) at com.google.common.collect.AbstractBiMap.putInBothMaps(AbstractBiMap.j ava:111)

Cassandra annotation

2011-09-30 Thread Peter Lin
I know this topic has come up in the past. I'm currently working on a set of Cassandra specific annotations that define key, keyspace and column in my POJO's. Instead of hand rolling lots of boiler plate code for creating the keyspace, I prefer to annotate my POJO's and have the system do that for

Re: [RELEASE CANDIDATE] Apache Cassandra 1.0.0-rc1 released

2011-09-30 Thread Radim Kolar
Caught: me.prettyprint.hector.api.exceptions.HCassandraInternalException: Cassan dra encountered an internal error processing this request: TApplicationError typ e: 6 message:Internal error processing system_add_column_family me.prettyprint.hector.api.exceptions.HCassandraInternalException: Cas

Re: release mmap memory through jconsole?

2011-09-30 Thread Yang
my young-gen pauses are fine, they are generally below 0.1 seconds, for my application that's fine for me :) (I do see pauses of other nature, much longer (20seconds), some due to GC (full GC), which I'm still investigating) 2011/9/30 Jonathan Ellis : > I think we found why you're seeing lots of

Re: release mmap memory through jconsole?

2011-09-30 Thread Jonathan Ellis
I think we found why you're seeing lots of young gen-based GC pauses... :) 2011/9/30 Yang : > why? > > I thought bigger young gen would allow more objects to die (become > non-reachable) before minor collection, so the minor collection cost > is low. particularly it would allow you to merge more

Re: release mmap memory through jconsole?

2011-09-30 Thread Yang
why? I thought bigger young gen would allow more objects to die (become non-reachable) before minor collection, so the minor collection cost is low. particularly it would allow you to merge more updates and not consume memory (since old objects are released on GC) bigger old gen would allow you

Re: release mmap memory through jconsole?

2011-09-30 Thread Yi Yang
Is it? Heard that twitter uses 60G, if I have remembered correctly. --Original Message-- From: Norman Maurer To: user@cassandra.apache.org To: i...@iyyang.com Subject: Re: release mmap memory through jconsole? Sent: Oct 1, 2011 12:55 AM I would also not use such a big heap. I think most p

Re: Performance degradation observed through embedded cassandra server - pointers needed

2011-09-30 Thread Roshan Dawrani
Hi, For our Grails + Cassandra application's clean-DB-for-every-test needs, we finally went back from using costly "truncate" calls to "range-scans-and-delete" approach, and found such a great different between the performance of the two approaches, that wrote a small blog post here about it: "Gra

Re: release mmap memory through jconsole?

2011-09-30 Thread Norman Maurer
I would also not use such a big heap. I think most people will tell you that 12G -16G is max to use. Bye, Norman 2011/9/30 Yi Yang : > It is meaningless to release such memory. The counting includes the data you > reached in the SSTable. Those data locates on your hard drive. So it is not > the

Re: release mmap memory through jconsole?

2011-09-30 Thread Yi Yang
It is meaningless to release such memory. The counting includes the data you reached in the SSTable. Those data locates on your hard drive. So it is not the RAM spaces you have actually used. -Y. --Original Message-- From: Yang To: user@cassandra.apache.org ReplyTo: user@cassandra.apache

release mmap memory through jconsole?

2011-09-30 Thread Yang
I gave an -Xmx50G to my Cassandra java processs, now "top" shows its virtual memory address space is 82G, is there a way to release that memory through JMX ? Thanks Yang

Re: is it advisable to keep the data that is not frequently read/written to the database else where ?

2011-09-30 Thread Ramesh S
Thank you Jonathan for your quick reply. The reason I asked the question is because I have noticed some companies have used Cassandra to store data (which needs frequent read writes ) in-memory and have used other databases for data which is less frequently read/updated. So this created my doubt in

Re: sstable2json weirdness

2011-09-30 Thread Jonathan Ellis
It's possible we have a paging bug in sstable2json. On Fri, Sep 30, 2011 at 10:29 AM, Scott Fines wrote: > Hi all, > I've been messing with sstable2json as a means of mass-exporting some data > (mainly for backups, but also for some convenience trickery on an individual > nodes' data). However, I

Re: is it advisable to keep the data that is not frequently read/written to the database else where ?

2011-09-30 Thread Jonathan Ellis
Short answer: no. Longer: What problems do you hope to avoid by adding this complexity? On Fri, Sep 30, 2011 at 9:45 AM, Ramesh S wrote: > > > I have some data that would be read/write might be once during the entire > session, like authentication info. > When designing database with Cassandra i

sstable2json weirdness

2011-09-30 Thread Scott Fines
Hi all, I've been messing with sstable2json as a means of mass-exporting some data (mainly for backups, but also for some convenience trickery on an individual nodes' data). However, I've run into a situation where sstable2json appears to be dumping out TONS of duplicate columns for a single ro

Re: [RELEASE CANDIDATE] Apache Cassandra 1.0.0-rc1 released

2011-09-30 Thread Jonathan Ellis
What part does not work? 2011/9/30 Radim Kolar : > is there hector snapshot available for 1.0rc? Hector 0.8 do not works with > it > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

is it advisable to keep the data that is not frequently read/written to the database else where ?

2011-09-30 Thread Ramesh S
I have some data that would be read/write might be once during the entire session, like authentication info. When designing database with Cassandra is it advisable to keep the data that is not frequently read/written to the database else where ? Thank you regards, Ramesh

Re: How can I check what the consistency level is?

2011-09-30 Thread Ikeda Anthony
We are using 0.8.6 On 29/09/2011, at 21:19 PM, Jonathan Ellis wrote: > Are you on a current Cassandra release? If not you could be seeing > https://issues.apache.org/jira/browse/CASSANDRA-2870 > > On Thu, Sep 29, 2011 at 7:02 PM, Anthony Ikeda > wrote: >> We seem to be having issues with out

Re: create super column family for

2011-09-30 Thread Ramesh S
I am using 0.8.6. On Thu, Sep 29, 2011 at 11:10 PM, Yi Yang wrote: > ** Which version are you using? In my memory 0.8.3 cannot do it correctly > but later versions fixed the bug. > > 從我的 BlackBerry(R) 無線裝置 > -- > *From: * Ramesh S > *Date: *Thu, 29 Sep 2011 15:23:29

RE: invalid column name length 0

2011-09-30 Thread Desimpel, Ignace
Wanted to see if I still would similar exceptions if I lowered the load by reducing the replication factor. I saw that in the log files a lot of 'GC parNew' messages and started a complete new run (empty database) with smaller JVM -Xmn1000M and with replication factor 1 (before it was 3). Curren