RE: Consurrent compactors

2012-02-03 Thread Viktor Jevdokimov
My concern is not anout cleanup, but about supposed "tendency of small sstables to accumulate during a single long running compactions". When next task is for the same column family as currently long-running compaction, other column families compactions are freezed and concurrent_compactors > 1

Write latency of counter updates across multiple rows

2012-02-03 Thread Amit Chavan
Hi, In our use case, we maintain minute-wise roll ups for different metrics. These are stored in a counter column family where the row key is a composite containing the timestamp rounded to the last minute and an integer between 0-9 (This integer is calculated as the MD5 hash of the metric mod 10)

Re: Unsubscribe

2012-02-03 Thread francesco . tangari . inf
lol -- francesco.tangari@gmail.com Inviato con Sparrow (http://www.sparrowmailapp.com/?sig) Il giorno venerdì 3 febbraio 2012, alle ore 14.51, Larry Liu ha scritto: > Please unsubscribe me. > > Thanks!

Re: Unsubscribe

2012-02-03 Thread Alain RODRIGUEZ
Help yourself : http://wiki.apache.org/cassandra/FAQ#unsubscribe Alain 2012/2/3 > lol > > -- > francesco.tangari@gmail.com > Inviato con Sparrow > > Il giorno venerdì 3 febbraio 2012, alle ore 14.51, Larry Liu ha scritto: > > Please unsubscribe me. > > T

Re: Unsubscribe

2012-02-03 Thread Eric Evans
On Fri, Feb 3, 2012 at 7:51 AM, Larry Liu wrote: > Please unsubscribe me. http://goo.gl/lQJC2 -- Eric Evans Acunu | http://www.acunu.com | @acunu

Re: WARN [Memtable] live ratio

2012-02-03 Thread Jonathan Ellis
It's a warn because it's nonsense for the JVM to report that an column + overhead, takes less space than just the column data itself. On Tue, Jan 31, 2012 at 9:41 PM, Mohit Anchlia wrote: > I guess this is not really a WARN in that case. > > On Tue, Jan 31, 2012 at 4:29 PM, aaron morton wrote: >

Re: Recommended configuration for good streaming performance?

2012-02-03 Thread Jonathan Ellis
On Thu, Feb 2, 2012 at 11:52 AM, Erik Forsberg wrote: > Our Cassandra hardware are 16 core (including HT cores) with 24GiB of RAM. > They have two disks each. So far we've configured them with commitlog on one > disk and sstables on the other, but with streaming not using commitlog > (correct?) Y

Internal error processing batch_mutate java.util.ConcurrentModificationException

2012-02-03 Thread Viktor Jevdokimov
What may be cause of the following exception in 1.0.7 Cassandra: ERROR [Thrift:134] 2012-02-03 15:51:02,800 Cassandra.java (line 3462) Internal error processing batch_mutate java.util.ConcurrentModificationException at java.util.AbstractList$Itr.checkForComodification(AbstractList.java:3

Re: WARN [Memtable] live ratio

2012-02-03 Thread Mohit Anchlia
On Fri, Feb 3, 2012 at 7:32 AM, Jonathan Ellis wrote: > It's a warn because it's nonsense for the JVM to report that an column > + overhead, takes less space than just the column data itself. > But is there any action we need to take, or worry about? We trigger alerts based on WARN and ERROR. But

Re: WARN [Memtable] live ratio

2012-02-03 Thread Jonathan Ellis
You should come up with a way to reproduce so we can fix it. :) On Fri, Feb 3, 2012 at 10:31 AM, Mohit Anchlia wrote: > On Fri, Feb 3, 2012 at 7:32 AM, Jonathan Ellis wrote: >> It's a warn because it's nonsense for the JVM to report that an column >> + overhead, takes less space than just the co

Re: WARN [Memtable] live ratio

2012-02-03 Thread Radim Kolar
Dne 3.2.2012 17:46, Jonathan Ellis napsal(a): You should come up with a way to reproduce so we can fix it. :) it happens after HH delivery when memtable contains lot of deletes

Re: WARN [Memtable] live ratio

2012-02-03 Thread Mohit Anchlia
On Fri, Feb 3, 2012 at 8:46 AM, Jonathan Ellis wrote: > You should come up with a way to reproduce so we can fix it. :) This happens when server is idle for a while with not so much data and then you start a load like 50 write and 50 read requests per sec. We have 4 CF that we write to and then r

yet a couple more questions on composite columns

2012-02-03 Thread Yiming Sun
Hi, We are getting close to replacing our super-column based schema to something more efficient, and I am trying to wrap my heads around composite columns. An email from another list member has clarified that composite and non-composite columns should not be mixed in the same CF because only one

Cassandra OOM - 1.0.2

2012-02-03 Thread Ajeet Grewal
Hey guys, I am getting an out of memory (mmap failed) error with Cassandra 1.0.2. The relevant log lines are pasted at http://pastebin.com/UM28ZC1g. Cassandra works fine until it reaches about 300-400GB of load (on one instance, I have 12 nodes RF=2). Then nodes start failing with such errors. Th

Re: yet a couple more questions on composite columns

2012-02-03 Thread Andrey V. Panov
On 4 February 2012 06:21, Yiming Sun wrote: > I cannot have one composite column name with 3 components while another > with 4 components? Just put 4 components and left last empty (if it is same type)?! Another question I have is how flexible composite columns actually are. If > my data mode

Re: Can you query Cassandra while it's doing major compaction

2012-02-03 Thread Adrian Cockcroft
At Netflix we rotate the major compactions around the cluster, don't run them all at once. We also either take that node out of client traffic so it doesn't get used as a coordinator or use the Astyanax client that is latency and token aware to steer traffic to the other replicas. We are running o

Re: yet a couple more questions on composite columns

2012-02-03 Thread Chris Gerken
> > > On 4 February 2012 06:21, Yiming Sun wrote: > I cannot have one composite column name with 3 components while another with > 4 components? > Just put 4 components and left last empty (if it is same type)?! > > Another question I have is how flexible composite columns actually are. If