Re: jscv CPU Consumption

2012-06-28 Thread Olivier Mallassi
precision : nmon does not show any IO (disk) activities On Fri, Jun 29, 2012 at 8:45 AM, Olivier Mallassi wrote: > Hi all > > We have a 12 servers clusters (8 cores by machines..). > OS is Ubuntu 10.04.2. > > On one of the machine (only one) and without any load (no inserts, no > reads), we h

jscv CPU Consumption

2012-06-28 Thread Olivier Mallassi
Hi all We have a 12 servers clusters (8 cores by machines..). OS is Ubuntu 10.04.2. On one of the machine (only one) and without any load (no inserts, no reads), we have a huge CPU Load whereas there is no activities (no compaction in progress etc...) A top on the machine show us the process

Re: key_cache_size_in_mb

2012-06-28 Thread Gurpreet Singh
Vijay, Thanks for the suggestion. Row Key size is 8 bytes (its a long). Is the issue here incorrect calculation really? The server already had the key cache in memory when i stopped it, and it was using abt 6 gigs of heap total. How is it tht it cannot startup again with the same keycache? /G On

Re: Cassandra Authentication

2012-06-28 Thread Mohit Anchlia
Sent from my iPad On Jun 28, 2012, at 8:45 AM, Christof Bornhoevd wrote: > Hi, > > we are using Cassandra v1.0.8 with Hector v1.0-5 and would like to move our > current system to an operational setting based on Amazon AWS. What are best > practices for addessing security for Cassandra on A

Re: which high level Java client

2012-06-28 Thread Dan Washusen
Pelops is a very thin wrapper over the Thrift client so that could be a good option. You could also check out a fork by the VMWare/Spring guys which adds full async support: https://github.com/andrewswan/scale7-pelops. I'm not sure on the state of it, but it seems promising... On Thursday

Re: key_cache_size_in_mb

2012-06-28 Thread Vijay
> It has 13.7million keys How big is your Row Keys? Current calculation (in 1.1) assumes that the average size of the Entry in the keycache is 16 bytes. One thing which you can do to get out this issue is to reduce the Keycache to a low enough to get the server started or increase the Heap to hold

Re: key_cache_size_in_mb

2012-06-28 Thread Gurpreet Singh
Vijay, I am running into an issue right now, not sure if its related to this one. My cassandra 1.1 was running fine for a week, and the key cache size (as checked by jconsole) increased to almost 650 mb. It has 13.7million keys. I have set key_cache_size_in_mb to 800 mb. I checked the heap size, a

Re: key_cache_size_in_mb

2012-06-28 Thread Vijay
in 1.1 we dont calculate the Key size accurately, hence we have the fix in https://issues.apache.org/jira/browse/CASSANDRA-4315 Regards, On Thu, Jun 28, 2012 at 11:25 AM, Gurpreet Singh wrote: > anyone have an explanation for this? > This kinda screws up memory calculations. > > /G > > On Mon

Re: hector timeouts

2012-06-28 Thread Deno Vichas
On 6/28/2012 9:37 AM, David Leimbach wrote: That coupled with Hector timeout issues became a real problem for us. could you share some details on this? we're using hector and we see random timeout warns in the logs and not sure how to address them. thanks, deno

Re: Memtable tuning in 1.0 and higher

2012-06-28 Thread Joost van de Wijgerd
Hi Jonathan, The problem is not that I haven't allocated enough memory to the memtables, the problem is that the memtable for this particular CF flushes too early because the liveRation stays at 1.0. When looking at the code it seems to me the the liveRatio is calculated based on the throughput of

Re: key_cache_size_in_mb

2012-06-28 Thread Gurpreet Singh
anyone have an explanation for this? This kinda screws up memory calculations. /G On Mon, Jun 25, 2012 at 5:50 PM, Gurpreet Singh wrote: > Hi, > I have a question about cassandra 1.1 > > Just wanted to confirm if key_cache_size_in_mb is the maximum amount of > memory that key cache will use in m

Re: Memtable tuning in 1.0 and higher

2012-06-28 Thread Edward Capriolo
I was wondering if we could find cases where the new one global limit would not be good for some. As Jonathan said setting you memtable memory high will help. Although if you are constantly overwtiting the exact almost same data it should never flush if you have enough dedicated memory. On Thursda

Re: Memtable tuning in 1.0 and higher

2012-06-28 Thread Jonathan Ellis
[moving to user list] 1.0 doesn't care about throughput or op count anymore, only whether the total memory used by the *currrent* data in the memtables has reached the global limit. So, it automatically doesn't count "historical" data that's been overwritten in the current memtable. So, you may

AW: Re: Request Timeout with Composite Columns and CQL3

2012-06-28 Thread Henning Kropp
Well, a CQL import of the same data did not result in any issues. I was not able to rule out hector yet, but it's more likely that the hadoop BulkOutputFormat causes the trouble. To rule out hector I'll have to implement the import without the BulkOutputFormat as I did with CQL. I would like t

Re: cassandra queue

2012-06-28 Thread David Leimbach
Tried using Cassandra as a queue once. It's an attractive idea, having the data replicated and durably stored. However the problems we hit were with trying to utilize a secondary index for whether or not something had been processed or not. Since that index field was basically on a type with ari

Re: Distinct with Cql

2012-06-28 Thread Jonathan Ellis
No. (Moving to user list.) On Jun 28, 2012 8:17 AM, "Fábio Caldas" wrote: > It´s possible to use distinct on cql? > > -- > Atenciosamente, > Fábio Caldas >

Cassandra Authentication

2012-06-28 Thread Christof Bornhoevd
Hi, we are using Cassandra v1.0.8 with Hector v1.0-5 and would like to move our current system to an operational setting based on Amazon AWS. What are best practices for addessing security for Cassandra on AWS. Besides Security Groups in AWS how is Cassandra Client to Cluster authentication handle

Re: Amazingly bad compaction performance

2012-06-28 Thread Dustin Wenz
My maximum and initial heap sizes are set to 6GB. Actual memory usage for the VM is around 11-12GB. The machine has 24GB of physical memory, so there isn't any paging going in. I don't see any GC events logged that are longer than a few hundred milliseconds. Is it possible that GC is taking sig

Re: which high level Java client

2012-06-28 Thread Brian O'Neill
FWIW, We keep most of our system level integrations behind REST using Virgil: https://github.com/hmsonline/virgil When a lower-level integration is necessary we use Hector, but recently we've started using Astyanax and plan to port our Hector dependencies over to Astyanax when given a chance. I'

Re: which high level Java client

2012-06-28 Thread Vivek Mishra
Would like to add one more https://github.com/impetus-opensource/Kundera . Next release is planned with many distinguishing features. -Vivek On Thu, Jun 28, 2012 at 6:23 PM, Sasha Dolgy wrote: > Not following this thread too much, but there is also > https://github.com/Netflix/astyanax/ > > "As

Re: which high level Java client

2012-06-28 Thread Sasha Dolgy
Not following this thread too much, but there is also https://github.com/Netflix/astyanax/ "Astyanax is currently in use at Netflix . Issues generally are fixed as quickly as possbile and releases done frequently." -sd On Thu, Jun 28, 2012 at 2:39 PM, Poziombka, Wade

RE: which high level Java client

2012-06-28 Thread Poziombka, Wade L
I use Pelops and have been very happy. In my opinion the interface is cleaner than that with Hector. I personally do like the serializer business. -Original Message- From: Radim Kolar [mailto:h...@filez.com] Sent: Thursday, June 28, 2012 5:06 AM To: user@cassandra.apache.org Subject: R

Failed to solve Digest mismatch

2012-06-28 Thread Jason Tang
Hi First I delete one column, then I delete one row. Then try to read all columns from the same row, all operations from same client app. The consistency level is read/write quorum. Check the Cassandra log, the local node don't perform the delete operation but send the mutation to other

Re: which high level Java client

2012-06-28 Thread Radim Kolar
i do not have experience with other clients, only hector. But timeout management in hector is really broken. If you expect your nodes to timeout often (for example, if you are using WAN) better to try something else first.

Re: BulkLoading SSTables and compression

2012-06-28 Thread Andy Cobley
My (limited) experience of moving form 0.8 to 1.0 is that you do have to use rebuildsstables. I'm guessing BlukLoading is bypassing the compression ? Andy On 28 Jun 2012, at 10:53, jmodha wrote: > Hi, > > We are migrating our Cassandra cluster from v1.0.3 to v1.1.1, the data is > migrated us

No indexed columns present in by-columns clause with "equals" operator

2012-06-28 Thread Abhijit Chanda
Hi All, I have got a strange exception while using cassandra cql. Relational operators like (<, >, >=, <=) are not working. my columnfamily looks like this. CREATE COLUMNFAMILY STEST ( ROW_KEY text PRIMARY KEY, VALUE1 text, VALUE2 text ) WITH comment='' AND comparator=text AND read_repa

Cassandra consistency issue on cluster system

2012-06-28 Thread 黄荣桢
*Background*: My application is running on a cluster system(which have 4 nodes), and system time of these four nodes are synchronizing by NTP. I use Write.QUORUM and Read.QUORUM strategy. The probability of this problem is not very high. Cassandra version is 1.0.3, I have tried Cassandra 1.1.1, thi