Re: java.lang.NullPointerException on cassandra 1.0.2

2011-11-15 Thread Sylvain Lebresne
On Tue, Nov 15, 2011 at 12:13 AM, Ramesh Natarajan wrote: > Hi, > >  We are running a 8 node cassandra cluster running the latest 1.0.2 > release.  We are seeing this error showing up in the system.log file. > Any idea if this is a known issue in cassandra 1.0.2? It is not. Can you please open a

Re: Cassandra as a LinkedIn Skill

2011-11-15 Thread Alexandru Dan Sicoe
Done...good idea! ;) On Mon, Nov 14, 2011 at 7:54 PM, Jake Luciani wrote: > Hi, > > Sorry for the intrusion. > > I was speaking to some of the LinkedIn engineers at ApacheCon last week > about to see how to get > Cassandra into the linkedin skills page [1]. > > They claim if more people add Cass

Compaction -> CPU load 100% -> time out

2011-11-15 Thread Alain RODRIGUEZ
Hi, I'm running a 3 node cassandra 1.0.2 cluster on 3 Amazon EC2 t1.micro. I managed to fix some OOM I had, but I still have some spike of cpu load. I know that t1.micro have small resources, but I think it could be enough if they were well managed. My application works well, excepted when cassa

Re: BulkLoader

2011-11-15 Thread Giannis Neokleous
Hi Ernie, The nodes are not part of the ring so I don't think remove token will help. They're just marked as unreachable only when I call describe cluster. When I do nodetool ring the nodes don't show up there. -Giannis On Mon, Nov 14, 2011 at 10:55 PM, ehers...@gmail.com wrote: > Giannis, > >

Re: BulkLoader

2011-11-15 Thread Giannis Neokleous
Hi Mike, I'll try and write a blog post soon about it and share some information. -Giannis On Tue, Nov 15, 2011 at 7:49 AM, Giannis Neokleous < gian...@generalsentiment.com> wrote: > Hi Ernie, > > The nodes are not part of the ring so I don't think remove token will > help. They're just marked

Re: (A or B) AND C AND !D

2011-11-15 Thread A J
To clarify, I wish to keep N=4 and W=2 in the following scenario. Thanks. On Sun, Nov 13, 2011 at 11:20 PM, A J wrote: > Hello > Say I have 4 nodes: A, B, C and D and wish to have consistency level > for writes defined in such as way that writes meet the following > consistency level: > (A or B)

Re: describe cluster error

2011-11-15 Thread Silviu Matei
Thanks for your reply. We did a rolling upgrade; one by one, took the node offline, set up the configuration in the new distribution package and fired it up. I got that error after I tried to enable row cache, in hope of improving performance. Tried to update one of the CFs from the cli, but it jus

Seeking advice on Schema and Caching

2011-11-15 Thread Aditya Narayan
Hi I need to add 'search users' functionality to my application. (The trigger for fetching searched items(like google instant search) is made when 3 letters have been typed in). For this, I make a CF with String type keys. Each such key is made of first 3 letters of a user's name. Thus all names

RE: BulkLoader

2011-11-15 Thread mike.li
Thanks, Giannis. Looking forward to ... Mike From: Giannis Neokleous [mailto:gian...@generalsentiment.com] Sent: Tuesday, November 15, 2011 7:01 AM To: ehers...@gmail.com Cc: user@cassandra.apache.org Subject: Re: BulkLoader Hi Mike, I'll try and write a blog post soon about it and share some

0.8.6 - Cannot Restart Node, Commit Log Exception

2011-11-15 Thread Dan Hendry
Last night one of my nodes died inexplicably, with no log entries anywhere indicating the reason (cassandras log, /var/log/messages, etc). I tried to restart it but the node will not restart as it fails with the errors below when replaying the commit log. I should point out that the cluster is curr

RE: 0.8.6 - Cannot Restart Node, Commit Log Exception

2011-11-15 Thread Dan Hendry
After removing the offending commit log, the node was able to restart successfully. Sufficed to say that's not something I really wanted to do. Dan From: Dan Hendry [mailto:dan.hendry.j...@gmail.com] Sent: November-15-11 10:44 To: 'user@cassandra.apache.org' Subject: 0.8.6 - Cannot Restart

Continuous export of data out of database

2011-11-15 Thread A J
Hello VoltDB has an export feature to stream the data out of the database. http://voltdb.com/company/blog/voltdb-export-connecting-voltdb-other-systems This is different from Cassandra's export feature (http://wiki.apache.org/cassandra/Operations#Import_.2BAC8_export) which is more of a different

Re: Seeking advice on Schema and Caching

2011-11-15 Thread Quintero
Aditya Narayan wrote: >Hi > >I need to add 'search users' functionality to my application. (The trigger >for fetching searched items(like google instant search) is made when 3 >letters have been typed in). > >For this, I make a CF with String type keys. Each such key is made of first >3 letters

RE: BulkLoader

2011-11-15 Thread Quintero
mike...@thomsonreuters.com wrote: >Thanks, Giannis. Looking forward to ... > >Mike > >From: Giannis Neokleous [mailto:gian...@generalsentiment.com] >Sent: Tuesday, November 15, 2011 7:01 AM >To: ehers...@gmail.com >Cc: user@cassandra.apache.org >Subject: Re: BulkLoader > >Hi Mike, > >I'll try a

Re: describe cluster error

2011-11-15 Thread Quintero
Silviu Matei wrote: >Thanks for your reply. >We did a rolling upgrade; one by one, took the node offline, set up the >configuration in the new distribution package and fired it up. >I got that error after I tried to enable row cache, in hope of improving >performance. Tried to update one of the

RE: Compaction -> CPU load 100% -> time out

2011-11-15 Thread Dan Hendry
I really don't recommend using t1.micros. The problem with them is that they have CPU bursting, basically meaning you get lots of CPU resources for a short time but if you use more than you have been allocated you get basically nothing for 10+ seconds afterwards. By 'basically nothing' I really mea

RE: 0.8.6 - Cannot Restart Node, Commit Log Exception

2011-11-15 Thread Quintero
Dan Hendry wrote: >After removing the offending commit log, the node was able to restart >successfully. Sufficed to say that's not something I really wanted to do. > > > >Dan > > > >From: Dan Hendry [mailto:dan.hendry.j...@gmail.com] >Sent: November-15-11 10:44 >To: 'user@cassandra.apache.or

Re: (A or B) AND C AND !D

2011-11-15 Thread Quintero
A J wrote: >To clarify, I wish to keep N=4 and W=2 in the following scenario. > >Thanks. > >On Sun, Nov 13, 2011 at 11:20 PM, A J wrote: >> Hello >> Say I have 4 nodes: A, B, C and D and wish to have consistency level >> for writes defined in such as way that writes meet the following >> consi

Re: Continuous export of data out of database

2011-11-15 Thread Robert Jackson
The thing that I thought if initially would be setting up your cluster in a multi-datacenter config[1]. In that scenario you could add an additional machine in a second datacenter with RF=1. We are using a variant of this setup to separate long running calculations from our interactive systems.

Re: Continuous export of data out of database

2011-11-15 Thread A J
The issue with that is that I wish to have EACH_QUORUM in our other 2 datacenters but not in the third DC. Could not figure a way to accomplish that so exploring have a near-realtime backup copy in the third DC via some streaming process. On Tue, Nov 15, 2011 at 12:12 PM, Robert Jackson wrote: >

Better way for logging ?

2011-11-15 Thread Sachin Bhansali
Hi, Did anyone try to configure Async Logging in Cassandra 0.8.4 ? It seems only way to configure logging is through property file log4j-embedded-cassandra.properties which doesnt support Async logging. - Sachin

Re: Continuous export of data out of database

2011-11-15 Thread Robert Jackson
It would work if you could use LOCAL_QUORUM in each independent data center, but with EACH_QUORUM the whole read/write operation would block until a quorum was reached in each data center. This would be particularly bad if using a single replica in the "backup" data center and it was unavailable

Re: Better way for logging ?

2011-11-15 Thread Jonathan Ellis
Right, it only supports the properties file atm. We're open to extending this to the xml configurator but is this really a problem? At INFO cassandra doesn't log much, and at DEBUG you're going to suffer async or no. :) On Tue, Nov 15, 2011 at 12:32 PM, Sachin Bhansali wrote: > Hi, > > Did anyo

Re: Better way for logging ?

2011-11-15 Thread Sachin Bhansali
Thanks Jonathan, Actually we where concerned about writing logs on to NFS. - Sachin On Tue, Nov 15, 2011 at 2:39 PM, Jonathan Ellis wrote: > Right, it only supports the properties file atm. > > We're open to extending this to the xml configurator but is this > really a problem? At INFO cassand

Re: Seeking advice on Schema and Caching

2011-11-15 Thread Aditya Narayan
Any insights on this ? On Tue, Nov 15, 2011 at 9:40 PM, Quintero wrote: > > > Aditya Narayan wrote: > > >Hi > > > >I need to add 'search users' functionality to my application. (The trigger > >for fetching searched items(like google instant search) is made when 3 > >letters have been typed in).

memory problems still post- CASSANDRA-3492

2011-11-15 Thread Mick Semb Wever
I've got a following problem to CASSANDRA-3492, also related to ridiculously high memory. After the fix yesterday for CASSANDRA-3492 I have that node in question up and running. But another node (on the same machine but different cluster), even after an upgrade to the staging 1.0.3 and a `nodet

Network traffic patterns

2011-11-15 Thread Philippe
Hello, I'm trying to understand the network usage I am seeing in my cluster, can anyone shed some light? It's an RF=3, 12-node, cassandra 0.8.6 cluster. The nodes are p13,p14,p15...p24 and are consecutive in that order on the ring. Each node is only a cassandra database. I am hitting the cluster fr

Re: Network traffic patterns

2011-11-15 Thread Philippe
Sorry about the previous message, I've enabled keyboard shortcuts on gmail...*sigh*... Hello, I'm trying to understand the network usage I am seeing in my cluster, can anyone shed some light? It's an RF=3, 12-node, cassandra 0.8.6 cluster. repair is performed on each node once a week, with a rolli

Re: Seeking advice on Schema and Caching

2011-11-15 Thread Ben Gambley
Hi Aditya Not sure the best way to do in Cassandra but have you considered using apache solr - you could then include just the row keys pointing back to Cassandra where the actual data is. Solr seems quite capable of performing google like searches and is fast. Cheers Ben On 16/11/2011, at 1:

CASSANDRA-2863

2011-11-15 Thread Ian Danforth
Re: https://issues.apache.org/jira/browse/CASSANDRA-2863 All, I encountered this NPE during a node move. Everything seemed to complete (no streaming, no further compactions, no further errors in system.log) however the move command never returned. After several hours I then cancelled that comman

Re: questions on frequency and timing of async replication between DCs

2011-11-15 Thread Subrahmanya Harve
Thank you Konstantin,Radim. Appreciate your responses. On Mon, Nov 14, 2011 at 11:27 PM, Radim Kolar wrote: > > It may be the case that your CL is the issue. You are writing it at >> ONE, which means that out of the 4 replicas of that key (two in each >> data center), you are only putting it on

Re: Seeking advice on Schema and Caching

2011-11-15 Thread Aditya Narayan
Hi Ben, Solr, as I understood is for implementing full text search capability within documents, but in my case, as of now I just need to implement search on user names which seems to be easily provided by Cassandra as user names (as column names) may be sorted alphabetically within rows. I am spli

Re: Seeking advice on Schema and Caching

2011-11-15 Thread samal
> > I need to add 'search users' functionality to my application. (The >> trigger for fetching searched items(like google instant search) is made >> when 3 letters have been typed in). >> > >> > For this, I make a CF with String type keys. Each such key is made of >> first 3 letters of a user's na

Re: Seeking advice on Schema and Caching

2011-11-15 Thread Aditya Narayan
Got the first option that you suggested. However, In the second one, are you suggested to use, for e.g, key='Marcos' & store cols, for all users of that name, containing userId inside that row. That way it would have to read multiple rows while user is doing a single search. On Wed, Nov 16, 2011

Re: Seeking advice on Schema and Caching

2011-11-15 Thread Aditya Narayan
Regarding the first option that you suggested through composite columns, can I store the username & id both in the column name and keep the column valueless? Will I be able to retrieve both the username and id from the composite col name ? Thanks a lot On Wed, Nov 16, 2011 at 10:56 AM, Aditya Nar

Re: Seeking advice on Schema and Caching

2011-11-15 Thread samal
I think you can but I am not sure, I haven't tried that yet, Nothing harm in keeping value also it will be read in single query only. In 2nd case, yes 2 or more query required to get specific user details. As username is map to user_id's key(unique like UUID) and user_id key store actual details.