Re: Way to force the propagation of a schema change?

2012-03-07 Thread Tamar Fraenkel
It is my understanding that Hector does it as well (you can send true to state you want to wait for schema agreement). *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Fri,

Large SliceRanges: Reading all results in to memory vs. reading smaller result sub-sets at a time?

2012-03-07 Thread Kevin
When dealing with large SliceRanges, it better to read all the results in to memory (by setting "count" to the largest value possible), or is it better to divide the query in to smaller SliceRange queries? Large in this case being on the order of millions of rows. There's a footnote concerning

Re: Node joining / unknown

2012-03-07 Thread igor
just run "nodetool compactionstat" on other nodes. -Original Message- From: "R. Verlangen" To: user@cassandra.apache.org Sent: Wed, 07 Mar 2012 23:09 Subject: Re: Node joining / unknown @Brandon: Thank you for the information. I'll do that next time. @Igor: Any ways to find out whether

Re: Node joining / unknown

2012-03-07 Thread R. Verlangen
@Brandon: Thank you for the information. I'll do that next time. @Igor: Any ways to find out whether that is the current state? And if so, how to solve it? 2012/3/7 > Maybe it wait for verification compaction on other node? > > > > > > -Original Message- > From: "R. Verlangen" > To: us

Re: Node joining / unknown

2012-03-07 Thread igor
Maybe it wait for verification compaction on other node?   -Original Message- From: "R. Verlangen" To: user@cassandra.apache.org Sent: Wed, 07 Mar 2012 22:15 Subject: Re: Node joining / unknown At this moment the node has joined the ring (after a restart: tried that before, but now it

Re: Node joining / unknown

2012-03-07 Thread Brandon Williams
On Wed, Mar 7, 2012 at 3:37 AM, aaron morton wrote: > 2) Stop the node. Try to get remove the token again from another node. Node > that removing a token will stream data around the place as well. A node that has never fully joined doesn't need to be removed (and can't.) Just shut it down and it

Re: Node joining / unknown

2012-03-07 Thread R. Verlangen
At this moment the node has joined the ring (after a restart: tried that before, but now it had finally result). When I try to run repair on the new node, the log says (the new node is NODE C): INFO [AntiEntropyStage:1] 2012-03-07 21:12:06,453 AntiEntropyService.java (line 190) [repair #cfcc12b0-

Re: "Final buffer length 4690 to accomodate data size of 2347 for RowMutation" error caused node death

2012-03-07 Thread Jonathan Ellis
Thanks, Thomas. Row cache/CLHCP confirms our suspected culprit. We've committed a fix for 1.0.9. On Wed, Mar 7, 2012 at 11:08 AM, Thomas van Neerijnen wrote: > Sorry, for the delay in replying. > > I'd like to stress that I've been working on this cluster for many months > and this was the firs

Re: Schema change causes exception when adding data

2012-03-07 Thread Tyler Hobbs
On Wed, Mar 7, 2012 at 2:10 AM, Tharindu Mathew wrote: > Sometimes still the schema does not come into agreement... I wonder > whether this issue is solved the newer versions? I believe there has been some improvement in this area in recent versions, but I think it's also still true that you sh

Re: "Final buffer length 4690 to accomodate data size of 2347 for RowMutation" error caused node death

2012-03-07 Thread Thomas van Neerijnen
Sorry, for the delay in replying. I'd like to stress that I've been working on this cluster for many months and this was the first and so far last time I got this error so I couldn't guess how to duplicate. Sorry I can't be more help. Anyways, here's the details requested: Row caching is enabled,

Re: newer Cassandra + Hadoop = TimedOutException()

2012-03-07 Thread Florent Lefillâtre
If you want try a test, in the CFIF.getSubSplits(String, String, TokenRange, Configuration) method, replace the loop on 'range.rpc_endpoints' by the same loop on 'range.endpoints'. This method split token range of each node with describe_splits method, but I think there is something wrong when you

Re: Old data coming alive after adding node

2012-03-07 Thread Stefan Reek
After the old data came up we were able to delete it again. And it is stable now. We are in the process of upgrading to 1.0, but as you said that's a painful process. I just hope 0.6 will keep running till we're done with the upgrade. Anyway thanks for the help. Cheers, Stefan On 03/06/2012

Re: Repairing nodes when two schema versions appear

2012-03-07 Thread aaron morton
> 1. Can this schema version issue happen in newer versions of Cassandra (>1.0) > ? AFAIK yes. Schema changes are assumed to happen infrequently, and to only be started if the cluster is in schema agreement. Clients (include the CLI and CQL) take care of this. > 2. When the node is UP and we d

Re: Node joining / unknown

2012-03-07 Thread aaron morton
> - When I try to remove the token, it says: Exception in thread "main" > java.lang.UnsupportedOperationException: Token not found. Am assuming you ran nodetool removetoken on a node other than the joining node? What did nodetool ring look like on that machine ? Take a look at nodetool netstat

Re: Secondary indexes don't go away after metadata change

2012-03-07 Thread aaron morton
Migrations are a delta (e.g. update CF). I have a quick look at the code; it does appear to be cancelling any in progress index builds when an index is dropped. There may be other code that does it though. Perhaps indexes should not be built until the node has schema agreement with others. No

Re: Repairing nodes when two schema versions appear

2012-03-07 Thread Tharindu Mathew
Thanks Aaron. This is great. A couple of questions if you don't mind... 1. Can this schema version issue happen in newer versions of Cassandra (>1.0) ? 2. When the node is UP and we do this, even though logs errors, still would everything come back to normal just like we shut down and delete and

Node joining / unknown

2012-03-07 Thread R. Verlangen
Hi there, I'm currently in a really weird situation. - Nodetool ring says node X is joining (this already takes 12 hours, with no activity) - When I try to remove the token, it says: Exception in thread "main" java.lang.UnsupportedOperationException: Token not found. - Removetoken status = No toke

Re: Schema change causes exception when adding data

2012-03-07 Thread Tharindu Mathew
Hi Folks, Managed to solve this problem to an extent. I used the thrift api just for this client and did a thread sleep until the schema comes into agreement. The addColumnFamily(CF, boolean) is not available in the Hector I use. Anyway, I checked the code in Hector trunk. The approach is almost

Re: newer Cassandra + Hadoop = TimedOutException()

2012-03-07 Thread Patrik Modesto
You're right, I wasn't looking in the right logs. Unfortunately I'd need to restart hadoop takstracker with loglevel DEBUG and that is not possilbe at the moment. Pitty it happens only in the production with terrabytes of data, not in the test... Regards, P. On Tue, Mar 6, 2012 at 14:31, Florent