Re: InternalError occurs in MappedFileDataInput

2011-09-19 Thread Jonathan Ellis
That sounds like "upgrade to the latest Sun JVM" to me. 2011/9/19 姚松文 : > > 1466380- INFO [GC inspection] 2011-09-19 17:07:37,915 > GCInspector.logIntervalGCStats(line 130) GC for ParNew: 584 ms, 227444824 > reclaimed leaving 10491875064 used; max is 17289969664 > 1466381- INFO [GC inspection] 201

Re: cassandra crashed while repairing, leave node size X3

2011-09-19 Thread Yan Chunlu
got it, thanks! On Tue, Sep 20, 2011 at 12:27 AM, Peter Schuller < peter.schul...@infidyne.com> wrote: > > In my tests I have seen repair sometimes take a lot of space (2-3 times), > > cleanup did not clean it, the only way I could clean that was using major > > compaction. > > https://issues.apa

Re: "Ignorning message." showing in the log while upgrade to 0.8

2011-09-19 Thread Yan Chunlu
any help on this? thanks! On Sun, Sep 18, 2011 at 5:04 PM, Yan Chunlu wrote: > thanks! is the load info also a bug? node1 supposed to have 80MB. > > bash-3.2$ bin/nodetool -h localhost ring > Address DC RackStatus State LoadOwns >Token > >9379860

InternalError occurs in MappedFileDataInput

2011-09-19 Thread 姚松文
1466380- INFO [GC inspection] 2011-09-19 17:07:37,915 GCInspector.logIntervalGCStats(line 130) GC for ParNew: 584 ms, 227444824 reclaimed leaving 10491875064 used; max is 17289969664 1466381- INFO [GC inspection] 2011-09-19 17:07:39,022 GCInspector.logIntervalGCStats(line 130) GC for ParNew: 5

Re: mmap segment underflow

2011-09-19 Thread Eric Czech
Ok then I'll shutdown the server, change the access mode, restart, and run scrub (and then change the access mode back). Thanks for the pointers and I'll let you know how it goes one way or the other. On Tue, Sep 20, 2011 at 12:29 AM, aaron morton wrote: > I've also found it useful to disable me

Re: mmap segment underflow

2011-09-19 Thread aaron morton
I've also found it useful to disable memmapped file access until the scrub is complete by adding this to the yaml disk_access_mode: standard Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 20/09/2011, at 6:55 AM, Jonathan Ellis w

[no subject]

2011-09-19 Thread RAJASHEKAR REDDY
.Have a nice day and cool night! http://cairlos.zymichost.com/com.friend.php?yvs=12r1

Re: mmap segment underflow

2011-09-19 Thread Jonathan Ellis
You should start with scrub. On Mon, Sep 19, 2011 at 1:04 PM, Eric Czech wrote: > I'm getting a lot of errors that look something like "java.io.IOError: > java.io.IOException: mmap segment underflow; remaining is 348268797 > but 892417075 requested" on one node in a 10 node cluster.  I'm > curren

mmap segment underflow

2011-09-19 Thread Eric Czech
I'm getting a lot of errors that look something like "java.io.IOError: java.io.IOException: mmap segment underflow; remaining is 348268797 but 892417075 requested" on one node in a 10 node cluster. I'm currently running version 0.8.4 but this is data that was carried over from much earlier version

Re: Figuring out which node a key belongs to

2011-09-19 Thread Jonathan Ellis
Look at nodetool getendpoints. On Mon, Sep 19, 2011 at 11:10 AM, Tharindu Mathew wrote: > Hi, > > I'd like to do $subject. Is there a way to do this? > > I feel this should be possible by hashing the key and comparing the token of > each node. But I don't know the internals enough to know exactl

Re: cassandra crashed while repairing, leave node size X3

2011-09-19 Thread Peter Schuller
> In my tests I have seen repair sometimes take a lot of space (2-3 times), > cleanup did not clean it, the only way I could clean that was using major > compaction. https://issues.apache.org/jira/browse/CASSANDRA-2816 (follow links to other jiras) https://issues.apache.org/jira/browse/CASSANDRA-2

Re: Possibility of going OOM using get_count

2011-09-19 Thread Tharindu Mathew
Yes, Aaron that self implemented paging is what I'm trying. Jonathan, the last column read in the previous result fetched is the starting column of the next iteration. The end column remains constant. This is using slice ranges. Afaiu, that should work. Regards, Tharindu Sent from my iPhone

Figuring out which node a key belongs to

2011-09-19 Thread Tharindu Mathew
Hi, I'd like to do $subject. Is there a way to do this? I feel this should be possible by hashing the key and comparing the token of each node. But I don't know the internals enough to know exactly? This is to tell hadoop to fetch a record from a specific node. I'm customizing the CFIF. Rega

Re: Queue suggestion in Cassandra

2011-09-19 Thread David Allsopp
I have had similar experiences. On the advice of the Cassandra team, I now maintain the queue itself in-memory, but persist the data items in Cassandra (one per row). When re-starting the system I pull data from Cassandra to re-construct the ordered queue in-memory. In some cases I write columns to

Re: Node repair never progressing past strange AEService request (0.8.5)

2011-09-19 Thread Sylvain Lebresne
Yes, the fact that node send TreeRequest (and merkle trees) to themselves is part of the protocol, no problem there. As for "it has ran for many hours without repairing anything", what makes you think it didn't repair anything ? -- Sylvain On Mon, Sep 19, 2011 at 4:14 PM, Jason Harvey wrote: >

Re: Node repair never progressing past strange AEService request (0.8.5)

2011-09-19 Thread Jason Harvey
Got a response from jbellis in IRC saying that the node will have to build its own hash tree. The request to itself is normal. On Mon, Sep 19, 2011 at 7:01 AM, Jason Harvey wrote: > I have a node in my 0.8.5 ring that I'm attempting to repair. I sent > it the repair command and let it run for a f

Node repair never progressing past strange AEService request (0.8.5)

2011-09-19 Thread Jason Harvey
I have a node in my 0.8.5 ring that I'm attempting to repair. I sent it the repair command and let it run for a few hours. After checking the logs it didn't appear to have repaired at all. This was the last repair-related thing in the logs: INFO [AntiEntropyStage:1] 2011-09-19 05:53:55,823 AntiEn

Re: Possibility of going OOM using get_count

2011-09-19 Thread Jonathan Ellis
Unfortunately no, because you don't know what the actual last-column-counted was. On Mon, Sep 19, 2011 at 4:25 AM, aaron morton wrote: > get_count() supports the same predicate as get_slice. So you can implement > the paging yourself. > Cheers > - > Aaron Morton > Freelance Cassan

Re: cassandra crashed while repairing, leave node size X3

2011-09-19 Thread Yan Chunlu
I am using 0.7.4 too. and would waiting for 0.8.6 stable to release because of CASSANDRA-3166. did you already using 0.8.6 in production? 2011/9/19 Jonas Borgström > On 09/19/2011 04:26 AM, Anand Somani wrote: > > In my tests I have seen repair sometimes take a lot of space (2-3 > > times), cle

replication factor > no nodes

2011-09-19 Thread Fredrik Stigbäck
What is the implication of having a replication factor greater that the number of nodes in cluster? We're changing replication factor at runtime and sometimes when a node is removed/decomissioned from the cluster, replication factor will be greater than number of nodes since we have replication fac

Re: returning empty rows on range scans

2011-09-19 Thread aaron morton
See http://wiki.apache.org/cassandra/FAQ#range_ghosts Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19/09/2011, at 9:11 PM, Radim Kolar wrote: > Is there good reason why cassandra is returning empty rows (no columns) to > clien

Re: Possibility of going OOM using get_count

2011-09-19 Thread aaron morton
get_count() supports the same predicate as get_slice. So you can implement the paging yourself. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19/09/2011, at 8:45 PM, Tharindu Mathew wrote: > > > On Mon, Sep 19, 2011 at 12:40

returning empty rows on range scans

2011-09-19 Thread Radim Kolar
Is there good reason why cassandra is returning empty rows (no columns) to client on rangeslicequery? (list command in CLI). They should be hidden from user because it confuses applications. They are not returned if get CLI command is used.

Re: Possibility of going OOM using get_count

2011-09-19 Thread Tharindu Mathew
On Mon, Sep 19, 2011 at 12:40 PM, Benoit Perroud wrote: > The workaround for 0.7 is calling get_slice and count on client side. > It's heavier, sure, but you will then be able to set start column > accordingly. > I was afraid of that :( Will follow that method. Thanks. > > > > 2011/9/19 Tharin

Re: cassandra crashed while repairing, leave node size X3

2011-09-19 Thread Jonas Borgström
On 09/19/2011 04:26 AM, Anand Somani wrote: > In my tests I have seen repair sometimes take a lot of space (2-3 > times), cleanup did not clean it, the only way I could clean that was > using major compaction. Do you remember with what version you saw these problems? I've had the same problems wi

Re: Possibility of going OOM using get_count

2011-09-19 Thread Benoit Perroud
The workaround for 0.7 is calling get_slice and count on client side. It's heavier, sure, but you will then be able to set start column accordingly. 2011/9/19 Tharindu Mathew : > Thanks Aaron and Jake for the replies. > Any chance of a possible workaround to use for Cassandra 0.7? > > On Mon, Se