detect zookeeper down

2012-08-19 Thread kim young ill
hi, i'm using hbase 0.9.2 to store data with HTablePool. normally when the app start i'd feed the hbas-client with addresses of zookeeper-ensemble. if the zookeeper-host, to which the client is connecting to is down, hbase client doesnt seem to be able to handle this cautomatically, what should be

Re: OOME cause

2012-08-19 Thread Sever Fundatureanu
Hi Kevin, The heap was close to 100% as expected. The version is 0.92.0. I can also add I am using the options: HBASE_OPTS="-XX:NewSize=64m -XX:MaxNewSize=64m -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:CMSInitiatingOccupancyFraction=70" If I allocate .8 for memstore+blockCache, will HBase use on

Re: OOME cause

2012-08-19 Thread Kevin O'dell
Sever, What is the heap set at? I would not recommend exceeding .7 with memstore and block cache combined as this does not leave much room for hbase itself. What version is this on? On Aug 19, 2012 7:51 AM, "Sever Fundatureanu" wrote: > Hello, > > I have a RegionServer which OOMEd. The memsto

OOME cause

2012-08-19 Thread Sever Fundatureanu
Hello, I have a RegionServer which OOMEd. The memstore is set to 0.4 and the blockCache to 0.4 of total memory. Although the memstore was empty (confirmed with Ganglia), the server OOMEd. I noticed the block cache is doing a lot of evictions, which caused a full GC pause. However, I don't see why

Re: how client location a region/tablet?

2012-08-19 Thread Lin Ma
Thank you Stack, especially for the smart 6 round trip guess for the puzzle. :-) 1. "Yeah, we client cache's locations, not the data." -- does it mean for each client, it will cache all location information of a HBase cluster, i.e. which physical server owns which region? Supposing each region has

Re: how client location a region/tablet?

2012-08-19 Thread Lars George
That is spot on Stack, it is the worst case scenario as you describe, i.e. all cached information is stale. Lars On Aug 19, 2012, at 6:40 AM, Stack wrote: > On Sat, Aug 18, 2012 at 2:13 AM, Lin Ma wrote: >> Hello guys, >> >> I am referencing the Big Table paper about how a client locates a t