Re: Lost regions question

2013-04-12 Thread Brennon Church
ing i would like to ask is was the cluster brought down abruptly by killing the RS. Which version of HBase? Regards Ram On Fri, Apr 12, 2013 at 11:20 AM, Brennon Church wrote: Hello, I had an interesting problem come up recently. We have a few thousand regions across 8 datanode/regionse

Re: Lost regions question

2013-04-12 Thread Brennon Church
read the data. Some logs could tell us what made the parent to get reopened rather than daughters. Another thing i would like to ask is was the cluster brought down abruptly by killing the RS. Which version of HBase? Regards Ram On Fri, Apr 12, 2013 at 11:20 AM, Brennon Church wrote

Lost regions question

2013-04-11 Thread Brennon Church
Hello, I had an interesting problem come up recently. We have a few thousand regions across 8 datanode/regionservers. I made a change, increasing the heap size for hadoop from 128M to 2048M which ended up bringing the cluster to a complete halt after about 1 hour. I reverted back to 128M a

Compaction timing and recovery from failure

2013-03-25 Thread Brennon Church
Everyone, I recently had a couple compactions, minors that were promoted to majors, take 8 and 10 minutes each. I eventually killed the regionserver underneath them as I'd never seen compactions last that long before. In looking through the logs from the regionserver that was killed and wat

Re: Question about compactions

2013-03-21 Thread Brennon Church
-Daniel Cryans wrote: On Thu, Mar 21, 2013 at 6:46 AM, Brennon Church wrote: Hello all, As I understand it, a common performance tweak is to disable major compactions so that you don't end up with storms taking things out at inconvenient times. I'm thinking that I should just write a

Question about compactions

2013-03-21 Thread Brennon Church
Hello all, As I understand it, a common performance tweak is to disable major compactions so that you don't end up with storms taking things out at inconvenient times. I'm thinking that I should just write a quick script to rotate through all of our regions, one at a time, and compact them.

Re: Throttle replication speed in case of datanode failure

2013-01-17 Thread Brennon Church
at 9:54 AM, Brennon Church wrote: Hello, Is there a way to throttle the speed at which under-replicated blocks are copied across a cluster? Either limiting the bandwidth or the number of blocks per time period would work. I'm currently running Hadoop v1.0.1. I

Throttle replication speed in case of datanode failure

2013-01-17 Thread Brennon Church
Hello, Is there a way to throttle the speed at which under-replicated blocks are copied across a cluster? Either limiting the bandwidth or the number of blocks per time period would work. I'm currently running Hadoop v1.0.1. I think the dfs.namenode.replication.work.multiplier.per.iteratio

Re: HBase table affinity to host(s)

2012-12-23 Thread Brennon Church
ind a patch which does per table load balancing. You can modify that code to move regions of selected table to pre-defined group of servers (specified through configuration). Cheers On Fri, Dec 21, 2012 at 11:01 PM, Brennon Church wrote: I do allow regions from other tables on the newer servers.

Re: HBase table affinity to host(s)

2012-12-21 Thread Brennon Church
up of region servers. Development for 0.94 is on-going, to my knowledge. Cheers On Fri, Dec 21, 2012 at 7:30 PM, Brennon Church wrote: 0.92.0 I was looking at the balancer option. I'm loathe to turn the automatic balancer off and handle it manually as we have a lot of regions. Is

Re: HBase table affinity to host(s)

2012-12-21 Thread Brennon Church
is no such capability - you may need to customize load balancer. What version of HBase are you using ? Cheers On Fri, Dec 21, 2012 at 3:54 PM, Brennon Church wrote: I'm curious, is there any concept of hosting regions from a given table only on a single host or subset of hosts in a cluste

HBase table affinity to host(s)

2012-12-21 Thread Brennon Church
I'm curious, is there any concept of hosting regions from a given table only on a single host or subset of hosts in a cluster? In our case we have a heavily-used table that can cause problems for the older systems in our cluster. Newer systems would have less trouble, so I'd like to restrict

Log errors about META

2012-12-10 Thread Brennon Church
Hello, I had some interesting trouble a couple days ago that I'm trying to track down. Can anyone help me identify what would have caused the following log entries? They showed up for about 1 hour, eventually going away without my having done anything. The last time I see such entries in my