Re: HBase version

2011-12-26 Thread Harsh J
Hey Sambit, Your best bet is to use an append-supportive release, such as Apache Hadoop 0.20.205 (or Apache Hadoop 1.0.0 which is a revision on top of that, out soon). Do read http://hbase.apache.org/book.html#hadoop for explicit guidelines on selecting the right Hadoop version for HBase. With

HBase version

2011-12-26 Thread Sambit Tripathy
Hi, I am going to install HBase on my beowulf cluster which has hadoop 0.20.203.rc1 for test purposes. Which is the stable version of HBase that works along with hadoop-0.20.203.rc1? Any experiences so far? Thanks Sambit

Re: java.lang.UnsatisfiedLinkError

2011-12-26 Thread Greg Pelly
Hi, No need for the pardon:) Ok. I'll investigate getting the noexec taken off, I already have but everyone is on holidays. Thanks for all of your help. Cheers On Tue, Dec 27, 2011 at 4:14 PM, Stack wrote: > On Mon, Dec 26, 2011 at 6:17 PM, Greg Pelly wrote: > > Hi, > > > > The hbase.rootdir

Re: java.lang.UnsatisfiedLinkError

2011-12-26 Thread Stack
On Mon, Dec 26, 2011 at 6:17 PM, Greg Pelly wrote: > Hi, > > The hbase.rootdir was already using a folder under /var and since yesterday > I changed the HBASE_PID_DIR to use /var/hadoop/pids. > > The error hasn't changed at all. > Pardon me. Thats I thought you just wanted to change the hbase ho

Re: java.lang.UnsatisfiedLinkError

2011-12-26 Thread Greg Pelly
Hi, The hbase.rootdir was already using a folder under /var and since yesterday I changed the HBASE_PID_DIR to use /var/hadoop/pids. The error hasn't changed at all. Cheers On Tue, Dec 27, 2011 at 10:24 AM, Stack wrote: > On Sun, Dec 25, 2011 at 6:40 PM, Greg Pelly wrote: > > is there >

Re: Meta region hotspotting

2011-12-26 Thread Jack Levin
Some time ago, we had a situation where our REST server was slammed with queries that did not find any matches for rows in Hbase. When that happened we sustained 50k rpc/sec to META region server as reported by the master web page. After digging deeper we found that reach request with 'wrong' url

Re: hdfs-1623 Was: ceph and hbase.

2011-12-26 Thread Todd Lipcon
That's my github but I don't regularly push there -- so it's a bit out of date. Working from the apache svn is probably the best bet Todd On Sunday, December 25, 2011, Andrey Stepachev wrote: > Thanks! > > 25 декабря 2011 г. 3:13 пользователь Ted Yu написал: > >> Andrey: >> A quick search led m

Re: java.lang.UnsatisfiedLinkError

2011-12-26 Thread Stack
On Sun, Dec 25, 2011 at 6:40 PM, Greg Pelly wrote: > is there > any chance I could get hbase to use a different folder rather than tmp to > see if that fixes it? > See hbase.rootdir, the first config doc'd in http://hbase.apache.org/book.html#hbase.site St.Ack

Re: What's the scenario of manual hlog splitting?

2011-12-26 Thread Yifeng Jiang
Thanks Jon, Just for parallel log splitting. I got it. Yifeng On Dec 25, 2011, at 12:39 AM, Jonathan Hsieh wrote: > Yifeng, > > HLog splitting is used to when shutting down a region server or to recover > log edits after a region server goes down uncleanly. > > Prior to 0.92, if many region

Thrift architecture

2011-12-26 Thread Bob Smith
Hello - I am trying to figure out the best way to architect access to an HBase cluster from a multi-user system that has potentially thousands of processes all potentially reading and writing data from/to HBase. The multi-user system is a collection of processes written in C or C++ (essentially a c

Re: holes in tables.

2011-12-26 Thread Lars George
Hi Jack, Have a look into the JRuby source of that script. It is trivial to patch it so that it does what you want. Lars On Dec 26, 2011, at 19:15, Jack Levin wrote: > patch_meta.rb has some problems. I ran it, and it would create region > start/end combos, there were incorrect in terms of

Re: holes in tables.

2011-12-26 Thread Jack Levin
patch_meta.rb has some problems. I ran it, and it would create region start/end combos, there were incorrect in terms of order, for example "dab - cab", which is a region that is not right, because first key is greater than end key. I guess what I really need is a very simple tool, that takes som

Re: holes in tables.

2011-12-26 Thread Lars George
You could also have a go at https://issues.apache.org/jira/browse/HBASE-4009 Simple script based on the check_meta.rb to patch holes. Lars On Dec 26, 2011, at 4:23 AM, Ted Yu wrote: > OfflineMetaRepair class is in 0.90.5 > See HBASE-4377 > > But maybe you're looking for an online solution. >