Re: Anybody Familiar with REST+Hbase?

Yes. On Wed, Mar 23, 2011 at 10:08 PM, Robert J Berger wrote: > Does this replace stargate for 0.90+? I'm currently using stargate with > 0.20.3 > Thanks > Rob > > On Mar 22, 2011, at 7:02 AM, Ted Yu wrote: > >> See: >> http://hbase.apache.org/docs/current/api/org/apache/hadoop/hbase/rest/pa

Re: Anybody Familiar with REST+Hbase?

Does this replace stargate for 0.90+? I'm currently using stargate with 0.20.3 Thanks Rob On Mar 22, 2011, at 7:02 AM, Ted Yu wrote: > See: > http://hbase.apache.org/docs/current/api/org/apache/hadoop/hbase/rest/package-summary.html > > On Tue, Mar 22, 2011 at 2:07 AM, sreejith P. K. wrote:

Re: HRegionserver memory usage

After making below changes. It shows "heapdumponoutofmemoryerror". On Thu, Mar 24, 2011 at 8:54 AM, Shahnawaz Saifi wrote: > Thank you, I changed heap size to 4GB and enabled gc. Along this also > defined : > export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS $HBASE_JMX_BASE > -Dcom.sun.man

Re: HRegionserver memory usage

Thank you, I changed heap size to 4GB and enabled gc. Along this also defined : export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS $HBASE_JMX_BASE -Dcom.sun.management.jmxremote.port=10102 -Xmx5120m" Will check the performance. -Shah On Thu, Mar 24, 2011 at 6:23 AM, Buttler, David wrote:

RE: HRegionserver memory usage

You might want to think about upping your hbase heap size to at least 4GB, preferably 8GB. That only leaves about 6-7GB for map/reduce tasks (1 GB for data node, 1 GB for OS), but unless you have a lot of them or are doing extremely memory intensive operations it will be better. Also, consider

Re: zk connection leak with TableInput/OutputFormat (CDH3b4, 0.90.1)

Hi Dmitriy, Are you submitting these MR jobs on a cluster? Which machines are leaking the connections? Is it the cluster nodes or the node where you submitted the job? After a job is complete, the JVMs that ran the tasks should be completely torn down and thus should not be able to hang onto a co

Re: Region server crashes when using replication

On Wed, Mar 23, 2011 at 3:22 PM, Eran Kutner wrote: > They are using two separate ensembles, 3 servers in each. I'm trying to > create total independence for each cluster. Can you find out who deleted the znode that the region server failed on? If it reported the status a few times before that, i

Re: Region server crashes when using replication

(ugh last email bounced 3 TIMES with spam score too high, something weird is going on so clearing all old text) That really sounds like a different issue, and more inline with what I guessed earlier, that some other region server is deleting the znode under that region server. I would think of a c

Re: zk connection leak with TableInput/OutputFormat (CDH3b4, 0.90.1)

yes i am passing destroyProxy=true. But according to the code, it doesn't affect closing zookeeper connection (it should be closed anyway) but i have +1 zk connection each time i run the MR job still. -d On Wed, Mar 23, 2011 at 2:22 PM, Ted Yu wrote: > I assume you passed true as second paramet

Re: zk connection leak with TableInput/OutputFormat (CDH3b4, 0.90.1)

I assume you passed true as second parameter to deleteConnection(). On Wed, Mar 23, 2011 at 1:54 PM, Dmitriy Lyubimov wrote: > Hi, > > I am experiencing severe connection leak in my MR client that uses > Hbase as input/output . Every job that uses TableInputFormat leaks 1 > zookeeper connection

zk connection leak with TableInput/OutputFormat (CDH3b4, 0.90.1)

Hi, I am experiencing severe connection leak in my MR client that uses Hbase as input/output . Every job that uses TableInputFormat leaks 1 zookeeper connection per run as evidenced by netstat. I understand that the way HTable manages connections now is it creates a new HBase (and also Zookeeper)

Re: hadoop/HDFS append release?

Its looking like 0.22 hadoop will be the first 'official' Apache release with append. HBase 0.90.x won't work with it but 0.92.x will (Intent is to have 0.92.x work on 0.22 and 0.20) St.Ack On Wed, Mar 23, 2011 at 11:45 AM, Joe Pallas wrote: > Does anyone know what the timeline is for an offici

hadoop/HDFS append release?

Does anyone know what the timeline is for an official release of HDFS with append support (hadoop 0.22?) and whether HBase will be compatible with it? The hbase doc says it won't work with 0.22.x “as of this writing.” Thanks. joe

RE: Timestamp question

Thanks -Original Message- From: jdcry...@gmail.com [mailto:jdcry...@gmail.com] On Behalf Of Jean-Daniel Cryans Sent: Wednesday, March 23, 2011 11:13 AM To: user@hbase.apache.org Subject: Re: Timestamp question The timestamp is used by HBase to control versions, it just happens to be expo

Re: Timestamp question

The timestamp is used by HBase to control versions, it just happens to be exposed to the user. J-D On Wed, Mar 23, 2011 at 11:01 AM, Peter Haidinyak wrote: > Hi, >   If I'm not using the timestamp for anything can I used it to store data? > > Thanks > > -Pete >

Timestamp question

Hi, If I'm not using the timestamp for anything can I used it to store data? Thanks -Pete

Re: Connecting to HBase from OSGi

Thank you for your answers! I got a bit further, yet now I'm struggling with zookeeper. I'm getting a NullPointerException when calling ZookeeperWrapper.getZookeeperClusterKey. Any ideas on what this means? Could this be a configuration problem? Kind regards, Niels On Wed, 2011-03-23 at 10:35 -

Re: Connecting to HBase from OSGi

Yes you can, I use Felix and Eclipse Virgo Blueprint in my app, and it connects to HBase. The HBase and Hadoop jars are not bundles, however, so you will need to either put them on the boot classpath, package them inside your bundle jar, or turn them into bundles yourself. On Mar 21, 2011, at 1

Re: Region server crashes when using replication

On Wed, Mar 23, 2011 at 4:54 AM, Eran Kutner wrote: > I tried that, but still get the same result with the 0.90.2 build. The worst > part is that region server fails, then another one tries to take over and > also fails, until the entire cluster is down. The fact that a replication > failure such

google snappy

Hey my fellow hadoop/hbase developers, I just came across this google compression/decompression package yesterday, could we make a good use of this compression scheme in hadoop? It's written in C++ though. http://code.google.com/p/snappy/ I haven't looked close

Re: Region containing .META. frozen

Please take a jstack next time. What version of jvm are you using. If older, < u21, and no apparent reason for the RegionServer lockup, then it might be a JVM issue. Try adding -XX:+UseMembar to your HBASE_OPTS (We've seen at least one case of RegionServer lockup because of missed notifications).

Re: File formats in Hadoop

I was exploring different file formats in hadoop initially but somehow the search spanned into hbase i guess Sorry for the confusion Ryan :D On Wed, Mar 23, 2011 at 7:18 AM, Harsh J wrote: > On Wed, Mar 23, 2011 at 8:36 AM, Ryan Rawson wrote: > > Curious, why do you mention "SequenceFile" and "

Re: File formats in Hadoop

On Wed, Mar 23, 2011 at 8:36 AM, Ryan Rawson wrote: > Curious, why do you mention "SequenceFile" and "TFile".  Neither of > those are either in the hbase.io, and TFile is not used anywhere in > HBase. A cross-posting side-effect, I guess :-) -- Harsh J http://harshj.com

Region containing .META. frozen

Hi all, We are using CDH3B4. The RegionServer containing .META. stopped working under normal load. The region server process was up, it could be viewed in hbase admin interface, but the requests, regions, usedHeap, maxHeap metrics were constant in time and it couldn't be accessed. Other machi