Re: rest reverse scan

2014-07-24 Thread boci
Yeah, that's me :) 2014.07.24. 23:55 ezt írta ("Jonathan Hsieh" ): > Looks like someone filed an feature request for this here : > > https://issues.apache.org/jira/browse/HBASE-11577 > > Please follow up there/ > > > On Tue, Jul 22, 2014 at 4:36 PM, boci wrote: > > > Hi guys, > > > > I see in the

Re: Re: hbase server exception

2014-07-24 Thread b...@foxmail.com
>< thanks,i will try unit test b...@foxmail.com From: Ted Yu Date: 2014-07-25 13:53 To: user@hbase.apache.org Subject: Re: hbase server exception Hit Send too soon. More information is needed before we know whether fix for HBASE-11234 would solve the problem you're facing. Cheers On T

Re: hbase server exception

2014-07-24 Thread Ted Yu
Hit Send too soon. More information is needed before we know whether fix for HBASE-11234 would solve the problem you're facing. Cheers On Thu, Jul 24, 2014 at 9:51 PM, Ted Yu wrote: > How often do you see this error ? > Is it possible to encapsulate the scenario using unit test ? > > I am not

Re: hbase server exception

2014-07-24 Thread Ted Yu
How often do you see this error ? Is it possible to encapsulate the scenario using unit test ? I am not certain HBASE-11234 On Jul 24, 2014, at 9:37 PM, "b...@foxmail.com" wrote: > i use cdh hbase > 0.96.1.1,http://archive.cloudera.com/cdh5/cdh/5/hbase-0.96.1.1-cdh5.0.2.releasenotes.html >

Re: Re: hbase server exception

2014-07-24 Thread b...@foxmail.com
i use cdh hbase 0.96.1.1,http://archive.cloudera.com/cdh5/cdh/5/hbase-0.96.1.1-cdh5.0.2.releasenotes.html no this patch so i add this path and rebuid hbase,restart regionServer will solve ths problem?don't need to empty the data thanks b...@foxmail.com From: Ted Yu Date: 2014-07-25 13:20

Re: hbase server exception

2014-07-24 Thread Ted Yu
The error indicates there was bug in prefix tree module. Does the 0.96 release you use include fix for HBASE-11234 ? Cheers On Thu, Jul 24, 2014 at 9:11 PM, b...@foxmail.com wrote: > my hbase version is 0.96,and regionServer throw this exception,is this a > bug? > > 2014-07-25 13:04:07,494 ER

hbase server exception

2014-07-24 Thread b...@foxmail.com
my hbase version is 0.96,and regionServer throw this exception,is this a bug? 2014-07-25 13:04:07,494 ERROR [regionserver60020-largeCompactions-1406165462536] regionserver.CompactSplitThread: Compaction failed Request = regionName=t2013,15100405147|1386470415000|472507379770398,1406208607841.76

Re: Help needed on writing custom load balancer

2014-07-24 Thread Ted Yu
For #2, I searched in 0.94 and trunk but didn't find call to immediateAssignment method except in tests. For #3, please take a look at 17.3.1.1. under http://hbase.apache.org/book.html#node.management. Cheers On Thu, Jul 24, 2014 at 5:45 PM, gomes wrote: > > I have few questions, if you can h

Help needed on writing custom load balancer

2014-07-24 Thread gomes
I have few questions, if you can help me that will be great. 1. I am writing my own custom load balancer against the LoadBalancer in Hbase 0.94.6.1. I want to place a group of regions from different tables on same host. I was able to achieve this with balanceCluster, and retainAssignment method

Re: BucketCache Configuration

2014-07-24 Thread Jane Tao
Hi Stack, We are using Hbase 0.96.1.1+cdh5.0.1+68. In hbase-site.xml: hbase.bucketcache.ioengine offheap hbase.bucketcache.percentage.in.combinedcache 0.8 hbase.bucketcache.size 4 The Java heap size for region server is 32G. The MaxDirectMemorySize is 4

Re: Where can I find hbase-0.99-SNAPSHOT (binary)

2014-07-24 Thread Ted Yu
On Jul 24, 2014, at 2:08 PM, yun peng wrote: > Hi, > > I need the HBase-0.99-SNAPSHOT, more specifically the following two jars, > because of an open-source project depends on them. > > org.apache.hbase:hbase-testing-util:jar:0.99.0-SNAPSHOT > org.apache.hbase:hbase-client:jar:0.99.0-SNAPSHOT

Re: Where can I find hbase-0.99-SNAPSHOT (binary)

2014-07-24 Thread Ted Yu
You can build these jar files from branch-1 Cheers On Jul 24, 2014, at 2:08 PM, yun peng wrote: > Hi, > > I need the HBase-0.99-SNAPSHOT, more specifically the following two jars, > because of an open-source project depends on them. > > org.apache.hbase:hbase-testing-util:jar:0.99.0-SNAPSHOT

Where can I find hbase-0.99-SNAPSHOT (binary)

2014-07-24 Thread yun peng
Hi, I need the HBase-0.99-SNAPSHOT, more specifically the following two jars, because of an open-source project depends on them. org.apache.hbase:hbase-testing-util:jar:0.99.0-SNAPSHOT org.apache.hbase:hbase-client:jar:0.99.0-SNAPSHOT I have tried to download the latest source which is newer t

Re: rest reverse scan

2014-07-24 Thread Jonathan Hsieh
Looks like someone filed an feature request for this here : https://issues.apache.org/jira/browse/HBASE-11577 Please follow up there/ On Tue, Jul 22, 2014 at 4:36 PM, boci wrote: > Hi guys, > > I see in the documentation java Scan api support reverse scan (so I think I > can fetch the latest

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Arpit Agarwal
+Hbase User On Wed, Jul 23, 2014 at 11:04 PM, Shankar hiremath < shankar.hirem...@huawei.com> wrote: > Dear All, > > Observation: > I have HBase cluster with Kerberos enabled, when the Region Server > startups then we observed some 20-30 socket fds are in CLOSE_WAIT state, > After that when the

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Andrew Purtell
After trying Esteban's suggestion, please also generate a listing using 'lsof -nP' to turn off hostname and port name resolution. No idea here what those port numbers "busboy" or "eforward" map to. Important to determine if those are HBase or HDFS service ports. On Thu, Jul 24, 2014 at 11:00 AM,

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Esteban Gutierrez
Shankar, seems that those close_wait are bound to ipv6, have you tried to disable ipv6 first? (-Djava.net.preferIPv4Stack=true) Regards, Esteban. -- Cloudera, Inc. On Thu, Jul 24, 2014 at 5:02 AM, Shankar hiremath < shankar.hirem...@huawei.com> wrote: > I am using Hbase 0.98.3 and Hadoop 2

Re: HFile Reader in 0.96 and 0.98

2014-07-24 Thread Esteban Gutierrez
Hi Guillermo, If you need a portable way to access HFiles, lets say in a MR job the TableSnapshotInputFormat is the best option if that works for your use case. Otherwise if you still want to use HFile.createReader() across major releases of HBase you might want to use reflection to verify if the

Manually control regionserver hostname

2014-07-24 Thread Tom Brown
Hello, I wish to manually specify the hostname that the master uses to address a particular regionserver. My machines have multiple names (a friendly one, and an internal VMish one). Both names resolve just fine within the environment, but only the friendly ones resolve from outside the environmen

Re: Not able to put Twitter4j.Place object attributes from scala application

2014-07-24 Thread Ted Yu
Do you see any exception in region server logs ? Which release of hbase are you using ? Cheers On Jul 24, 2014, at 3:11 AM, reddibabu wrote: > Hi, > > I am working on Twitter API for retrieve the twitter information and store > those details into Hbase table. > Here, I am not able to put twit

Not able to put Twitter4j.Place object attributes from scala application

2014-07-24 Thread reddibabu
Hi, I am working on Twitter API for retrieve the twitter information and store those details into Hbase table. Here, I am not able to put twitter4j.Place attributes into Hbase table, I am able to retrieve Place and GeoLocation properties from Twitter API and able to see on Client application. The

Re: HFile Reader in 0.96 and 0.98

2014-07-24 Thread Ted Yu
HFile is marked with @InterfaceAudience.Private Can you tell us a bit more about your use case ? Thanks On Jul 24, 2014, at 3:52 AM, Guillermo Ortiz wrote: > Hi, > > I am trying to make compatible HBase 0.96 with 0.98 but, I have seen that > the HFile.createReader has a new parameter "Configu

RE: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Shankar hiremath
I am using Hbase 0.98.3 and Hadoop 2.4.1 Regards -Shankar This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not lim

Re: How to monitor HBase Region Server ?

2014-07-24 Thread Wellington Chevreuil
The master and region servers UI on hbase 0.98 provide all these details. You can access your master UI and from there navigate through your RS for specific details. http://YOUR-MASTER-HOST:60010/ On 24 Jul 2014, at 12:12, Pham Phuong Tu wrote: > Hi guys, > > I want to monitor deep aspect

HFile Reader in 0.96 and 0.98

2014-07-24 Thread Guillermo Ortiz
Hi, I am trying to make compatible HBase 0.96 with 0.98 but, I have seen that the HFile.createReader has a new parameter "Configuration". I have been looking for another way to get an Hfile.Reader from two versions with the same code but I think that it's not possible, is there another way to get

How to monitor HBase Region Server ?

2014-07-24 Thread Pham Phuong Tu
Hi guys, I want to monitor deep aspect ()of Hbase like Hannibal ( https://github.com/sentric/hannibal), this tool isn't support for Hbase 0.98. So, how can monitor these things: - Region distributon - Region split per table - Number of storefile - Size of the memstore - Size of the storefiles - C

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Qiang Tian
what is your hbase version? the close_wait is in regionserver process, probably rpc connection close() is not call due to some reason? can you pastebin the related regionserver log? On Thu, Jul 24, 2014 at 3:16 PM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Sorry about tha

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread ramkrishna vasudevan
Sorry about that. https://issues.apache.org/jira/browse/HBASE-9393. Similar issue has been reported. What version of HBase and HDFS are you using? See if things are similar. Regards Ram On Thu, Jul 24, 2014 at 12:33 PM, Shankar hiremath < shankar.hirem...@huawei.com> wrote: > Hi Ram, > > Act

RE: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Shankar hiremath
Hi Ram, Actually It is not file FD, it is socket FD which is in CLOSE_WAIT state (tcp socket connection) > java18028 shankar1 194u IPv6 18548560 0t0 TCP > XX-XX-XX-XX:62675->XX-XX-XX-XX:busboy (CLOSE_WAIT) Regards -Shankar This e-mail and its attachments contain confidential infor