Re: querying hbase

2013-05-21 Thread Jean-Marc Spaggiari
Using Phoenix for that is like trying to kill a mosquito with an atomic bomb, no? ;) Few easy to install and use tools which I already tried: - http://sourceforge.net/projects/haredbhbaseclie/files/ - http://sourceforge.net/projects/hbasemanagergui/ - https://github.com/NiceSystems/hrider/wiki Th

Re: querying hbase

2013-05-21 Thread lars hofhansl
Maybe Phoenix (http://phoenix-hbase.blogspot.com/) is what you are looking for. -- Lars From: Aji Janis To: user Sent: Tuesday, May 21, 2013 3:43 PM Subject: Re: querying hbase I haven't tried that because I don't know how to. Still I think I am looking for a

Re: Inconsistent Table HBCK

2013-05-21 Thread Jean-Marc Spaggiari
Hi Jay, Which 0.94 version are you running? 0.94.0? Or 0.94.7? JM 2013/5/21 Jay Talreja > One of our production clusters had several region server failures. As a > result one of the tables is in an inconsistent state as reported by hbck. > We have tried using hbck repair commands but none see

hbase region server shutdown after datanode connection exception

2013-05-21 Thread Cheng Su
Hi all. I have a small hbase cluster with 3 physical machines. On 192.168.1.80, there are HMaster and a region server. On 81 & 82, there is a region server on each. The region server on 80 can't sync HLog after a datanode access exception, and started to shutdown.

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Hi again ! Well.. to make this easier, Ive created a script which greps the hotspots in log files out and cleans them, restarting the entire cluster. Overall, it appears that my region servers cant see my hbase-master due to "closed connections", or something of that sort. These errors are n

Re: querying hbase

2013-05-21 Thread Aji Janis
I haven't tried that because I don't know how to. Still I think I am looking for a nice GUI interface that can take in HBase connection info and help me view the data something like pgadmin (or its php version), sql developer, etc On Tue, May 21, 2013 at 6:16 PM, Viral Bajaria wrote: > The shell

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
No problem. This is hadoop-metrics.properties: http://bin.cakephp.org/view/697496673 This is hbase-env.sh: http://bin.cakephp.org/view/693824872 This is hbase-policy.xml: http://bin.cakephp.org/view/1578555029 This is hbase-site.xml: http://bin.cakephp.org/view/175451749 This is log4j.properti

Re: querying hbase

2013-05-21 Thread Viral Bajaria
The shell allows you to use filters just like the standard HBase API but with jruby syntax. Have you tried that or that is too painful and you want a simpler tool ? -Viral On Tue, May 21, 2013 at 2:58 PM, Aji Janis wrote: > are there any tools out there that can help in visualizing data stored

querying hbase

2013-05-21 Thread Aji Janis
are there any tools out there that can help in visualizing data stored in Hbase? I know the shell lets you do basic stuff. But if I don't know what rowid I am looking for or if I want to rows with family say *name* (yes SQL like) are there any tools that can help with this? Not trying to use this o

Re: HBase is not running.

2013-05-21 Thread Jay Vyas
Here is my conf file.I wonder if maybe the problem is intercommunication between region servers? hbase.master hbase-master:6 The host and port that the HBase master runs at.

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jean-Daniel Cryans
I see: 2013-05-21 17:15:07,914 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_FAILED_OPEN, server=hbase-regionserver1,60020,1369170595340, region=70236052/-ROOT- Over and over. Look in the region server logs, you should see fat stack traces on why it's fa

Re: HBase is not running.

2013-05-21 Thread Mohammad Tariq
Is this the only thing which appears on your screen?Could you please show me your config files? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:49 AM, Yves S. Garret wrote: > This is what happens when I start hbase. > > $ bin/start-hbase.sh > starting master, logging to >

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
hmmm...all looks fine to me. we can do a few checks though to make sure everything is in place. start with making sure that all the RSs are properly up. Also make sure HDFS is out of safemode. What does " 192.168.122.200:60010" show? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 20

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
This is what happens when I start hbase. $ bin/start-hbase.sh starting master, logging to /media/alternative-storage-do-not-touch/hbase-0.94.7/logs/hbase-ysg-master-ysg.connect.out No real problems or error or warnings... but it does not have the same output that you have in your blog... perhaps

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
https://gist.github.com/anonymous/5623327 <-- all logs for starting up hbase and master On Tue, May 21, 2013 at 5:13 PM, Mohammad Tariq wrote: > No prob. I was referring to this : > > 127.0.0.1 hbase-master > 192.168.122.200 hbase-master > > I was thinking that this is your HBase master. Correc

Re: HBase is not running.

2013-05-21 Thread Mohammad Tariq
No issues. Are the HBase daemons running fine?Are you able to initiate anything from the shell? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:37 AM, Yves S. Garret wrote: > Hi, sorry, I thought I had more info than what was displayed in my > e-mail a little earlier toda

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
No prob. I was referring to this : 127.0.0.1 hbase-master 192.168.122.200 hbase-master I was thinking that this is your HBase master. Correct me if i'm wrong. Could you please show me your logs? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:36 AM, Jay Vyas wrote: > Hm

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Here is my new /etc/hosts file > 127.0.0.1 localhost.localdomain localhost4 localhost4.localdomain4 localhost > #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 > #127.0.0.1 hbase-master > 192.168.122.200 hbase-master > 192.168.122.201 hbase-regionserver1 > 192.168

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Hi, sorry, I thought I had more info than what was displayed in my e-mail a little earlier today that had the little list, but I did not. My biggest hangup is getting that Web GUI to work. That's really where I'm stuck. I followed your tutorial on the cloudfront blog and when it came time to go

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Hmmm... what do you mean "have your hostname in there"? sorry -- just curious about which hostname you are referring to...? Im now getting a new exception: 13/05/21 17:02:44 INFO client.HConnectionManager$HConnectionImplementation: getMaster attempt 2 of 7 failed; retrying after sleep of 1002

ETL tools

2013-05-21 Thread Aji Janis
Hello users, I am interested in hearing about what sort of ETL tools are you using with your cloud based apps. Ideally, I am looking ETL(s) with the following feature: -free (yup) -open-source/community support -handles different types of sources or atleast has plugins may be (email, rss, filesys

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
OK..You already have your hostname in there. But it is appearing twice. Comment out "127.0.0.1 hbase-master". This might be a reason. I did not notice that you are on a distributed setup. RS IPs and hostnames are fine. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:21 AM,

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Kevin O'dell
Hi Jay, I think Gmail is cutting that off for you as it doesn't show duplicate data. Here you go: #This is my /etc/hosts file --- 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Hi kevin : So you don't have any region servers defined in your /etc/hosts ? On Tue, May 21, 2013 at 4:46 PM, Mohammad Tariq wrote: > Sorry, my bad. By that I meant "127.0.0.1hostname"..To me it seems like > HBase is not able to connect to localhost using 127.0.0.1 > > Warm Regards, > Tariq

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Kevin O'dell
Jay, I am not sure if this is network related, but the host file doesn't look correct. Here is what I would add there: #This is my /etc/hosts file --- 127.0.0.1 localhost.localdomain localhost4 localhost4.localdomain4 localhost #::1 localhost.localdomain localhost6 localhost6.loc

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
Sorry, my bad. By that I meant "127.0.0.1hostname"..To me it seems like HBase is not able to connect to localhost using 127.0.0.1 Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:12 AM, Jay Vyas wrote: > Thanks, but adding 127.0.0.1 localhost to the top seems redundant

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Thanks, but adding 127.0.0.1 localhost to the top seems redundant... right? I did so but still no luck :(. 1) OS? This is fedora 16. 2) any thoughts on why the "PleaseHoldException" is being triggered ? On Tue, May 21, 2013 at 4:32 PM, Mohammad Tariq wrote: > OS?Add "127.0.0.1 localh

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
OS?Add "127.0.0.1 localhost" and see if it makes any difference. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 1:57 AM, Jay Vyas wrote: > #This is my /etc/hosts file --- > 127.0.0.1 localhost localhost.localdomain localhost4 > localhost4.localdomain4 > #::1 lo

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
#This is my /etc/hosts file --- 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 127.0.0.1 hbase-master 192.168.122.200 hbase-master 192.168.122.201 hbase-regionserver1 192.168.122.202 hbas

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
Hello Jay, Please change the line containing "127.0.1.1" in your /etc/hosts to "127.0.0.1" and see if it works. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 1:47 AM, Jay Vyas wrote: > Hi folks: > > Hope someone can shed some light on this - > > I cannot run "hbase

Re: HBase is not running.

2013-05-21 Thread Mohammad Tariq
sure.. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 1:48 AM, Yves S. Garret wrote: > Hello, > > No, still having issues. I'll give you some more details in a second. > > > On Tue, May 21, 2013 at 4:07 PM, Mohammad Tariq > wrote: > > > Hey Yves, > > > > I am sorr

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Hello, No, still having issues. I'll give you some more details in a second. On Tue, May 21, 2013 at 4:07 PM, Mohammad Tariq wrote: > Hey Yves, > > I am sorry for being unresponsive. I was travelling and was out of > reach. What's the current status?Are you good now? > > Warm Regards,

Re: HBase is not running.

2013-05-21 Thread Mohammad Tariq
Hey Yves, I am sorry for being unresponsive. I was travelling and was out of reach. What's the current status?Are you good now? Warm Regards, Tariq cloudfront.blogspot.com On Tue, May 21, 2013 at 11:15 PM, Asaf Mesika wrote: > Yes. > > On May 21, 2013, at 8:32 PM, "Yves S. Garret" >

Re: What is in BlockCache?

2013-05-21 Thread Jean-Daniel Cryans
The reference guide has a pretty good section about this: http://hbase.apache.org/book.html#block.cache What do you think is missing in order to fully answer your question? Thx, J-D On Mon, May 20, 2013 at 5:07 AM, yun peng wrote: > Hi, All, > I am wondering what is exactly stored in BlockCach

Re: How does client connects to Hbase server

2013-05-21 Thread Jean-Daniel Cryans
I guess you are referring to http://hbase.apache.org/book.html#client_dependencies ? The thing is by default hbase.zookeeper.quorum is localhost, so your client will look at your local machine to find HBase if you don't configure anything. J-D On Tue, May 21, 2013 at 10:50 AM, Vimal Jain wrote:

Re: How does client connects to Hbase server

2013-05-21 Thread Shahab Yunus
A default hbase-site.xml is provided in all hbase installations. Plus and more importantly, you are running the Standalone mode so there is no need any information regarding zookeeper or HBase Master server. Everything is local. Regards, Shahab On Tue, May 21, 2013 at 1:50 PM, Vimal Jain wrote:

How does client connects to Hbase server

2013-05-21 Thread Vimal Jain
Hi, I am newbie to both Hadoop and Hbase technologies. I have setup Hbase properly in Standalone mode. I am unable to understand work flow when a client (Java program accessing Hbase) connects to Hbase Server. Documentations and Books say that the client should have hbase-site.xml in its classpath

Re: HBase is not running.

2013-05-21 Thread Asaf Mesika
Yes. On May 21, 2013, at 8:32 PM, "Yves S. Garret" wrote: > Do you mean this? > > http://blog.devving.com/hbase-quickstart-guide/ > > > On Tue, May 21, 2013 at 1:29 PM, Asaf Mesika wrote: > >> Devving.com has a good tutorial on HBase first setup >> >> On Tuesday, May 21, 2013, Yves S. Gar

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Do you mean this? http://blog.devving.com/hbase-quickstart-guide/ On Tue, May 21, 2013 at 1:29 PM, Asaf Mesika wrote: > Devving.com has a good tutorial on HBase first setup > > On Tuesday, May 21, 2013, Yves S. Garret wrote: > > > Hi Mohammad, > > > > I was following your tutorial and when I g

Re: HBase is not running.

2013-05-21 Thread Asaf Mesika
Devving.com has a good tutorial on HBase first setup On Tuesday, May 21, 2013, Yves S. Garret wrote: > Hi Mohammad, > > I was following your tutorial and when I got to the part when you do > $ bin/start-hbase.sh, this is what I get: > http://bin.cakephp.org/view/428090088 > > I'll keep looking on

HBase BoF around Hadoop Summit, San Jose, 2013

2013-05-21 Thread Devaraj Das
I am hosting a meetup on the 25th of June (a day before the Hadoop Summit). People interested in talking about HBase usecases, experience, new features, etc. - please get in touch with me. http://www.meetup.com/hbaseusergroup/events/119154442/

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
On Tue, May 21, 2013 at 10:00 AM, Yves S. Garret wrote: > Ok, it seems to be working now. I changed my environment variables > as a result. However, when I try to get the web GUI to work, it doesn't > work :) . That's where I'm stuck right now. > > > On Tue, May 21, 2013 at 9:21 AM, Yves S. Ga

Re: Help with Read Latency Metrics Interpretation

2013-05-21 Thread Jeremy Carroll
There are more items then data in the BlockCache. There are bloom filters, indexes, and data. You should look at your blockCacheHitCount for each of these item times. You may have a high hit rate on blooms, but low on data for example. The fsRead metrics are for items that read from disk. Not item

Help with Read Latency Metrics Interpretation

2013-05-21 Thread amit.mor.m...@gmail.com
I am on EC2, with HBase 0.94.2 and I can't find an explanation to this phenomena: I'm having these metrics on my RegionServers: blockCacheHitRatio=87% fsReadLatencyHistogramMean= 5886103.47 fsReadLatencyHistogramMedian=6280445 fsReadLatencyHistogram75th= 28117916.5 fsReadLatencyHistogram95th= 536

Inconsistent Table HBCK

2013-05-21 Thread Jay Talreja
One of our production clusters had several region server failures. As a result one of the tables is in an inconsistent state as reported by hbck. We have tried using hbck repair commands but none seem to work. There is one region that is stuck in a forever pending open state. The error reported i

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Ok, it seems to be working now. I changed my environment variables as a result. However, when I try to get the web GUI to work, it doesn't work :) . That's where I'm stuck right now. On Tue, May 21, 2013 at 9:21 AM, Yves S. Garret wrote: > Also, I keep hearing that Java 6 is required. Curren

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Also, I keep hearing that Java 6 is required. Currently I have Java 7 installed. Is this an issue or do I need to downgrade? On Tue, May 21, 2013 at 9:18 AM, Yves S. Garret wrote: > Hi Mohammad, > > I was following your tutorial and when I got to the part when you do > $ bin/start-hbase.sh, th

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Hi Mohammad, I was following your tutorial and when I got to the part when you do $ bin/start-hbase.sh, this is what I get: http://bin.cakephp.org/view/428090088 I'll keep looking online for an answer, but was I supposed to do something else besides this? This is the contents of my bashrc: http: