Re: How to debug and run hadoop/HBase source code in eclipse

2011-09-02 Thread vamshi krishna
Oh..thank you Doug. On Fri, Sep 2, 2011 at 8:04 PM, Doug Meil wrote: > > One more thing: > > re: "most of the users subscribed in this mailing-list are trying to > modify the actual source code to add extra functionality to hadoop/Hbase" > > Not really. The "user" dist-list is for people who ar

Re: PENDING_CLOSE for too long

2011-09-02 Thread Stack
Are you having trouble getting to any of your data out in tables? To get rid of them, try restarting your master. Before you restart your master, do "HBASE-4126 Make timeoutmonitor timeout after 30 minutes instead of 3"; i.e. set "hbase.master.assignment.timeoutmonitor.timeout" to 180 in hba

2 node cluster

2011-09-02 Thread Honglin Li
Hi, all, If I have a two-node HBase deployed with a one-node zookeeper, if the node with the zookeeper goes down, can I just relaunch Hadoop, HBase with new zookeeper on the 2nd node itself to continue the service? The real question is: is there persistent data in the old zookeeper that is n

HBase Backups / Problem using Export/Import Job HBase 0.20.3 -> s3n -> HBase 0.90 (CDH3) DroppedSnapshotException

2011-09-02 Thread Robert J Berger
We've been working on a Backup / Restore program Hbacker (https://github.com/rberger/hbacker) that uses the HBase Hadoop Export/Import jobs. Its pretty tuned to our use case (we just do appends, never delete, this allows us to do very simple incremental backups). Its still really rough and onl

Re: HBase and Cassandra on StackOverflow

2011-09-02 Thread Time Less
> > Can't we just all get along? :-) > ... > So, no, frankly we cannot get along. If this were a passionless technical > discussion that would not be the case. However, from my perspective, which I > believe is shared by others on the HBase side, the Cassandra project is run > by asshats and some o

PENDING_CLOSE for too long

2011-09-02 Thread Geoff Hendrey
In the master logs, I am seeing "regions in transition timed out" and "region has been PENDING_CLOSE for too long, running forced unasign". Both of these log messages occur at INFO level, so I assume they are innocuous. Should I be concerned? -geoff

hbase-0.91.0-SNAPSHOT.tar.gz Distribution

2011-09-02 Thread Trey Spiva
I was reading the quick start to learn about hbase. The quickstart send you to the apache download mirrors to download the hbase 0.91.0 snapshot. However, when I go the stable directory of the suggested mirror I only find a link to the file hbase-0.90.4.tar.gz. Was the 0.91.0 snapshot removed

Fwd: HBase troubleshooting

2011-09-02 Thread Stack
This message was sent to issues. I'm forwarding it to the appropriate list. St.Ack -- Forwarded message -- From: Dmitry Kangin Date: 2011/9/1 Subject: HBase troubleshooting To: iss...@hbase.apache.org Hello everyone! We started using hbase (hadoop) system and faced some perfor

RE: HBase 0.90.4 missing from Maven repository?

2011-09-02 Thread Terry Siu
Thanks, St.Ack! However, I just checked the repo and I still don't see 0.90.4. -Terry -Original Message- From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Wednesday, August 31, 2011 4:07 PM To: user@hbase.apache.org Subject: Re: HBase 0.90.4 missing from Mave

Re: Can you go from 90.4 to 90.2?

2011-09-02 Thread Jacques
Ok, thanks. On Thu, Sep 1, 2011 at 10:38 PM, Stack wrote: > I think so. I haven't tried it. Can't think of any destructive > change that would prevent your going backward but would suggest you > check the differences. > St.Ack > > On Thu, Sep 1, 2011 at 10:17 PM, Jacques wrote: > > It was my

Re: HBase and Cassandra on StackOverflow

2011-09-02 Thread Jacques
Don't forget that Gluster just released a beta open source Hadoop connector. Their "we'll just a dip a toe in the hadoop community" approach doesn't inspire confidence. On the other hand, they have a decent track record regarding larger HA file system setups and offer many things that MapR offers

Counter columns in hbase

2011-09-02 Thread sagar naik
Hi , We are counting events for our application. Sometimes, the same event arrives multiple times. This leads to counting of same event multiple times. Is there a way I can avoid this ? (Say timestamp on value or filters ?) We also want to do a bulk upload on counters. MR generating the aggregat

Re: HBase and Cassandra on StackOverflow

2011-09-02 Thread Ryan Rawson
On Fri, Sep 2, 2011 at 10:27 AM, Joseph Pallas wrote: > Drifting off topic a bit … > > On Sep 1, 2011, at 12:12 PM, Ryan Rawson wrote: > >>> First, you have to learn: >>> 1) Linux HA >>> 2) DRDB >>> >>> Right out of the gate just to have a redundant name node. >> >> Eh, no one would do that.  If y

Re: HBase and Cassandra on StackOverflow

2011-09-02 Thread Joseph Pallas
Drifting off topic a bit … On Sep 1, 2011, at 12:12 PM, Ryan Rawson wrote: >> First, you have to learn: >> 1) Linux HA >> 2) DRDB >> >> Right out of the gate just to have a redundant name node. > > Eh, no one would do that. If you want a redundant name node your only > choice is to use Mapr, w

Re: Incremental pre-aggregation strategy with MapReduce

2011-09-02 Thread Sonal Goyal
Could you give some insights into the kind of measurements you are saving and a sample aggregate? Best Regards, Sonal Crux: Reporting for HBase Nube Technologies On Fri, Sep 2, 2011 at 9:29 P

Re: Incremental pre-aggregation strategy with MapReduce

2011-09-02 Thread Doug Meil
What Stack says. Plus, for other tips see... http://hbase.apache.org/book.html#mapreduce http://hbase.apache.org/book.html#schema On 9/2/11 11:15 AM, "Stack" wrote: >Can you rely on versioning? If MR job runs once a day, only aggregate >whats changed in last day? > >Turn off speculative

Re: Incremental pre-aggregation strategy with MapReduce

2011-09-02 Thread Stack
Can you rely on versioning? If MR job runs once a day, only aggregate whats changed in last day? Turn off speculative execution. You'll need a means of dealing with MR jobs failing; i.e. throw away the aggregations done by the failed job rather than have the aggregations done by the failed job(s

Re: How to debug and run hadoop/HBase source code in eclipse

2011-09-02 Thread Doug Meil
One more thing: re: "most of the users subscribed in this mailing-list are trying to modify the actual source code to add extra functionality to hadoop/Hbase" Not really. The "user" dist-list is for people who are running Hbase and have operational questions (e.g., config, performance, trouble

Re: Connect In HBase

2011-09-02 Thread Diego Gomes Araújo
I had read, but I miss the part that shows how to configure a client to the HBAs. thanks Doug! -- Diego Gomes Araujo -- Bacharel em Sistemas de Informação -- Analista de Sistemas -- Sun Certified Java Programmer 6 (SCJP) -- Contato: +55 91 8196-4388 -- http://housesoftware.blogspot.com 2011/9/

Re: How to debug and run hadoop/HBase source code in eclipse

2011-09-02 Thread Doug Meil
Also, see this... http://hbase.apache.org/book.html#developer On 9/2/11 12:38 AM, "Li Pi" wrote: >So you can't run HBase within eclipse, though you can run all the test >cases. > >git pull HBase, then do mvn eclipse:eclipse, this should setup an eclipse >project in the directory. > >to comp

Re: Connect In HBase

2011-09-02 Thread Doug Meil
Hi there- Have you read this? http://hbase.apache.org/book.html#client_dependencies On 9/2/11 9:53 AM, "Diego Gomes Araújo" wrote: >Hello! > >I'm having the following doubts, how do I connect in my HBase straight >from >my java web application. > >For example: >I have my java web applica

Connect In HBase

2011-09-02 Thread Diego Gomes Araújo
Hello! I'm having the following doubts, how do I connect in my HBase straight from my java web application. For example: I have my java web application running on the server (A), and I have a cluster that can represent HBase pola letter (B). How do I use the service HBase located in the cluster

RE: Tall-Narrow vs. Flat-Wide Tables

2011-09-02 Thread Srikanth P. Shreenivas
Thanks Dave. In that case, I guess a correction needs to be done in HBase Definitive Guide's first chapter (http://ofps.oreilly.com/titles/9781449396107/intro.html), where it states: As opposed to the limit on column families there is no such thing for the number of columns: you could have

RE: Get query in REST for HBASE

2011-09-02 Thread Stuti Awasthi
Hi, Thanks Andrew for the pointers. It worked after decoding from base-64. Stuti -Original Message- From: Andrew Purtell [mailto:apurt...@apache.org] Sent: Thursday, September 01, 2011 6:21 PM To: user@hbase.apache.org Subject: Re: Get query in REST for HBASE Because keys in HBase are b