Re: How and where exactly LSM trees are used in HBase?

2013-12-07 Thread Ted Yu
Searching for 'lsm tree hbase' would give you several articles. I am in China - the search results are mostly in Chinese. You should be able to read this: http://stackoverflow.com/questions/13762992/log-structured-merge-tree-in-hbase Cheers On Wed, Dec 4, 2013 at 6:49 PM, AnilKumar B wrote:

Re: Does HBase Java Client compatible to all the hbase distributions?

2013-12-07 Thread Ted Yu
Hi, Please read Chapter 3 of the refguide starting with the following: http://hbase.apache.org/book.html#hbase.binary.compatibility Cheers On Fri, Dec 6, 2013 at 12:42 PM, jingych wrote: > Hi, All! > > Does HBase Java Client compatible to all the hbase distributions? > If don't,how to disting

Re: hbase rest query params for maxVersions and maxValues

2013-12-07 Thread Ted Yu
Koert: Thanks for reporting this issue. Mind filing a JIRA ? Cheers On Sun, Dec 8, 2013 at 2:01 AM, Koert Kuipers wrote: > i am trying to use maxValues with a "globbed" row resource in stargate. > from looking at the source code one has to do something like > > table/row/column(s)/timestamp(s

Re: Remote java client hang

2013-12-07 Thread Rural Hunter
No, I didn't. What's that for? I just followed this guide: http://archive.cloudera.com/cdh/3/hbase/client_dependencies.html Meanwhile, I have another question. My hbase cluster is running in a inner-network. All master and slaves hostnames are resolved to LAN ip like this: master 192.168.1.2 sl

hbase rest query params for maxVersions and maxValues

2013-12-07 Thread Koert Kuipers
i am trying to use maxValues with a "globbed" row resource in stargate. from looking at the source code one has to do something like table/row/column(s)/timestamp(s)/?n=1 (except the ?n=1 piece must be urlencoded) however i cannot get the n=1 piece to work. i get this stacktrace: Problem access

Re: HTable writeAsyncBuffer

2013-12-07 Thread Koert Kuipers
hey st.ack well i am considering creating lots of deletes from a map-reduce job instead of puts, and was looking at the code to see how efficient that would be... but now i am more generally wondering if there is any downside to making all these operations go into the buffer instead of treating p

Re: RPC - Queue Time when handlers are all waiting

2013-12-07 Thread Bharath Vissapragada
I'd look into the RS logs to see whats happening there. Difficult to guess from the given information! On Sat, Dec 7, 2013 at 8:52 PM, Federico Gaule wrote: > Any clue? > El dic 5, 2013 9:49 a.m., "Federico Gaule" escribió: > > > Hi, > > > > I have 2 clusters, Master (a) - Slave (b) replicatio

Re: RPC - Queue Time when handlers are all waiting

2013-12-07 Thread Federico Gaule
Any clue? El dic 5, 2013 9:49 a.m., "Federico Gaule" escribió: > Hi, > > I have 2 clusters, Master (a) - Slave (b) replication. > B doesn't have client write or reads, all handlers (100) are waiting but > rpc.metrics.RpcQueueTime_num_ops and rpc.metrics.RpcQueueTime_avg_time reports > to be rpc c

Re: How to convert SequenceFile into HFile?

2013-12-07 Thread Igor Gatis
Hi JM, My usage is the following: I want to write a C++ program which will answer RPC requests. Each request has a list of keys and responses will contain values. I want to use HFile because it has an efficient key-based index and because there is a whole set of tools in hadoop to produce this kin

Re: HTable writeAsyncBuffer

2013-12-07 Thread Stack
On Fri, Dec 6, 2013 at 3:06 PM, Koert Kuipers wrote > i noticed that puts are put into a bugger (writeAsyncBuffer) that gets > flushed if it gets to a certain size. > writeAsyncBuffer can take objects of type Row, which includes besides the > Put also Deletes, Appends, and RowMutations. > > but

Re: What is HBase compaction-queue-size at all?

2013-12-07 Thread Jean-Marc Spaggiari
> So I think it includes both running compactions and those in queue. Am I missing something? Yes, that's correct. A major is just a compaction running on all the regions. So a region server will count it like a compaction. But it can also be a minor that the RS is seeing. So not necessary a major