Re: How practical is it to add a timestamp oracle on Zookeeper

2013-04-21 Thread PG
Hi, ted and JM, Thanks for the nice introduction. I have read the Omid paper, which looks use a centralized party to do the coordination and achieves 72K transactions per sec. And It does much more work than just assigning timestamps, and I think it implicitly justifies the usage of a global tim

Re: How HBase perform per-column scan?

2013-03-10 Thread PG
Hi, Ted and Anoop, thanks for your notes. I am talking about column rather than column family, since physically column family should be able to perform efficiently (storage layer, CF's are stored separately). But columns of the same column family may be mixed physically, and that makes filters c

Re: Issues on disabling compaction in HBase 0.94.2

2012-11-24 Thread PG
Hi, I have figured out the problem... The XML snippet in previous email works for HBase 092 but not for 094. By consulting HBase-default.xml, it can be done to disable all compact ions. Thanks all the same. Regards, Yun On Nov 22, 2012, at 11:06 PM, ramkrishna vasudevan wrote: > Hi Yun, > >

Re: How to monitor total disk access in HBase?

2012-11-12 Thread PG
Thanks, for the suggestions. Will do instrumentation based on JMX. Regards, Yun On Nov 12, 2012, at 12:59 AM, Stack wrote: > On Sat, Nov 10, 2012 at 7:03 AM, yun peng wrote: >> Hi, I want to profile the # of disk access (both random and sequential) >> issued from HBase (into HDFS). For disk rea

Re: How to check if a major_compact is done?

2012-11-08 Thread PG
Hi, thanks for the comments. One thing is shouldn't web UI comes from the hbase API, or can I issue function call to get the progress of compaction?. Hun On Nov 8, 2012, at 1:33 AM, ramkrishna vasudevan wrote: > There is no interface which says that the major compaction is completed. > But

Re: How to config hbase0.94.2 to retain deleted data

2012-10-23 Thread PG
The comment clear things up. Configuration through Java code is also working too. Thanks. Yun On Oct 22, 2012, at 12:34 AM, lars hofhansl wrote: > There currently is not. You have setup your column families to support this > (Note that you only need to do that once per column family!). > This

Re: When does HBase set modification timestamp of a HFile?

2012-10-21 Thread PG
Hi, for the record, I have tried fs api as well, and they are the same with each other. Regards, Yun On Oct 21, 2012, at 12:45 AM, lohit wrote: > Looks like StoreFile.getModificationTime is returning you in seconds > precision. > I am not sure what other APIs could be used here, but if you kno

Re: Where is code in hbase that physically delete a record?

2012-10-19 Thread PG
Hi, Anoop and Ram, As I have coded the idea, the detailed instructions are very helpful. One minor thing to add is that coming out from scanner are the KeyValues which are already sorted by column qualifier and time stamps. though i did not find it mentioned in java doc, but i found it very use