Master shuts down during log splitting on restart

2014-09-24 Thread ashish singhi
Hi All. I am using 0.98.6 HBase. I observed that when I have the following value set in my hbase-site.xml file hbase.regionserver.wal.encryption false hbase.regionserver.hlog.reader.impl org.apache.hadoop.hbase.regionserver.wal.SecureProtobufLogReader hbase.regionserver.hlog.writer.impl org

Re: Help in purging hbase data

2014-09-24 Thread Jean-Marc Spaggiari
Hi Nishanth, which HBase version do you use? I think there is a coprocessor hook on the compaction that you might be able to use. However, depending on your HBase knowledge, it might be a bit "Dangerous"... JM 2014-09-24 14:31 GMT-04:00 Nishanth S : > Thank you Jean.is there some batch API whic

Re: Help in purging hbase data

2014-09-24 Thread Nishanth S
Thank you Jean.is there some batch API which hbase exposes for deletes for which I can feed the row keys?. The reason I am asking is I have a solr implementation which runs on the background which has hbase row key as one of the fields.So It would be pretty easy to grab a set of row keys that ne

Re: Help in purging hbase data

2014-09-24 Thread Jean-Marc Spaggiari
Hi Nishan, What you are looking for is HBASE-11764 and not available yet. JM 2014-09-24 14:12 GMT-04:00 Nishanth S : > Hi All, > > We were using TTL feature to delete the hbase data since we were able to > define the retention days at column

Help in purging hbase data

2014-09-24 Thread Nishanth S
Hi All, We were using TTL feature to delete the hbase data since we were able to define the retention days at column family level.But right now we have a requirement for storing data with different retention period in this column family.So we would need to do a select and delete.What would be

Re: MapReduce vs hosts (Cannot resolve the host name)

2014-09-24 Thread Jean-Marc Spaggiari
Oh, this is archeology! ;) Almost 2 years old post ;) I have not solved this. It doesn't create any issue. I think you should consider is as a warning more than as an error. It is most probably due to some DNS vs Reverse DNS results. JM 2014-09-23 23:50 GMT-04:00 Om Parkash : > Hi Jean-Marc >

Re: HBase establishes session with ZooKeeper and close the session immediately

2014-09-24 Thread tobe
Thanks @qiang and I have found the root cause. Yes, it's about ReplicationSink and I have found the log, "2014-09-23,14:58:01,736 DEBUG org.apache.hadoop.hbase.replication.regionserver.ReplicationSink: Replicating for table online_miliao_recent". Then I look at the relevant code and found that ev

Re: HBase establishes session with ZooKeeper and close the session immediately

2014-09-24 Thread Qiang Tian
yeah...replication uses client API to process the edits.. see ReplicationSink#replicateEntries. perhaps adding a stacktrace here is the best(and fastest) way to find the root: 2014-09-18,16:38:17,867 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=10.2.201.74:11000