Re: IOException in Get.readVersions()

2019-03-21 Thread Stack
It should have been an IAE. As a community, we famously have an addition to IOE [1]. S 1. https://blog.tsunanet.net/2012/04/apache-hadoop-abuse-ioexception.html On Mon, Mar 18, 2019 at 3:07 PM strijbol.n...@gmail.com < strijbol.n...@gmail.com> wrote: > Hi, > > The readVersions(int) method on Get

Re: Bits getting flipped in record value

2019-03-21 Thread Reid Chan
Maybe you can try unset the DATA_BLOCK_ENCODING attribute, then bulk load and run live ingest feed again to see if bits flipped still happen, if it is convenient. -- Best regards, R.C From: Austin Heyne Sent: 21 March 2019 2

What's the largest cluster size of HBase?

2019-03-21 Thread dongdan39
Hi, Experts, Does anybody know what is the largest HBase cluster ever used by any company? The only info that we can get is a few PB of size in year 2011 by google. But what is the current status after so many years of technical evolvement of HBase(e.g., can HBase support ~100PB storage?)? Tha

Re: Bits getting flipped in record value

2019-03-21 Thread Austin Heyne
We're using FAST_DIFF for the block encoding. For completeness here's the rest: {TABLE_ATTRIBUTES => {coprocessor$1 => 's3://optix.rtb16/root/lib/geomesa-hbase-distributed-runtime_2.11-2.1.0.jar|org.locationtech.geomesa.hbase.coprocessor.GeoMesaCoprocessor|1073741823|'}, {NAME => 'd', BLOOMFIL

Corrupted HBase MasterProcWAL

2019-03-21 Thread Matthew Blissett
Hi all, We have an HBase cluster running version 1.2.0-cdh5.12.0. While investigating a slow startup time, I found that HBase spent 12 minutes working through 14,146 logs in /hbase/MasterProcWALs/. 2019-03-20 15:04:07,687 INFO org.apache.hadoop.hbase.util.FSHDFSUtils: Recover lease on dfs file