Re: HBase 0.94.3 with ACL RS won't start

hi, folks, I am able to recreate the same error on another single node cluster. RS log pasted here: http://pastebin.com/iP9Mrz2T and hbase-site.xml is here: http://pastebin.com/ppnqfwGR the only thing changes is by adding the following property per http://hbase.apache.org/book/hbase.accesscontro

Re: mapreduce.LoadIncrementalHFiles hangs..

You need to give user hbase write permission to the subdirectory under /tmp Cheers On Jun 19, 2014, at 7:33 PM, Chen Wang wrote: > Ted, > Thanks for the pointer!! After checking the 04 regionserver log, they are > flushed with permission denied error. Does it mean that user hbase does not > hav

Re: mapreduce.LoadIncrementalHFiles hangs..

Ted, Thanks for the pointer!! After checking the 04 regionserver log, they are flushed with permission denied error. Does it mean that user hbase does not have permission to access to the hdfs? aused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Perm

Re: mapreduce.LoadIncrementalHFiles hangs..

Was cluster-04 always showing up in the log ? Have you checked region server log on cluster-04 ? Cheers On Thu, Jun 19, 2014 at 6:09 PM, Chen Wang wrote: > Last piece of the puzzle! > > My Mapreduce succeeded in generating hdfs file, However, bulk load with the > following code: > > LoadIncre

Re: mapreduce.LoadIncrementalHFiles hangs..

Here you go. Thanks for looking!! ull thread dump Java HotSpot(TM) 64-Bit Server VM (24.55-b03 mixed mode): "Attach Listener" daemon prio=10 tid=0x7f8130c49800 nid=0x5826 waiting on condition [0x] java.lang.Thread.State: RUNNABLE "IPC Client (669337652) connection to

Re: how to know run major compact successfully?

finally, it become 100%. How I don't know how to reproduce it. What I have done is deleting many rows and in hbase shell executing "major_compact 'tablename'" On Thu, Jun 19, 2014 at 7:39 PM, Anoop John wrote: >>>Compaction Progress is confusing, which 110.55% > > 110% !!!Mind raising a jira

Re: mapreduce.LoadIncrementalHFiles hangs..

You're using 0.96, right ? Can you jstack the LoadIncrementalHFiles process and pastebin the stack ? On Thu, Jun 19, 2014 at 6:09 PM, Chen Wang wrote: > Last piece of the puzzle! > > My Mapreduce succeeded in generating hdfs file, However, bulk load with the > following code: > > LoadIncrement

mapreduce.LoadIncrementalHFiles hangs..

Last piece of the puzzle! My Mapreduce succeeded in generating hdfs file, However, bulk load with the following code: LoadIncrementalHFiles loader = new LoadIncrementalHFiles(hbaseConf); loader.doBulkLoad(newExecutionOutput, candidateSendTable); Just hangs there without any output. I tried to

Re: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.compressionByName

AbstractHFileWriter is in hbase-server module. Adding hbase-it works because hbase-it depends on hbase-server. The following comes from dependency tree output in trunk (for 0.96 it's the same): [INFO] org.apache.hbase:hbase-it:jar:0.99.0-SNAPSHOT ... [INFO] +- org.apache.hbase:hbase-server:jar

Re: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.compressionByName

Figured out. Need org.apache.hbase hbase-it 0.96.1.1-cdh5.0.1 as well.. On Thu, Jun 19, 2014 at 5:21 PM, Chen Wang wrote: > Hi folks, > > I am running bulk load with HFileOutputFormat. The reducer throws the > following NoSuchMethodError.Just wondering where this class is? > > My p

java.lang.NoSuchMethodError: org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.compressionByName

Hi folks, I am running bulk load with HFileOutputFormat. The reducer throws the following NoSuchMethodError.Just wondering where this class is? My pom looks like this:(0.96.1.1-cdh5.0.1) org.apache.hadoop hadoop-client 2

Re: Maven repo missing jars for hbase package - but works fine for others such as hbase-common/client/etc)

There are no jars at the 'base' level. There is no hbase-VERSION.jar, only hbase-server-VERSION.jar, etc. St.Ack On Thu, Jun 19, 2014 at 4:14 PM, Stephen Boesch wrote: > The following hbase artifacts from maven work JUST FINE including the > sources: > > hbase-client > hbase-common > hbase-ser

Re: Maven repo missing jars for hbase package - but works fine for others such as hbase-common/client/etc)

There is no jar for base package. If you build (locally) 0.96+, you would find out yourself. Cheers On Thu, Jun 19, 2014 at 4:14 PM, Stephen Boesch wrote: > The following hbase artifacts from maven work JUST FINE including the > sources: > > hbase-client > hbase-common > hbase-server > hbase-

Maven repo missing jars for hbase package - but works fine for others such as hbase-common/client/etc)

The following hbase artifacts from maven work JUST FINE including the sources: hbase-client hbase-common hbase-server hbase-shell hbase-examples hbase-thrift hbase-protocol Here is an example of the repo for hbase-common that contains all the correct artifacts: http://mvnrepository.com/artifact/

HBase 0.94.3 with ACL RS won't start

Hi All, I am running HBase 0.94.3 and trying to get ACL working on a single node cluster. I followed the steps in http://hbase.apache.org/book/hbase.accesscontrol.configuration.html step 8.4.3 and added those 2 properties to my hbase-site.xml After stopping and starting hbase, my regionserver is

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

hadoop version Hadoop 1.0.4 Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r 1393290 Compiled by hortonfo on Wed Oct 3 05:13:58 UTC 2012 >From source with checksum fe2baea87c4c81a2c505767f3f9b71f4 and rpm -qa | grep mapr returns nothing... On Thu, Jun 19, 2014 at

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

On Thu, Jun 19, 2014 at 9:32 PM, Chen Wang wrote: > > does it matter what version of hadoop the hbase cluster is using? the hdfs > file is on cluster 1, while the hbase is installed on another cluster. Is the hbase cluster running on mapr or any other distribution ? -- Thanks and Regards, Nabe

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

I changed my pom to be like; org.apache.hadoop hadoop-client 1.0.3 org.apache.hadoop hadoop-core 1.0.3-mapr-2.1.3.1 com.mapr.hadoop maprfs 1.0.3-mapr-2.1.3.1 org.apache.hbase hbase 0.94.5-mapr But still sees org.apache.hadoop.hbase.mapreduce.LoadI

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

rpm -qa | grep mapr mapr-pig-0.10.19796-GA.noarch mapr-client-2.1.3.24434.GA-3.x86_64 mapr-mahout-0.7.18380-GA.noarch mapr-oozie-internal-3.3.2.22919-1.noarch mapr-pig-internal-1.2.9.14962.GA.v0.9.0-sp1.x86_64 On Thu, Jun 19, 2014 at 6:49 AM, Nabeel Moidu wrote: > I meant mapr. > > rpm -qa | gr

Re: HBase leader node - Is there such an animal?

bq. by hashing the first 2 bytes. Does this achieve good distribution ? You may want to include more bytes. On Wed, Jun 18, 2014 at 11:23 PM, yanivG wrote: > Yes, I thought it as well, although I distribute the keys by hashing the > first 2 bytes. > > > > -- > View this message in context: > h

Re: HBase leader node - Is there such an animal?

Yes, I thought it as well, although I distribute the keys by hashing the first 2 bytes. -- View this message in context: http://apache-hbase.679495.n3.nabble.com/HBase-leader-node-Is-there-such-an-animal-tp4060544p4060581.html Sent from the HBase User mailing list archive at Nabble.com.

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

I meant mapr. rpm -qa | grep mapr On Thu, Jun 19, 2014 at 6:56 PM, Chen Wang wrote: > hadoop version > Hadoop 1.0.3 > Source http://mapr.com -r 2fc440194a6652404626d72b3e3045781f5576ab > > > On Thu, Jun 19, 2014 at 5:03 AM, Nabeel Moidu wrote: > >> What version of mapr are you running? >> >> On

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

hadoop version Hadoop 1.0.3 Source http://mapr.com -r 2fc440194a6652404626d72b3e3045781f5576ab On Thu, Jun 19, 2014 at 5:03 AM, Nabeel Moidu wrote: > What version of mapr are you running? > > On Thu, Jun 19, 2014 at 4:39 PM, Chen Wang > wrote: > > I also checked hadoop classpath, and it does c

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

What version of mapr are you running? On Thu, Jun 19, 2014 at 4:39 PM, Chen Wang wrote: > I also checked hadoop classpath, and it does contain maprfs jar > :/opt/mapr/hadoop/hadoop-0.20.2/bin/../lib/logging-0.1.jar:/opt/mapr/hadoop/hadoop-0.20.2/bin/../lib/maprfs-1.0.3-mapr-2.1.3.2.jar > > > On T

Re: what differenct between znode /hbase/table94 and /hbase/table?

they are the same thing. /hbase/table94 is a "compatibility" znode that replaces /hbase/table if you want more details take a look at HBASE-6710. Matteo On Thu, Jun 19, 2014 at 9:57 AM, ch huang wrote: > hi,maillist: > i see table94 and table znode under /hbase znode,what's >

Re: how to know run major compact successfully?

>>Compaction Progress is confusing, which 110.55% 110% !!!Mind raising a jira with the details and ur observation? -Anoop- On Wed, Jun 18, 2014 at 8:56 AM, Li Li wrote: > I found the information in web ui > http://mphbase-master1:60010/master-status#compactStas > but the Compaction Progres

Re: Zookeeper timeout exception seen whenever too much of data is being pushed to hbase

org.apache.hadoop.hbase.client.HTablePool.getTable(HTablePool.java:180) at com.narus.cdp.backend.hbase.ConfigurationLoader.getHTable(ConfigurationLoader.java:46) at com.narus.cdp.backend.hbase.HBaseUtil.getTable(HBaseUtil.java:32) at com.narus.cdp.backend.hbase.HBaseUtil.put

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

I also checked hadoop classpath, and it does contain maprfs jar :/opt/mapr/hadoop/hadoop-0.20.2/bin/../lib/logging-0.1.jar:/opt/mapr/hadoop/hadoop-0.20.2/bin/../lib/maprfs-1.0.3-mapr-2.1.3.2.jar On Thu, Jun 19, 2014 at 3:52 AM, Chen Wang wrote: > Nabeel, > I have the maprfs-1.0.3-mapr-3.0.0.jar

Re: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

Nabeel, I have the maprfs-1.0.3-mapr-3.0.0.jar in my pom.xml,and I am building a shaded jar. This means that maprfs-1.0.3-mapr-3.0.0.jar is on my classpath right? Thanks, Chen On Wed, Jun 18, 2014 at 9:59 PM, Nabeel Moidu wrote: > On Wed, Jun 18, 2014 at 10:23 AM, Chen Wang > wrote: > > java.i

Re: Regionserver crash

Hi Samir, It had been about 30 mins since the last round of inserts, i was performing a count of rows in the table when the region crashed. I had another crash of a regionserver - oom which resulted in a similar problme, but this time running "hbase hbck -fix" twice was able to resolve the pro

what differenct between znode /hbase/table94 and /hbase/table?

hi,maillist: i see table94 and table znode under /hbase znode,what's difference between them? i see no znode under /hbase/table

Re: Invitation to connect on LinkedIn

I think someone got into the mailing list, I don't recongize this request and I am not bhalchandra bhutkar On Thu, Jun 19, 2014 at 3:11 AM, Mohammad Tariq wrote: > You need to use JM's address instead of hbase mailing list. > > *Warm regards,* > *Mohammad Tariq* > *cloudfront.blogspot.com

Re: Invitation to connect on LinkedIn

You need to use JM's address instead of hbase mailing list. *Warm regards,* *Mohammad Tariq* *cloudfront.blogspot.com * On Thu, Jun 19, 2014 at 1:22 PM, rakesh rakshit wrote: > Friend, I guess you are mistaken. I am not Jean-Marc whom you are expecting > here. >

Re: Invitation to connect on LinkedIn

Friend, I guess you are mistaken. I am not Jean-Marc whom you are expecting here. Thanks. Rakesh On Thu, Jun 19, 2014 at 10:34 AM, bjbhutkar wrote: > LinkedIn > > > > > Jean-Marc, > > I'd like to add you to my professional network on LinkedIn. > > - bhalchandra > > bhalchandra bh

Re: HBase Cluster setup

the HBASE_HOME seems to be pointing to /home/ubuntu/hbase/conf instead of /home/ubuntu/hbase to be up and running with hbase you can just follow this 5 steps $ tar xzvf hbase-0.99.0-SNAPSHOT-bin.tar.gz $ export HBASE_HOME=`pwd`/hbase-0.99.0-SNAPSHOT/ $ export PATH=$HBASE_HOME/bin:$PATH $ start-h

Re: HBase Cluster setup

What does your setup look like? Are you running from the extracted tarball? Any modifications to hbase-site.xml? -Dima On Tuesday, June 17, 2014, prmdbaora wrote: > ubuntu@namenode:~$ hbase/bin/start-hbase.sh > Error: Could not find or load main class org.apache.hadoop.hbase.util. > HBaseConfTo