Hi,
Sorry to reask, but I'm not reaching any further. I think i'm missing some
really obvious permission configuration, as I was testing the hadoop command
and it only works with one user (the one I use to install ceph).
This works
ubuntu@cephmaster:~/ceph-cluster$ hadoop fs -put ceph.conf /
This work (file has 'ubuntu' as owner')
ubuntu@cephmaster:~/ceph-cluster$ hadoop fs -ls /
Found 1 items
-rw-r--r-- 3 ubuntu 262 2015-12-29 11:35 /ceph.conf
This doesn't work (using user 'ceph' to list files)
ubuntu@cephmaster:~/ceph-cluster$ sudo -u ceph hadoop fs -ls /
ls: Permission denied
I think Hbase fails to start cause it's using it's own user and it seems only
user "ubuntu" is allow to use ceph. Is there any easy way to fix this? Maybe
disabling security? Sorry if the question looks silly, I'm really new to ceph
and don't know exactly where to search about this.
Thanks in advance,
________________________________
De: Jose M <soloning...@hotmail.com>
Enviado: lunes, 28 de diciembre de 2015 09:45 a.m.
Para: ceph-users@lists.ceph.com
Asunto: Ceph & Hbase
Hi!
Does anyone succesfully configure hbase to use ceph? I'm having some problems
with it, maybe anyone can help.
I have ceph already running and ceph-hadoop bindings installed ('hadoop fs -ls
/' working). I'm trying Hbase in pseudo distributed mode, but when starting
hbase-master I'm getting this error
2015-12-27 16:41:53,962 INFO [main] mob.MobFileCache: MobFileCache is
initialized, and the cache size is 1000
2015-12-27 16:41:54,484 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Failed construction of Master: class
org.apache.hadoop.hbase.master.HMaster
at
org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2046)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:198)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2060)
Caused by: java.io.IOException: Permission denied
at com.ceph.fs.CephMount.native_ceph_mount(Native Method)
at com.ceph.fs.CephMount.mount(CephMount.java:154)
at org.apache.hadoop.fs.ceph.CephTalker.initialize(CephTalker.java:141)
at
org.apache.hadoop.fs.ceph.CephFileSystem.initialize(CephFileSystem.java:98)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2643)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:93)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2680)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2662)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:379)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:1005)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:532)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:347)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at
org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2041)
This is my core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>ceph://cephmaster:6789/</value>
</property>
<property>
<name>ceph.conf.file</name>
<value>/etc/ceph/ceph.conf</value>
</property>
<property>
<name>ceph.auth.id</name>
<value>admin</value>
</property>
<property>
<name>ceph.auth.keyring</name>
<value>/home/developer/ceph-cluster/ceph.client.admin.keyring</value>
</property>
<property>
<name>fs.ceph.impl</name>
<value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
</property>
<property>
<name>fs.AbstractFileSystem.ceph.impl</name>
<value>org.apache.hadoop.fs.ceph.CephHadoop2FileSystem</value>
</property>
<property>
<name>ceph.data.pools</name>
<value>hadoop1</value>
</property>
<property>
<name>ceph.mon.address</name>
<value>cephmaster:6789</value>
</property>
<property>
<name>ceph.object.size</name>
<value>67108864</value>
</property>
</configuration>
This is my hbase-site.xml
<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>ceph://cephmaster:6789/hbase</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>cephmaster</value>
</property>
</configuration>
I already tried adding here fs.defaultFS, ceph.conf.file, ceph.auth.id,
ceph.auth.keyfile, fs.ceph.impl and fs.AbstractFileSystem.ceph.impl in
hbase-site.xml just in case (although i think they aren't needed here) but I
got the same exception.
I suppose from the exception I have some permission error with ceph fs but I'm
not sure.
Hope you can help me finding the right direction to fix this:)
Thanks in advance,
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
