On 04/14/2014 11:38 PM, Noah Watkins wrote: > This strikes me as a difference in semantics between HDFS and CephFS, > and like Greg said it's probably based on HBase assumptions. It'd be > really helpful to find out what the exception is. If you are building > the Hadoop bindings from scratch, you can instrument `listStatus` in > `CephFileSystem.java` -- I believe this is being caused by > `listStatus` returning `null`. > I can't test the system now, as the cluster has been taken down. But I can confirm that it was mainly how HBase want the file system to work. Moreover the problem was when creating file with names as ".filename", so if it has "." in start e.g. hidden/temp files, ceph has been failing on that. Although I could create ceph from cephfs. Noah, you may know more about it.
- Gurvinder > > > On Mon, Apr 14, 2014 at 2:27 PM, Gregory Farnum <g...@inktank.com> wrote: >> This looks like some kind of HBase issue to me (which I can't help >> with; I've never used it), but I guess if I were looking at Ceph I'd >> check if it was somehow configured such that the needed files are >> located in different pools (or other separate security domains) that >> might be set up wrong. >> -Greg >> Software Engineer #42 @ http://inktank.com | http://ceph.com >> >> >> On Mon, Apr 7, 2014 at 1:49 AM, Gurvinder Singh >> <gurvindersinghdah...@gmail.com> wrote: >>> Hi, >>> >>> I am trying to make HBase 0.96 work on top of Ceph 0.72.2. When I start >>> the Hbase-master I am getting this error. >>> >>> 2014-04-05 23:39:39,475 DEBUG [master:pltrd023:60000] wal.FSHLog: Moved >>> 1 WAL file(s) to /hbase/data/hbase/meta/1588230740/oldWALs >>> 2014-04-05 23:39:39,538 FATAL [master:host:60000] master.HMaster: >>> Unhandled exception. Starting shutdown. >>> java.io.IOException: Error accessing >>> ceph://mon-host:6789/hbase/data/hbase/meta/.tabledesc >>> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1486) >>> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1524) >>> at >>> org.apache.hadoop.hbase.util.FSUtils.listStatus(FSUtils.java:1582) >>> at >>> org.apache.hadoop.hbase.util.FSTableDescriptors.getCurrentTableInfoStatus(FSTableDescriptors.java:348) >>> at >>> org.apache.hadoop.hbase.util.FSTableDescriptors.getTableInfoPath(FSTableDescriptors.java:329) >>> at >>> org.apache.hadoop.hbase.util.FSTableDescriptors.getTableInfoPath(FSTableDescriptors.java:310) >>> at >>> org.apache.hadoop.hbase.util.FSTableDescriptors.createTableDescriptorForTableDirectory(FSTableDescriptors.java:709) >>> at >>> org.apache.hadoop.hbase.util.FSTableDescriptors.createTableDescriptor(FSTableDescriptors.java:690) >>> at >>> org.apache.hadoop.hbase.util.FSTableDescriptors.createTableDescriptor(FSTableDescriptors.java:677) >>> at >>> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:486) >>> at >>> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146) >>> at >>> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127) >>> at >>> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789) >>> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606) >>> at java.lang.Thread.run(Thread.java:724) >>> >>> >>> The only odd thing/warn i see in the log file is this >>> >>> wal.FSHLog: FileSystem's output stream doesn't support >>> getNumCurrentReplicas; --HDFS-826 not available; >>> fsOut=org.apache.hadoop.fs.ceph.CephOutputStream >>> >>> It has able to create hbase root and other directories such as data,meta >>> etc. So it seems Hbase is able to communicate with Ceph, but somehow it >>> is not able to create all the necessary files Any suggestions there ? >>> >>> I have added these config options in the hbase-site.xml file >>> >>> <property> >>> <name>fs.defaultFS</name> >>> <value>ceph://mon-host:6789/</value> >>> </property> >>> >>> <property> >>> <name>ceph.conf.options</name> >>> <value>client_readahead_min=4193404</value> >>> </property> >>> >>> <property> >>> <name>ceph.conf.file</name> >>> <value>/etc/ceph/ceph.conf</value> >>> </property> >>> >>> <property> >>> <name>ceph.auth.id</name> >>> <value>admin</value> >>> </property> >>> >>> <property> >>> <name>ceph.auth.keyfile</name> >>> <value>/etc/hbase/conf/admin.secret</value> >>> </property> >>> >>> <property> >>> <name>fs.ceph.impl</name> >>> <value>org.apache.hadoop.fs.ceph.CephFileSystem</value> >>> </property> >>> >>> <property> >>> <name>fs.AbstractFileSystem.ceph.impl</name> >>> <value>org.apache.hadoop.fs.ceph.CephHadoop2FileSystem</value> >>> </property> >>> >>> <property> >>> <name>hbase.rootdir</name> >>> <value>ceph://mon-host:6789/hbase</value> >>> <description>The directory shared by RegionServers. >>> </description> >>> </property> >>> >>> >>> - Gurvinder >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@lists.ceph.com >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> _______________________________________________ >> ceph-users mailing list >> ceph-users@lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
