Peng, I'm glad you were able to get it working. You'll have to provide some more information to start debugging why it is slow. How is your Ceph cluster configured? Also, have a look at the jobtracker statistics and see if any tasks are failing.
On Thu, Oct 17, 2013 at 8:17 PM, 鹏 <wkp4...@126.com> wrote: > ** > > Hi all ! > I think I suceed using cephFS with hadoop, but I still face lost > question for that I am a newer in hadoop and ceph! > first, my ceph version is 0.62. java is 1.6.0_45 .hadoop is 1.1.2 I > think suceed because: > # hadoop fs -ls / > drwxrwxrwx - root 0 2013-10-16 10:57 /libcephfs_junit > but, when I use the commond hadoop dfsadmin -report, nothing printed > on the terminal。 > [] #hadoop dfsadmin -report > [] # > and then , I try some mapreduce's work! > #hadoop jar hadoop-examples-1.1.2.jar wordcount /tmp/wordcount/word.txt > /tmp/wordcount/out > .........INFO ceph.CephFileSystem:........... > ... > ..........WARN Snappy.Load Dnappy: Snappy native library not loaded. > .... > INFO:map 0% reduce 0% > and Nothing was print on! I wait for it more then 10 Minute and the > word.txt content less the 10 words. > > by the way, the jps restut is: > #jps > 2913 secondaryNameNode > 17888 TaskTracker > 4581 JPS > 2974 JobTracker > > and my hadoop conf is > core-site.xml > hadoop.tmp.dir = /usr/hadoop/tmp > fs.ceph.impl =org.apache.hadoop.fs.ceph.CephFileSystem > fs.default.name = ceph://192.168.58.129/ > ceph.conf.file = /etc/ceph/ceph.conf > > mapres-site.xml > mapred.job.tracket=http://192.168.58.132:9001 > > ndfs-site.xml > dfs.replication=1 > > > thanks > peng > > > > > > > > ****** > > > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
