> > export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true"
>
> Was there actually a problem if you didn't set this?
>
I have commented this out and restarted mapred and everything still worked ok.
It is probably only needed for the HDFS processes.
> > 4. Symink JNI library
> > cd $HADOOP_HOME/lib/n
On Jun 5, 2013, at 12:51 PM, Noah Watkins wrote:
>> I have tried adding -Djava.library.path=/usr/lib/jni to HADOOP_OPTS in
>> hadoop-env.sh and exporting LD_LIBRARY_PATH=/usr/lib/jni in hadoop-env.sh,
>> but it didn't work for me. I'd love to hear about a more elegant method of
>> making Had
Thanks a lot for this Ilja! I'm going to update the documentation again soon,
so this very helpful.
On Jun 5, 2013, at 12:21 PM, Ilja Maslov wrote:
> export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true"
Was there actually a problem if you didn't set this?
> 4. Symink JNI library
> cd $HADOOP_
Thanks for all the help, guys!
Let me give back to community by listing all the minimal steps I needed to make
it work on current versions of the software.
Ubuntu 12.04.2 LTS
ceph 0.61.2-1precise
Hadoop 1.1.2
1. Install additional packages:
libcephfs-java
libcephfs-jni
2. Download http://ceph.
You need to specify the ceph implementation in core-site.xml:
fs.ceph.impl
org.apache.hadoop.fs.ceph.CephFileSystem
Mike
On 5 June 2013 16:19, Ilja Maslov wrote:
> Hmm, no joy so far :(
>
> Still getting:
>
> hduser@dfs01:~$ hadoop fs -ls
> Bad connection to FS. command a
Hmm, no joy so far :(
Still getting:
hduser@dfs01:~$ hadoop fs -ls
Bad connection to FS. command aborted. exception: No FileSystem for scheme: ceph
hadoop-cephfs.jar from http://ceph.com/download/hadoop-cephfs.jar is in the
classpath
libcephfs.jar from libcephfs-java (0.61.2-1precise) package i
On Jun 4, 2013, at 2:58 PM, Ilja Maslov wrote:
> Is the only way to get it to work is to build Hadoop off the
> https://github.com/ceph/hadoop-common/tree/cephfs/branch-1.0/src or is it
> possible to compile/obtain some sort of a plugin and feed it to a stable
> hadoop version?
Hi Ilja,
We
Hi,
I'm trying to get Hadoop tested with the ceph:/// schema, but can't seem to
find a way to make Hadoop ceph-aware :(
Is the only way to get it to work is to build Hadoop off the
https://github.com/ceph/hadoop-common/tree/cephfs/branch-1.0/src or is it
possible to compile/obtain some sort of
