y hadoop feature would work bad if replication is
> disabled "from the hadoop side".
>
> THanks!
> De: Zoltan Arnold Nagy <mailto:zol...@linux.vnet.ibm.com>>
> Enviado: viernes, 05 de febrero de 2016 02:21 p.m.
> Para: Jose M
> Asunto: Re: [ceph-users] Ceph a
old Nagy <mailto:zol...@linux.vnet.ibm.com>>
> Enviado: jueves, 04 de febrero de 2016 06:07 p.m.
> Para: John Spray
> Cc: Jose M; ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
> Asunto: Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)
>
> Might be
s an object store and wasn't use until
now with hadoop).
De: Zoltan Arnold Nagy
Enviado: jueves, 04 de febrero de 2016 06:07 p.m.
Para: John Spray
Cc: Jose M; ceph-users@lists.ceph.com
Asunto: Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)
Might be totally wrong here, but it'
Might be totally wrong here, but it’s not layering them but replacing hdfs://
URLs with ceph:// URLs so all the mapreduce/spark/hbase/whatever is on top can
use CephFS directly which is not a bad thing to do (if it works) :-)
> On 02 Feb 2016, at 16:50, John Spray wrote:
>
> On Tue, Feb 2, 201
Hi Jose,
I believe what you are referring to is using Hadoop over Ceph via the
VFS implementation of the Ceph client vs the user-space libcephfs
client library. The current Hadoop plugin for Ceph uses the client
library. You could run Hadoop over Ceph using a local Ceph mount
point, but it would t
On Tue, Feb 2, 2016 at 3:42 PM, Jose M wrote:
> Hi,
>
>
> One simple question, in the ceph docs says that to use Ceph as an HDFS
> replacement, I can use the CephFs Hadoop plugin
> (http://docs.ceph.com/docs/master/cephfs/hadoop/).
>
>
> What I would like to know if instead of using the plugin, I
Hi,
One simple question, in the ceph docs says that to use Ceph as an HDFS
replacement, I can use the CephFs Hadoop plugin
(http://docs.ceph.com/docs/master/cephfs/hadoop/).
What I would like to know if instead of using the plugin, I can mount ceph in
fstab and then point hdfs dirs (namenode
Hi Matan,
Hadoop on CephFS is part of the regular test suites run on CephFS, so
it should work at least to some extent. Any testing/feedback on this
will be appreciated.
As far as I know, the article you link is the best available documentation.
Cheers,
John
On Fri, Oct 24, 2014 at 8:30 PM,
Hi,
Given HDFS is far from ideal for small files, I am examining the
possibility of using Hadoop on top Ceph. I found mainly one online resource
about it https://ceph.com/docs/v0.79/cephfs/hadoop/. I am wondering whether
there is any reference implementation or blog post you are aware of, about
ha
