Re: [ceph-users] Spark/Mesos on top of Ceph/Btrfs

2015-01-16 Thread wireless
On 01/14/2015 07:37 AM, John Spray wrote: On Tue, Jan 13, 2015 at 1:25 PM, James wrote: I was wondering if anyone has Mesos running on top of Ceph? I want to test/use Ceph if lieu of HDFS. You might be interested in http://ceph.com/docs/master/cephfs/hadoop/ It allows you to expose CephFS to

Re: [ceph-users] Spark/Mesos on top of Ceph/Btrfs

2015-01-14 Thread Gurvinder Singh
We are definitely interested in such a setup too. Not necessarily with btrfs but ceph combined with Spark & Mesos. Earlier last year the ceph hadoop plugin was not stable enough after that I haven't looked in to it. As hadoop plugin relies of CephFS and it is still under development. So we are cur

Re: [ceph-users] Spark/Mesos on top of Ceph/Btrfs

2015-01-14 Thread James
Sebastien Han writes: > What do you want to use from Ceph? RBD? CephFS? (I hope this post is not redundant I still seem to be having some troubles posting to this group and I'm using gmane) Hello one and all, I am suppose to be able to post to this group via gmane, but I'm not seeing the

Re: [ceph-users] Spark/Mesos on top of Ceph/Btrfs

2015-01-14 Thread John Spray
On Tue, Jan 13, 2015 at 1:25 PM, James wrote: > I was wondering if anyone has Mesos running on top of Ceph? > I want to test/use Ceph if lieu of HDFS. You might be interested in http://ceph.com/docs/master/cephfs/hadoop/ It allows you to expose CephFS to applications that use expect HDFS. Howev

Re: [ceph-users] Spark/Mesos on top of Ceph/Btrfs

2015-01-14 Thread Sebastien Han
Hey What do you want to use from Ceph? RBD? CephFS? It is not really clear, you mentioned ceph/btfrs which makes me either think of using btrfs for OSD store or btrfs on top of a RBD device. Later you mentioned HDFS, does that mean you want to use CephFS? I don’t know much about Mesos, but what

[ceph-users] Spark/Mesos on top of Ceph/Btrfs

2015-01-14 Thread James
Hello, I was wondering if anyone has Mesos running on top of Ceph? I want to test/use Ceph if lieu of HDFS. I'm working on Gentoo, but any experiences with Mesos on Ceph are of keen interest to me as related to performance, stability and any difficulties experienced. James