Re: [ceph-users] Ceph as an Alternative to HDFS for Hadoop

2018-01-02 Thread Traiano Welcome
Hi Serkan On Fri, Dec 22, 2017 at 12:04 PM, Serkan Çoban wrote: > >Also, are there any benchmark comparisons between hdfs and ceph > specifically around performance of apps benefiting from data locality ? > There will be no data locality in ceph, because all the data is > accessed through networ

Re: [ceph-users] Ceph as an Alternative to HDFS for Hadoop

2018-01-02 Thread Traiano Welcome
On Wed, Dec 27, 2017 at 1:52 AM, Aristeu Gil Alves Jr wrote: > In a recent thread on the list, I received various important answers to my > questions on hadoop plugin. Maybe this thread will help you. > https://www.spinics.net/lists/ceph-users/msg40790.html > > One of the most important answers i

Re: [ceph-users] Ceph as an Alternative to HDFS for Hadoop

2017-12-26 Thread Aristeu Gil Alves Jr
In a recent thread on the list, I received various important answers to my questions on hadoop plugin. Maybe this thread will help you. https://www.spinics.net/lists/ceph-users/msg40790.html One of the most important answers is about data locality. The last message lead me to this article. https:/

Re: [ceph-users] Ceph as an Alternative to HDFS for Hadoop

2017-12-21 Thread Serkan Çoban
>Also, are there any benchmark comparisons between hdfs and ceph specifically >around performance of apps benefiting from data locality ? There will be no data locality in ceph, because all the data is accessed through network. On Fri, Dec 22, 2017 at 4:52 AM, Traiano Welcome wrote: > Hi List >

[ceph-users] Ceph as an Alternative to HDFS for Hadoop

2017-12-21 Thread Traiano Welcome
Hi List I'm researching the possibility os using ceph as a drop in replacement for hdfs for applications using spark and hadoop. I note that the jewel documentation states that it requires hadoop 1.1.x, which seems a little dated and would be of concern for peopel: http://docs.ceph.com/docs/jewe