Hi Milan, We've done some tests here and our hadoop can talk to RGW successfully with this SwiftFS plugin. But we haven't tried Spark yet. One thing is the data locality feature, it actually requires some special configuration of Swift proxy-server, so RGW is not able to archive the data locality there.
Could you please kindly share some deployment consideration of running Spark on Swift/Ceph? Tachyon seems more promising... Sincerely, Yuan On Wed, Jun 17, 2015 at 9:58 PM, Milan Sladky <milan.sla...@outlook.com> wrote: > Is it possible to access Ceph from Spark as it is mentioned here for > Openstack Swift? > > https://spark.apache.org/docs/latest/storage-openstack-swift.html > > Thanks for help. > > Milan Sladky > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
