Thanks Gregory. I find intel introduced a technology for running hadoop on rgw direclty(http://www.slideshare.net/zhouyuan/hadoop-over-rgw), but I think it is complex for my usage. There is another technology storlet( http://ibmresearchnews.blogspot.co.uk/2014/05/storlets-turning-object-storage-into.html) developed by IBM research lab, I think that is my expectation, but looks not open source. So maybe I need develop something similar like storlet with rgw interface. Thanks
2015-11-14 1:53 GMT+08:00 Gregory Farnum <gfar...@redhat.com>: > I think I saw somebody working on a RADOS interface to Apache Hadoop once, > maybe search for that? > Your other option is to try and make use of object classes directly, but > that's a bit orimitive to build full map-reduce on top of without a lot of > effort. > -Greg > > > On Friday, November 13, 2015, min fang <louisfang2...@gmail.com> wrote: > >> Hi, I setup ceph cluster for storing pictures. I want to introduce a data >> mining program in ceph osd nodes to dig objects with concrete properties. >> >> I hope some kind of map-reduce framework can use ceph object interface >> directly,while not using posix file system interface. >> >> Can somebody help give some suggestion? >> >> Thanks. >> >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
