Re: [ceph-users] Ceph object mining

2015-11-13 Thread min fang
Thanks Gregory. I find intel introduced a technology for running hadoop on rgw direclty(http://www.slideshare.net/zhouyuan/hadoop-over-rgw), but I think it is complex for my usage. There is another technology storlet( http://ibmresearchnews.blogspot.co.uk/2014/05/storlets-turning-object-storage-in

Re: [ceph-users] Ceph object mining

2015-11-13 Thread Gregory Farnum
I think I saw somebody working on a RADOS interface to Apache Hadoop once, maybe search for that? Your other option is to try and make use of object classes directly, but that's a bit orimitive to build full map-reduce on top of without a lot of effort. -Greg On Friday, November 13, 2015, min fang

[ceph-users] Ceph object mining

2015-11-13 Thread min fang
Hi, I setup ceph cluster for storing pictures. I want to introduce a data mining program in ceph osd nodes to dig objects with concrete properties. I hope some kind of map-reduce framework can use ceph object interface directly,while not using posix file system interface. Can somebody help give s