Re: [ceph-users] Regarding key/value interface

2014-09-12 Thread Allen Samuels
Another thing we're looking into is compression. The intersection of compression and object striping (fracturing) is interesting. Is the striping variable on a per-object basis? Allen Samuels Chief Software Architect, Emerging Storage Solutions 951 SanDisk Drive, Milpitas, CA 95035 T: +1 408

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Somnath Roy
Hi Haomai, > Make perfect sense Sage.. >

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Sage Weil
On Fri, 12 Sep 2014, Somnath Roy wrote: > Thanks Sage... > Basically, we are doing similar chunking in our current implementation which > is derived from objectstore. > Moving to Key/value will save us from that :-) > Also, I was thinking, we may want to do compression (later may be dedupe ?) >

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Somnath Roy
Thanks Sage... Basically, we are doing similar chunking in our current implementation which is derived from objectstore. Moving to Key/value will save us from that :-) Also, I was thinking, we may want to do compression (later may be dedupe ?) on that Key/value layer as well. Yes, partial read/

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Haomai Wang
On Fri, Sep 12, 2014 at 9:46 AM, Somnath Roy wrote: > > Make perfect sense Sage.. > > Regarding striping of filedata, You are saying KeyValue interface will do the > following for me? > > 1. Say in case of rbd image of order 4 MB, a write request coming to > Key/Value interface, it will chunk t

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Haomai Wang
On Fri, Sep 12, 2014 at 9:46 AM, Somnath Roy wrote: > Make perfect sense Sage.. > > Regarding striping of filedata, You are saying KeyValue interface will do > the following for me? > > 1. Say in case of rbd image of order 4 MB, a write request coming to > Key/Value interface, it will chunk the

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Haomai Wang
On Fri, Sep 12, 2014 at 9:46 AM, Somnath Roy wrote: > Make perfect sense Sage.. > > Regarding striping of filedata, You are saying KeyValue interface will do > the following for me? > > 1. Say in case of rbd image of order 4 MB, a write request coming to > Key/Value interface, it will chunk the

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Sage Weil
On Fri, 12 Sep 2014, Somnath Roy wrote: > Make perfect sense Sage.. > > Regarding striping of filedata, You are saying KeyValue interface will do the > following for me? > > 1. Say in case of rbd image of order 4 MB, a write request coming to > Key/Value interface, it will chunk the object (sa

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Somnath Roy
Make perfect sense Sage.. Regarding striping of filedata, You are saying KeyValue interface will do the following for me? 1. Say in case of rbd image of order 4 MB, a write request coming to Key/Value interface, it will chunk the object (say full 4MB) in smaller sizes (configurable ?) and str

Re: [ceph-users] Regarding key/value interface

2014-09-11 Thread Sage Weil
Hi Somnath, On Fri, 12 Sep 2014, Somnath Roy wrote: > > Hi Sage/Haomai, > > If I have a key/value backend that support transaction, range queries (and I > don?t need any explicit caching etc.) and I want to replace filestore (and > leveldb omap) with that,  which interface you recommend me to de

[ceph-users] Regarding key/value interface

2014-09-11 Thread Somnath Roy
Hi Sage/Haomai, If I have a key/value backend that support transaction, range queries (and I don't need any explicit caching etc.) and I want to replace filestore (and leveldb omap) with that, which interface you recommend me to derive from , directly ObjectStore or KeyValueDB ? I have already