Re: [ceph-users] Efficient storage of small objects / bulk erasure coding

2017-10-23 Thread Jiri Horky
Hi John, On 10/23/2017 02:59 PM, John Spray wrote: > On Tue, Oct 17, 2017 at 9:42 PM, Jiri Horky wrote: >> Hi list, >> >> we are thinking of building relatively big CEPH-based object storage for >> storage of our sample files - we have about 700M files ranging from very >> small (1-4KiB) files to

Re: [ceph-users] Efficient storage of small objects / bulk erasure coding

2017-10-23 Thread John Spray
On Tue, Oct 17, 2017 at 9:42 PM, Jiri Horky wrote: > Hi list, > > we are thinking of building relatively big CEPH-based object storage for > storage of our sample files - we have about 700M files ranging from very > small (1-4KiB) files to pretty big ones (several GiB). Median of file > size is 64

Re: [ceph-users] Efficient storage of small objects / bulk erasure coding

2017-10-23 Thread Gregory Farnum
On Mon, Oct 23, 2017 at 9:37 AM Jiri Horky wrote: > Hi Greg, > > > On 10/17/2017 11:49 PM, Gregory Farnum wrote: > > On Tue, Oct 17, 2017 at 12:42 PM Jiri Horky wrote: > >> Hi list, >> >> we are thinking of building relatively big CEPH-based object storage for >> storage of our sample files - we

Re: [ceph-users] Efficient storage of small objects / bulk erasure coding

2017-10-23 Thread Jiri Horky
Hi Greg, On 10/17/2017 11:49 PM, Gregory Farnum wrote: > On Tue, Oct 17, 2017 at 12:42 PM Jiri Horky > wrote: > > Hi list, > > we are thinking of building relatively big CEPH-based object > storage for > storage of our sample files - we have about 700M

Re: [ceph-users] Efficient storage of small objects / bulk erasure coding

2017-10-17 Thread Gregory Farnum
On Tue, Oct 17, 2017 at 12:42 PM Jiri Horky wrote: > Hi list, > > we are thinking of building relatively big CEPH-based object storage for > storage of our sample files - we have about 700M files ranging from very > small (1-4KiB) files to pretty big ones (several GiB). Median of file > size is 6