Re: [ceph-users] Basic object storage question

2015-09-24 Thread Mark Kirkwood
Glance (and friends - Cinder etc) work with the RBD layer, so yeah the big 'devices' visible to Openstack are made up of many (usually 4MB) Rados objects. Cheers Mark On 25/09/15 12:13, Cory Hawkless wrote: > > Upon bolting openstack Glance onto Ceph I can see hundreds of smaller objects > are

Re: [ceph-users] Basic object storage question

2015-09-24 Thread Cory Hawkless
m>] > Sent: Thursday, 24 September 2015 6:04 PM > To: Cory Hawkless mailto:c...@hawkless.id.au>> > Cc: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> > Subject: Re: [ceph-users] Basic object storage question > > On Thu, Sep 24, 2015 at 1:51 AM, Cory Hawk

Re: [ceph-users] Basic object storage question

2015-09-24 Thread Gregory Farnum
rrect. The rados cli program is more of an access and admin tool than anything intended for regular use. -Greg > > -Original Message- > From: John Spray [mailto:jsp...@redhat.com] > Sent: Thursday, 24 September 2015 6:04 PM > To: Cory Hawkless > Cc: ceph-users@lists.ceph.com

Re: [ceph-users] Basic object storage question

2015-09-24 Thread Cory Hawkless
eptember 2015 6:04 PM To: Cory Hawkless Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Basic object storage question On Thu, Sep 24, 2015 at 1:51 AM, Cory Hawkless wrote: > Hi all, > > > > I have basic question around how Ceph stores individual objects. > > Say I have a po

Re: [ceph-users] Basic object storage question

2015-09-24 Thread Gregory Farnum
On Thu, Sep 24, 2015 at 2:06 AM, Ilya Dryomov wrote: > On Thu, Sep 24, 2015 at 7:05 AM, Robert LeBlanc wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA256 >> >> If you use RADOS gateway, RBD or CephFS, then you don't need to worry >> about striping. If you write your own application that

Re: [ceph-users] Basic object storage question

2015-09-24 Thread Ilya Dryomov
On Thu, Sep 24, 2015 at 12:33 PM, Wido den Hollander wrote: > > > On 24-09-15 11:06, Ilya Dryomov wrote: >> On Thu, Sep 24, 2015 at 7:05 AM, Robert LeBlanc wrote: >>> -BEGIN PGP SIGNED MESSAGE- >>> Hash: SHA256 >>> >>> If you use RADOS gateway, RBD or CephFS, then you don't need to worry

Re: [ceph-users] Basic object storage question

2015-09-24 Thread Wido den Hollander
On 24-09-15 11:06, Ilya Dryomov wrote: > On Thu, Sep 24, 2015 at 7:05 AM, Robert LeBlanc wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA256 >> >> If you use RADOS gateway, RBD or CephFS, then you don't need to worry >> about striping. If you write your own application that uses librado

Re: [ceph-users] Basic object storage question

2015-09-24 Thread Ilya Dryomov
On Thu, Sep 24, 2015 at 7:05 AM, Robert LeBlanc wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > If you use RADOS gateway, RBD or CephFS, then you don't need to worry > about striping. If you write your own application that uses librados, > then you have to worry about it. I understa

Re: [ceph-users] Basic object storage question

2015-09-24 Thread John Spray
On Thu, Sep 24, 2015 at 1:51 AM, Cory Hawkless wrote: > Hi all, > > > > I have basic question around how Ceph stores individual objects. > > Say I have a pool with a replica size of 3 and I upload a 1GB file to this > pool. It appears as if this 1GB file gets placed into 3PG’s on 3 OSD’s , > simpl

Re: [ceph-users] Basic object storage question

2015-09-23 Thread Robert LeBlanc
ty of the application writing to Ceph, not of the RADOS > engine itself? > > > > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Cory Hawkless > Sent: Thursday, 24 September 2015 10:22 AM > To: ceph-users@lists.ceph.com > Subject: [ceph-users] Basi

Re: [ceph-users] Basic object storage question

2015-09-23 Thread Cory Hawkless
the RADOS engine itself? From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Cory Hawkless Sent: Thursday, 24 September 2015 10:22 AM To: ceph-users@lists.ceph.com Subject: [ceph-users] Basic object storage question Hi all, I have basic question around how Ceph stores individu

[ceph-users] Basic object storage question

2015-09-23 Thread Cory Hawkless
Hi all, I have basic question around how Ceph stores individual objects. Say I have a pool with a replica size of 3 and I upload a 1GB file to this pool. It appears as if this 1GB file gets placed into 3PG's on 3 OSD's , simple enough? Are individual objects never split up? What if I want to st