Re: [ceph-users] CEPH Cluster Usage Discrepancy

It is just a block size and it has no impact on data safety except that OSDs need to be redeployed in order for them to create bluefs with given block size. > On 21.10.2018, at 19:04, Waterbly, Dan wrote: > > Thanks Sergey! > > Do you know where I can find details on the repercussions of adju

Re: [ceph-users] CEPH Cluster Usage Discrepancy

Thanks Sergey! Do you know where I can find details on the repercussions of adjusting this value? Performance (read/writes), for once, not critical for us, data durability and disaster recovery is our focus. -Dan Get Outlook for iOS On Sun, Oct 21, 2018 at 8:37 AM -07

Re: [ceph-users] CEPH Cluster Usage Discrepancy

http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-February/024589.html > On 21.10.2018, at 16:12, Waterbly, Dan wrote: > > Awesome! Thanks Serian! > > Do you know where the 64KB comes from? Can that be tune

Re: [ceph-users] CEPH Cluster Usage Discrepancy

Awesome! Thanks Serian! Do you know where the 64KB comes from? Can that be tuned down for a cluster holding smaller objects? Get Outlook for iOS On Sat, Oct 20, 2018 at 10:49 PM -0700, "Serkan Çoban" mailto:cobanser...@gmail.com>> wrote: you have 24M objects, not 2.4

Re: [ceph-users] CEPH Cluster Usage Discrepancy

you have 24M objects, not 2.4M. Each object will eat 64KB of storage, so 24M objects uses 1.5TB storage. Add 3x replication to that, it is 4.5TB On Sat, Oct 20, 2018 at 11:47 PM Waterbly, Dan wrote: > > Hi Jakub, > > No, my setup seems to be the same as yours. Our system is mainly for > archivin

Re: [ceph-users] CEPH Cluster Usage Discrepancy

Hi Jakub, No, my setup seems to be the same as yours. Our system is mainly for archiving loads of data. This data has to be stored forever and allow reads, albeit seldom considering the number of objects we will store vs the number of objects that ever will be requested. It just really seems o

Re: [ceph-users] CEPH Cluster Usage Discrepancy

Hi Dan, Did you configure block.wal/block.db as separate devices/partition (osd_scenario: non-collocated or lvm for clusters installed using ceph-ansbile playbooks )? I run Ceph version 13.2.1 with non-collocated data.db and have the same situation - the sum of block.db partitions' size is displa

Re: [ceph-users] CEPH Cluster Usage Discrepancy

I get that, but isn’t 4TiB to track 2.45M objects excessive? These numbers seem very high to me. Get Outlook for iOS On Sat, Oct 20, 2018 at 10:27 AM -0700, "Serkan Çoban" mailto:cobanser...@gmail.com>> wrote: 4.65TiB includes size of wal and db partitions too. On Sat

Re: [ceph-users] CEPH Cluster Usage Discrepancy

4.65TiB includes size of wal and db partitions too. On Sat, Oct 20, 2018 at 7:45 PM Waterbly, Dan wrote: > > Hello, > > > > I have inserted 2.45M 1,000 byte objects into my cluster (radosgw, 3x > replication). > > > > I am confused by the usage ceph df is reporting and am hoping someone can > sh

[ceph-users] CEPH Cluster Usage Discrepancy

Hello, I have inserted 2.45M 1,000 byte objects into my cluster (radosgw, 3x replication). I am confused by the usage ceph df is reporting and am hoping someone can shed some light on this. Here is what I see when I run ceph df GLOBAL: SIZEAVAIL RAW USED %RAW USED 1.0