Re: [ceph-users] Cephfs total throughput

2015-09-15 Thread Gregory Farnum
Yes, they're both delayed and a guesstimate: the OSDs send periodic information to the monitors about the state of their PGs, which includes amount of data read/written from them. The monitor extrapolates the throughput at each report interval based on the pg updates it received during that time. -

Re: [ceph-users] Cephfs total throughput

2015-09-15 Thread Barclay Jameson
Good point. I have seen some really weird numbers something like 7x my normal client IO. This happens very rarely though. On Tue, Sep 15, 2015 at 2:25 PM, Mark Nelson wrote: > FWIW I wouldn't totally trust these numbers. At one point a while back I > had ceph reporting 226GB/s for several second

Re: [ceph-users] Cephfs total throughput

2015-09-15 Thread Scottix
I have a program that monitors the speed, and I have seen 1TB/s pop up and there is just no way that is true. Probably the way it is calculated is prone to extreme measurements, where if you average it out you get a more realistic number. On Tue, Sep 15, 2015 at 12:25 PM Mark Nelson wrote: > FWI

Re: [ceph-users] Cephfs total throughput

2015-09-15 Thread Mark Nelson
FWIW I wouldn't totally trust these numbers. At one point a while back I had ceph reporting 226GB/s for several seconds sustained. While that would have been really fantastic, I suspect it probably wasn't the case. ;) Mark On 09/15/2015 11:25 AM, Barclay Jameson wrote: Unfortunately, it's no

Re: [ceph-users] Cephfs total throughput

2015-09-15 Thread Barclay Jameson
Unfortunately, it's not longer idle as my CephFS cluster is now in production :) On Tue, Sep 15, 2015 at 11:17 AM, Gregory Farnum wrote: > On Tue, Sep 15, 2015 at 9:10 AM, Barclay Jameson > wrote: >> So, I asked this on the irc as well but I will ask it here as well. >> >> When one does 'ceph -s

Re: [ceph-users] Cephfs total throughput

2015-09-15 Thread Gregory Farnum
On Tue, Sep 15, 2015 at 9:10 AM, Barclay Jameson wrote: > So, I asked this on the irc as well but I will ask it here as well. > > When one does 'ceph -s' it shows client IO. > > The question is simple. > > Is this total throughput or what the clients would see? > > Since it's replication factor of

[ceph-users] Cephfs total throughput

2015-09-15 Thread Barclay Jameson
So, I asked this on the irc as well but I will ask it here as well. When one does 'ceph -s' it shows client IO. The question is simple. Is this total throughput or what the clients would see? Since it's replication factor of 3 that means for every write 3 are actually written. First lets assum