Re: [ceph-users] Commit and Apply latency on nautilus

2019-10-01 Thread Sasha Litvak
have quite a lot (74+) >> >> >> >> type_instance=Osd.opBeforeDequeueOpLat >> >> type_instance=Osd.opBeforeQueueOpLat >> >> type_instance=Osd.opLatency >> >> type_instance=Osd.opPrepareLatency >> >> type_instance=Osd.opProcessLatency >> >> type_instance=Osd.opRLatency

Re: [ceph-users] Commit and Apply latency on nautilus

2019-10-01 Thread Maged Mokhtar
y >> type_instance=Osd.opWPrepareLatency >> type_instance=Osd.opWProcessLatency >> type_instance=Osd.subopLatency >> type_instance=Osd.subopWLatency >> ... >> ... >> >> >> >> >> >>

Re: [ceph-users] Commit and Apply latency on nautilus

2019-10-01 Thread Robert LeBlanc
On Tue, Oct 1, 2019 at 7:54 AM Robert LeBlanc wrote: > > On Mon, Sep 30, 2019 at 5:12 PM Sasha Litvak > wrote: > > > > At this point, I ran out of ideas. I changed nr_requests and readahead > > parameters to 128->1024 and 128->4096, tuned nodes to > > performance-throughput. However, I still

Re: [ceph-users] Commit and Apply latency on nautilus

2019-10-01 Thread Robert LeBlanc
On Mon, Sep 30, 2019 at 5:12 PM Sasha Litvak wrote: > > At this point, I ran out of ideas. I changed nr_requests and readahead > parameters to 128->1024 and 128->4096, tuned nodes to performance-throughput. > However, I still get high latency during benchmark testing. I attempted to > disabl

Re: [ceph-users] Commit and Apply latency on nautilus

2019-09-30 Thread Sasha Litvak
type_instance=Osd.opRwLatency > >> type_instance=Osd.opRwPrepareLatency > >> type_instance=Osd.opRwProcessLatency > >> type_instance=Osd.opWLatency > >> type_instance=Osd.opWPrepareLatency > >> type_instance=Osd.opWProcessLatency > >> type_insta

Re: [ceph-users] Commit and Apply latency on nautilus

2019-09-30 Thread Paul Emmerich
stance=Osd.subopLatency >> type_instance=Osd.subopWLatency >> ... >> ... >> >> >> >> >> >> -Original Message- >> From: Alex Litvak [mailto:alexander.v.lit...@gmail.com] >> Sent: zondag 29 september 2019 13:06 >> To: ceph-us

Re: [ceph-users] Commit and Apply latency on nautilus

2019-09-30 Thread Sasha Litvak
e=Osd.subopWLatency > ... > ... > > > > > > -Original Message- > From: Alex Litvak [mailto:alexander.v.lit...@gmail.com] > Sent: zondag 29 september 2019 13:06 > To: ceph-users@lists.ceph.com > Cc: ceph-de...@vger.kernel.org > Subject: [ceph-users] C

Re: [ceph-users] Commit and Apply latency on nautilus

2019-09-30 Thread Marc Roos
] Commit and Apply latency on nautilus Hello everyone, I am running a number of parallel benchmark tests against the cluster that should be ready to go to production. I enabled prometheus to monitor various information and while cluster stays healthy through the tests with no errors or slow

[ceph-users] Commit and Apply latency on nautilus

2019-09-29 Thread Alex Litvak
Hello everyone, I am running a number of parallel benchmark tests against the cluster that should be ready to go to production. I enabled prometheus to monitor various information and while cluster stays healthy through the tests with no errors or slow requests, I noticed an apply / commit late