> -Original Message-
> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of
> William Josefsson
> Sent: 20 October 2016 10:25
> To: Nick Fisk
> Cc: ceph-users@lists.ceph.com
> Subject: Re: [ceph-users] RBD with SSD journals and SAS OSDs
>
&
On Mon, Oct 17, 2016 at 6:16 PM, Nick Fisk wrote:
> Did you also set /check the c-states, this can have a large impact as well?
Hi Nick. I did try intel_idle.max_cstate=0, and I've got quite a
significant improvement as attached below. Thanks for this advice!
This is still with DIRECT=1, SYNC=1,
Hello,
Note that the tests below were done on a VM with RBD cache disabled, so the
"direct=1" flag in FIO had a similar impact to "sync=1".
If your databases are MySQL, Oracle or something else that can use
O_DIRECT, RBD caching can improve things dramatically for you (with the
same risks that o
Thx Christian for elaborating on this appreciate it, I will rerun some
of my benchmarks and take your advice into consideration. I have also
found maximum performance recommendations for the dell 730xd bios
settings, hope these make sense: http://pasteboard.co/guHVMQVly.jpg
I will set all these set
> William Josefsson
>>> Sent: 17 October 2016 10:39
>>> To: n...@fisk.me.uk
>>> Cc: ceph-users@lists.ceph.com
>>> Subject: Re: [ceph-users] RBD with SSD journals and SAS OSDs
>>>
>>> hi nick, I earlier did cpupower frequency-set --cpu-governor p
com
>> Subject: Re: [ceph-users] RBD with SSD journals and SAS OSDs
>>
>> hi nick, I earlier did cpupower frequency-set --cpu-governor performance on
>> all my hosts, which bumped all CPUs up to almost max
>> speed or more.
>
> Did you also set /check t
Hello,
As I had this written mostly already and since it covers some points Nick
raised in more detail, here we go.
On Mon, 17 Oct 2016 16:30:48 +0800 William Josefsson wrote:
> Thx Christian for helping troubleshooting the latency issues. I have
> attached my fio job template below.
>
There's
> -Original Message-
> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of
> William Josefsson
> Sent: 17 October 2016 10:39
> To: n...@fisk.me.uk
> Cc: ceph-users@lists.ceph.com
> Subject: Re: [ceph-users] RBD with SSD journals and SAS OSDs
&g
cpu MHz : 2614.125
On Mon, Oct 17, 2016 at 5:17 PM, Nick Fisk wrote:
>> -Original Message-
>> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of
>> William Josefsson
>> Sent: 17 October 2016 09:31
>> To: Christian Balzer
>> C
> -Original Message-
> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of
> William Josefsson
> Sent: 17 October 2016 09:31
> To: Christian Balzer
> Cc: ceph-users@lists.ceph.com
> Subject: Re: [ceph-users] RBD with SSD journals and SAS OSDs
&
Thx Christian for helping troubleshooting the latency issues. I have
attached my fio job template below.
I thought to eliminate the factor that the VM is the bottleneck, I've
created a 128GB 32 cCPU flavor. Here's the latest fio benchmark.
http://pastebin.ca/raw/3729693 I'm trying to benchmark t
Hello,
On Sun, 16 Oct 2016 19:07:17 +0800 William Josefsson wrote:
> Ok thanks for sharing. yes my journals are Intel S3610 200GB, which I
> partition in 4 partitions each ~45GB. When I ceph-deploy I declare
> these as the journals of the OSDs.
>
The size (45GB) of these journals is only going
Ok thanks for sharing. yes my journals are Intel S3610 200GB, which I
partition in 4 partitions each ~45GB. When I ceph-deploy I declare
these as the journals of the OSDs.
I was trying to understand the blocking, and how much my SAS OSDs
affected my performance. I have a total of 9 hosts, 158 OSDs
Hello,
On Sun, 16 Oct 2016 15:03:24 +0800 William Josefsson wrote:
> Hi list, while I know that writes in the RADOS backend are sync() can
> anyone please explain when the cluster will return on a write call for
> RBD from VMs? Will data be considered synced one written to the
> journal or all t
Hi list, while I know that writes in the RADOS backend are sync() can
anyone please explain when the cluster will return on a write call for
RBD from VMs? Will data be considered synced one written to the
journal or all the way to the OSD drive?
Each host in my cluster has 5x Intel S3610, and 18x1
15 matches
Mail list logo
