Hi.

Basic
[global]

fsid = 0612cc7e-6239-456c-978b-b4df781fe831
mon initial members = ceph-1,ceph-2,ceph-3
mon host = 10.0.0.15,10.0.0.16,10.0.0.17
osd pool default size = 2
osd pool default pg num = 1024
osd pool default pgp num = 1024


RDMA
[global]

fsid = 0612cc7e-6239-456c-978b-b4df781fe831
mon initial members = ceph-1,ceph-2,ceph-3
mon host = 10.0.0.15,10.0.0.16,10.0.0.17
osd pool default size = 2
osd pool default pg num = 1024
osd pool default pgp num = 1024
ms_type=async+rdma
ms_async_rdma_device_name = mlx4_0


Thanks.

Best Regards,

Hung-Wei Chiu(邱宏瑋)
--
Computer Center, Department of Computer Science
National Chiao Tung University

2017-03-24 18:28 GMT+08:00 Haomai Wang <hao...@xsky.com>:

> the content of  ceph.conf ?
>
> On Fri, Mar 24, 2017 at 4:32 AM, Hung-Wei Chiu (邱宏瑋) <
> hwc...@cs.nctu.edu.tw> wrote:
>
>> Hi Deepak.
>>
>> Thansk your reply,
>>
>> I try to use gperf to profile the ceph-osd with basic mode (without RDMA)
>> and you can see the result in the following link.
>> http://imgur.com/a/SJgEL
>>
>> In the gperf result, we can see the whole CPU usage can divided into
>> three significant part, (Network: 36%, FileStore: 17% PG related:29%).
>> Do you have any idea about this?
>>
>> Thanks.
>>
>>
>> Best Regards,
>>
>> Hung-Wei Chiu(邱宏瑋)
>> --
>> Computer Center, Department of Computer Science
>> National Chiao Tung University
>>
>> 2017-03-24 14:31 GMT+08:00 Deepak Naidu <dna...@nvidia.com>:
>>
>>> >>Now, the kernel can decrease the CPU cycle usages for network I/O
>>> processing because of RDMA enabled (right?).
>>>
>>> Yes, kernel should have comparatively free cycles when using RDMA over
>>> TCP
>>>
>>> >>does it means host can provide more CPU for other processing, such as
>>> Disk I/O ?
>>>
>>> This can be subjective, bcos let's say u have an IO process which takes
>>> 10 mins over TCP then when using RDMA it might be 3 mins as your CPU cycles
>>> are less used by RDMA but if ur application process which provides the RDMA
>>> functionality might have processing cycles as well, which might use CPU
>>> cycles as well, example client or fuse plugins on the host getting it ?
>>>
>>>
>>> --
>>> Deepak
>>>
>>> > On Mar 23, 2017, at 11:10 PM, Hung-Wei Chiu (邱宏瑋) <
>>> hwc...@cs.nctu.edu.tw> wrote:
>>> >
>>> > Now, the kernel can decrease the CPU cycle usages for network I/O
>>> processing because of RDMA enabled (right?).
>>> > does it means host can provide more CPU for other processing, such as
>>> Disk I/O ?
>>>
>>> ------------------------------------------------------------
>>> -----------------------
>>> This email message is for the sole use of the intended recipient(s) and
>>> may contain
>>> confidential information.  Any unauthorized review, use, disclosure or
>>> distribution
>>> is prohibited.  If you are not the intended recipient, please contact
>>> the sender by
>>> reply email and destroy all copies of the original message.
>>> ------------------------------------------------------------
>>> -----------------------
>>>
>>
>>
>
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to