Hi, I have a 3 node SSD-backed cluster connected over infiniband (16K MTU) and here is the performance I am seeing:
[root@triton temp]# !dd dd if=/dev/zero of=/mnt/temp/test.out bs=512k count=1000 1000+0 records in 1000+0 records out 524288000 bytes (524 MB) copied, 0.436249 s, 1.2 GB/s [root@triton temp]# dd if=/dev/zero of=/mnt/temp/test.out bs=512k count=10000 10000+0 records in 10000+0 records out 5242880000 bytes (5.2 GB) copied, 299.077 s, 17.5 MB/s [root@triton temp]# dd if=/mnt/temp/test.out of=/dev/null bs=512k count=1000010000+0 records in 10000+0 records out 5242880000 bytes (5.2 GB) copied, 13.3015 s, 394 MB/s Does that look right? How do I check this is not a network problem, because I remember seeing a kernel issue related to large MTU.
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
