Hello, We've got a 3 node cluster online as part of an openstack ansible installation:
Ceph Mimic 3x OSD nodes: 3x 800GB Intel S3710 SSD OSD's using whole device bluestore (node 3 has 4 for 10 total) 40Gbit networking 96GB Ram 2x E5-2680v2 CPU Compute nodes are similar but with 192GB ram Performance using rados bench is fantastic, over 2GB/sec read, 800MB write etc. However, inside a VM on the compute nodes performance is poor on the root disk, 70MB read, 15-20k IOPS. Interestingly, if I create a volume and attach it to the instance, those numbers exactly double when testing the new volume, to 140MB/sec read, 30-40k IOPs. We've tried luminous, same thing. We're only getting about 26Gbit on the 40G links but that's fine for now until we go to production, it's hardly the limiting factor here. Any ideas please? Regards, Nick _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
