Hi everyone,
I am new to the Ceph. I have 5 PC test cluster on wich id like to test
CephFS behavior and performance.
I have used ceph-deploy on nod pc1 and installed ceph software (emeperor
0.72.2-0.el6) on all 5 machines.
Then set pc1 as mon and mds. PC2, PC3 as OSD and PC4, PC5 as ceph
clients. All machines use CentOS 6.5
operating system. Machines in Storage Cluster (pc1, pc2, pc3) use stock
kernel 2.6.32-431.el6.x86_64 and
clients(pc4, pc5) use 3.10.38-1.el6.elrepo.x86_64.
Machine spec:
CPU: 3.5GHz Intel Core i3-4330 (dual core)
RAM: 2x4GB 1600MHz RAM
HDD: 750GB WD7502ABYS 7200RPM 32MB Cache SATA 3.0Gb/s
All machines are connected via 1Gb/s ethernet thru switch.
OSD use around 730GB disk partition formated with XFS, mounted at
/export/sda2/osdX
and used in ceph-deploy osd prepare pc2:/export/sda2/osdX and
ceph-deploy osd activate
pc2:/export/sda2/osdX.
Then I have mounted CephFS on clients (pc4, pc5):
mount -t ceph 10.0.0.1:6789:/ /mnt/ceph -o
name=admin,secretfile=/root/admin.secret
I have run some tests and there are the results:
write: http://postimg.org/image/zblw6a2jz/
rewrite: http://postimg.org/image/t9mzzszxz/
read: http://postimg.org/image/6e73w046t/
Idealy the speed should be around 100MB/s (network limitation of single
client).
But the write is around 30 and read around 70. I suspect the write
performance is
half of the read because client writes the file and its replica at the
same time.
Still its kind of low it should be around 50 MB/s.
Other test that I have run is writing two 10GB files from single client
one at the time.
I have measured the utitlization of cluster machines with sar and
plotted those graphs:
pc1 (mon, mds): http://postimg.org/image/44gp2929z/
pc2 (osd1): http://postimg.org/image/p5rommxyj/
pc3 (osd2): http://postimg.org/image/l94fijbop/
pc4 (client): http://postimg.org/image/3kaz82cix/
The network trafic looks strange and both disk on OSD are utilizied on
100%. Is it
normal behavior for such load?
Im really new to the Ceph and i have done almost no configuration or
tunning of the system.
At the moment im bit confused about what to do to make the filesystem
work better.
Can anyone please give me some tips? Thanks a lot.
Michal Pazdera
---
Tato zpráva neobsahuje viry ani jiný škodlivý kód - avast! Antivirus je aktivní.
http://www.avast.com
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
