Hi guys,
We have a 100+ nodes cluster, each node has about 400G data, and is running
on a flash disk. We are running 2.1.2.
When I bring in a new node into the cluster, it introduces significant load
to the cluster. For the new node, the cpu usage is 100%, but disk write io
is only around 50MB/s, while we have 10G network.
Does it sound normal to you?
Here are some iostat and vmstat metrics:
==== iostat ====
avg-cpu: %user %nice %system %iowait %steal %idle
88.52 3.99 4.11 0.00 0.00 3.38
Device: tps MB_read/s MB_wrtn/s MB_read MB_wrtn
sda 1.00 0.00 0.04 0 0
sdb 156.50 0.00 55.62 0 1
==== vmstat =====
138 0 0 86781912 438780 101523368 0 0 0 31893 264496 247316
95 4 1 0 0 2015-04-21 01:04:01 UTC
147 0 0 86562400 438780 101607248 0 0 0 90510 456635 245849
91 5 4 0 0 2015-04-21 01:04:03 UTC
143 0 0 86341168 438780 101692224 0 0 0 32392 284495 273656
92 4 4 0 0 2015-04-21 01:04:05 UTC
Thanks.
--
Dikang
