Hi, pangj
While putting small objects, the bottleneck will not be the network
bandwidth, and the server's cpu/mem will be low. It will be a matter of
inode and cache. You can check the iowait of your storage node server
and it may be a "filesystem" problem. As a estimate of the performance
of your swift, take a look at this:
http://www.zmanda.com/blogs/?p=894
Robert van Leeuwen once post a report of their experience in the
mail list and I think it's such a good sharing.
http://engineering.spilgames.com/openstack-swift-lots-small-files/
Hope it helpful.
Jonathan Lu
On 2013/9/3 13:53, pangj wrote:
For each test file the size is 4KB.
Network connection is 1Gb.
But the bandwidth never got full, it's about only 70 - 80 Mb at peak.
And all servers' cpu/mem usage are low.
Thanks.
On 2013-9-3 13:32, Jonathan Lu wrote:
Hi,
What is the average size of the objects? And your network
condition? Maybe the bottleneck of performance is not Swift, but the
network or other things.
Best Regards
Jonathan Lu
On 2013/9/2 19:51, pangj wrote:
Hi,
We have benched the swift, the cluster is with one proxy server, one
combined account/container server, five object servers. All are
separated physical servers.
We benched from 12 clients (each with 200 threads), got the results as
below:
| node | PUT | GET | DELETE |
|--------+-------+-------+--------|
| sb2 A | 35.6 | 57.1 | 44 |
| sb2 B | 35.6 | 56.1 | 43.4 |
| sb3 A | 35.4 | 58.1 | 43.4 |
| sb3 B | 35.6 | 56.1 | 43.4 |
| ad61 A | 35.5 | 57.2 | 43.8 |
| ad61 B | 35.5 | 55.2 | 43.5 |
| sb64 A | 35.4 | 53.4 | 43.7 |
| sb64 B | 35.5 | 54.9 | 43.5 |
| sb65 A | 35.7 | 53.3 | 43.6 |
| sb65 B | 35.6 | 52.5 | 44.1 |
| sb27 A | 35.4 | 49.4 | 44.1 |
| sb27 B | 35.4 | 51.1 | 43.9 |
|--------+-------+-------+--------|
| total | 426.2 | 654.4 | 524.4 |
The total IOPS for PUT is 426, means 426 PUT requests per second.
But our application design requires 3000 PUT requests per second.
So how to improve swift's performance to match the requirement?
Thanks.
_______________________________________________
Mailing list:
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe :
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
