Ok, here is the story, we deployed some inhouse APIs in our Openstack privade cloud, and we were stressing them up, we realize that some packages were taking so long, to discard the behavior of the api, we installed apache, lighttpd and event tried with netcat, of course on the guest systems running ubuntu 10.10 w/virtio, after getting nuts modifing sysctl parameters to change the guest behavior, we realized that if we installed apache, or lighttpd on the PHYSICAL host the behavior was the same ...., that surprised us, when we try the same benchmark on a node without bonding, bridging and without any KVM packages or nova installed, with the same HW specs, the benchmark passes OK, but if we run the same tests on a spare nova node with everything installed + bonding + bridging that never run a virtual guest machine, the test fails too, so, so far:
Tested on hosts with Ubuntu 10.10, 11.10 and 12.04 - Clean node without bonding + briding or KVM - just the eth0 configured - PASS - Spare node with bridging - PASS - Spare node with just bonding (dynamic link aggr mode4) - PASS - Spare node with nova + kvm + bonding + bridging - FAILS - Spare node with nova + kvm - PASS Is there a chance that working with bridging + bonding + nova some module get screwed, ill attach the tests , you can see that a small amount of packages takes TOO LONG, like 3secs, and the overhead time is on the "CONNECT" phase This is ApacheBench, Version 2.3 <$Revision: 655654 $> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Licensed to The Apache Software Foundation, http://www.apache.org/ Benchmarking 172.16.161.25 (be patient) Completed 2500 requests Completed 5000 requests Completed 7500 requests Completed 10000 requests Completed 12500 requests Completed 15000 requests Completed 17500 requests Completed 20000 requests Completed 22500 requests Completed 25000 requests Finished 25000 requests Server Software: Apache/2.2.16 Server Hostname: 172.16.161.25 Server Port: 80 Document Path: / Document Length: 177 bytes Concurrency Level: 5 Time taken for tests: 7.493 seconds Complete requests: 25000 Failed requests: 0 Write errors: 0 Total transferred: 11350000 bytes HTML transferred: 4425000 bytes Requests per second: 3336.53 [#/sec] (mean) Time per request: 1.499 [ms] (mean) Time per request: 0.300 [ms] (mean, across all concurrent requests) Transfer rate: 1479.28 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 0 1 46.6 0 3009 Processing: 0 1 5.7 0 277 Waiting: 0 0 4.6 0 277 Total: 0 1 46.9 1 3010 Percentage of the requests served within a certain time (ms) 50% 1 66% 1 75% 1 80% 1 90% 1 95% 1 98% 1 99% 1 100% 3010 (longest request) Regards!
_______________________________________________ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
