When I am doing benchmarking on ATS I am seeing some requests >= 40ms but the
vast majority are taking <= 1ms. When turning on slow log it looks like the
issue is around cache. is there any option that I can set to mitigate this
issue or anything I can do to dig in deeper to find out where the problems is?
[Jul 31 03:01:57.160] Server {0x2ad695824700} ERROR: [36364408] Slow Request:
url: http://q4.ycpi.bf1.yahoo.net:8124/200_10_0_cache status: 200 unique id:
bytes: 200 fd: 0 client state: 0 server state: 0 ua_begin: 0.000
ua_read_header_done: 0.000 cache_open_read_begin: 0.000 cache_open_read_end:
0.040 dns_lookup_begin: -1.000 dns_lookup_end: -1.000 server_connect: -1.000
server_first_read: -1.000 server_read_header_done: -1.000 server_close: -1.000
ua_close: 0.040 sm_finish: 0.040
[Jul 31 03:01:58.440] Server {0x2ad695824700} ERROR: [36556479] Slow Request:
url: http://q4.ycpi.bf1.yahoo.net:8124/200_10_0_cache status: 200 unique id:
bytes: 200 fd: 0 client state: 0 server state: 0 ua_begin: 0.000
ua_read_header_done: 0.000 cache_open_read_begin: 0.000 cache_open_read_end:
0.040 dns_lookup_begin: -1.000 dns_lookup_end: -1.000 server_connect: -1.000
server_first_read: -1.000 server_read_header_done: -1.000 server_close: -1.000
ua_close: 0.040 sm_finish: 0.040
Here are the results of the benchmark. This occurs in less then 1% of the
responses:
[client bcall@q1 bench]$ fbench -s 120 -c 2 -n 200 -q "200_%d.query"
q2.ycpi.bf1.yahoo.net 8080
Starting clients...
[dummydate]: PROGRESS: fbench: Seconds left 120
[dummydate]: PROGRESS: fbench: Seconds left 60
Stopping
clients........................................................................................................................................................................................................
Clients stopped.
*** HTTP keep-alive statistics ***
connection reuse count -- 17774265
***************** Benchmark Summary *****************
clients: 200
ran for: 120 seconds
cycle time: 2 ms
lower response limit: 0 bytes
skipped requests: 0
failed requests: 0
successful requests: 17774465
cycles not held: 20219
minimum response time: 0.09 ms
maximum response time: 84.21 ms
average response time: 0.29 ms
25 percentile: 0.00 ms
50 percentile: 0.00 ms
75 percentile: 0.00 ms
90 percentile: 0.00 ms
95 percentile: 0.00 ms
99 percentile: 1.00 ms
actual query rate: 148175.09 Q/s
utilization: 21.41 %
zero hit queries: 0
-Bryan