Hello All,
First of all thanks for all the pointers in the #twisted about twisted.web
being able to use threadpool. Here's the benchmark between cherryPy 3.0 and
twisted.web that I promised. I hope this could serve as a reference in the
future.
*Testing parameters:*
- Office PC: Intel(R) Pentium(R) D CPU 2.80GHz with 1GB RAM
- Apache bench set to 500 concurrent attempts within 30 secs
- LinuxMint Elyssa/Python 2.5.2/Twisted 2.5
- Twisted using SelectReactor
- Webservers just returning "Hello!" after some mathematical calculation:
result = 0
for i in range(random.randint(100, 300)):
angle = math.radians(random.randint(0, 45))
result += math.tanh(angle)/math.cosh(angle)
*
CherryPy Results:*
Concurrency Level: 500
Time taken for tests: 30.1441 seconds
Complete requests: *6421*
Failed requests: 0
Write errors: 0
Total transferred: 834990 bytes
HTML transferred: 38538 bytes
Requests per second: 214.02 [#/sec] (mean)
Time per request: 2336.197 [ms] (mean)
Time per request: 4.672 [ms] (mean, across all concurrent requests)
Transfer rate: 27.17 [Kbytes/sec] received
*
twisted-web Results (no threading):*
Concurrency Level: 500
Time taken for tests: 30.35509 seconds
Complete requests: *10051*
Failed requests: 0
Write errors: 0
Total transferred: 502600 bytes
HTML transferred: 60312 bytes
Requests per second: 334.64 [#/sec] (mean)
Time per request: 1494.155 [ms] (mean)
Time per request: 2.988 [ms] (mean, across all concurrent requests)
Transfer rate: 16.31 [Kbytes/sec] received
*twisted-web Results (with threading, threadpool [min=100, max=400]):*
Concurrency Level: 500
Time taken for tests: 30.16998 seconds
Complete requests: *11068*
Failed requests: 0
Write errors: 0
Total transferred: 553450 bytes
HTML transferred: 66414 bytes
Requests per second: 368.72 [#/sec] (mean)
Time per request: 1356.026 [ms] (mean)
Time per request: 2.712 [ms] (mean, across all concurrent requests)
Transfer rate: 17.99 [Kbytes/sec] received
*Source Listing (using Twisted):
*
#!/usr/bin/python
from twisted.internet import reactor
from twisted.web import http
from twisted.python.threadpool import ThreadPool
import random, math, sys
class HTTPProtocol(http.Request):
def process(self):
def process_finish():
result = 0
for i in range(random.randint(100, 300)):
angle = math.radians(random.randint(0, 45))
result += math.tanh(angle)/math.cosh(angle)
self.setHeader('Content-Type', 'text/html')
self.write("Hello!")
self.finish()
if self.channel.factory.app.threads_enabled:
print("Using threads")
reactor.callFromThread(process_finish)
else:
print("Not using threads")
process_finish()
class HTTPChannel(http.HTTPChannel):
requestFactory = HTTPProtocol
class HTTPFactory(http.HTTPFactory):
protocol = HTTPChannel
def __init__(self, app):
self.app = app
def start(self, port=8080):
reactor.listenTCP(port, self)
class BenchmarkApplication():
def __init__(self):
self.httpfactory = None
self.pool = None
self.threads_enabled = False
def start(self):
try:
minthreads = int(sys.argv[1])
maxthreads = int(sys.argv[2])
self.pool = ThreadPool(minthreads, maxthreads)
self.pool.start()
self.threads_enabled = True
print "Threads enabled: MIN:%d MAX:%d" % (minthreads,
maxthreads)
except Exception, e:
print("minthreads and maxthreads is not set or malformed.
Threading will be disabled")
self.httpfactory = HTTPFactory(self)
self.httpfactory.start()
return (True)
def end(self):
if self.pool != None:
self.pool.stop()
if __name__ == "__main__":
gba = BenchmarkApplication()
if gba.start():
reactor.run()
gba.end()*
Source Listing (using CherryPy):
*#!/usr/bin/python
import cherrypy
from amazilia import *
from amazilia import base
from amazilia import mysql
import random, math
class Root:
def index(self):
result = 0
for i in range(random.randint(100, 300)):
angle = math.radians(random.randint(0, 45))
result += math.tanh(angle)/math.cosh(angle)
return "Hello!"
index.exposed = True
root = Root()
cherrypy.quickstart(root)*
*I haven't had much time to tinker with CherryPy. Threre might be some ways
to increase its performance. :)
---
Alvin
--
http://www.alvinatorsplayground.blogspot.com/
_______________________________________________
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
