Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Itamar Turner-Trauring
> Thank you for help. > As i see there is nothing particular in my test case. It may be that's just how fast it's going to be, yes. One potentially easy way to speed things up: try PyPy. ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Ilya Biin
Thank you for help. As i see there is nothing particular in my test case. 2012/3/3 Ilya Biin : > Running tests again without a profiler let me achieve 700rps, > but it seems too low for a dummy code either. > > plz tell me if i'm wrong > > 2012/3/3 Itamar Turner-Trauring : >>> cpu load was measure

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Ilya Biin
Running tests again without a profiler let me achieve 700rps, but it seems too low for a dummy code either. plz tell me if i'm wrong 2012/3/3 Itamar Turner-Trauring : >> cpu load was measured out of profiler. > > Profilers will slow down your program dramatically. A program that does > 10% CPU ru

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Itamar Turner-Trauring
> cpu load was measured out of profiler. Profilers will slow down your program dramatically. A program that does 10% CPU running under a profiler may use far less CPU when run normally. ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Ilya Biin
httperf on "twistd -n web --path /tmp" does 1200 rps as with my code it does 400 rps only which fits to ~10percent load on 30rps 2012/3/2 Itamar Turner-Trauring : >> I'm using epoll reactor and sample HTTP Proxy realization. >> >> From another process i'm executing ~30 HTTP requests per second and

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Glyph Lefkowitz
On Mar 2, 2012, at 2:50 PM, Itamar Turner-Trauring wrote: > On my laptop ab claims Note: pretty much everyone should avoid 'ab'. It mis-reports its results, usually subtly, but sometimes in comical ways; I am pretty sure I've seen it tell me that (a buggy version of) Twisted was doing negativ

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Ilya Biin
cpu load was measured out of profiler. twisted version used is from pip, Twisted==12.0.0 i'll supply http_perf test results a bit later > 1. What performance do you get out of twisted.web doing a simpler request? > > 2. What version of Twisted? > > 3. Was the 10% CPU while running under the profi

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Ilya Biin
I've never used stack overflow before. Direct connection to community seems preferrable. Source code being tested was import hotshot, hotshot.stats from twisted.internet import epollreactor epollreactor.install() from twisted.internet import reactor from twisted.web import http from twisted.web

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Itamar Turner-Trauring
> I'm using epoll reactor and sample HTTP Proxy realization. > > From another process i'm executing ~30 HTTP requests per second and > twisted process is consuming 10% cpu > > What is wrong? Why twisted perfomance is so poor here? The profile output you included doesn't particularly show anything

Re: [Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread exarkun
On 06:54 pm, m...@ilyabiin.com wrote: >I'm using epoll reactor and sample HTTP Proxy realization. See also the question on stackoverflow: http://stackoverflow.com/questions/9536732/twisted-reactor-cpu-usage Jean-Paul ___ Twisted-Python mailing list

[Twisted-Python] Twisted reactor cpu usage

2012-03-02 Thread Ilya Biin
I'm using epoll reactor and sample HTTP Proxy realization. From another process i'm executing ~30 HTTP requests per second and twisted process is consuming 10% cpu The profiler output is:         937706 function calls (934675 primitive calls) in 59.988 CPU seconds   Ordered by: cumulative time

Re: [Twisted-Python] Non-PDF version of the Twisted book?

2012-03-02 Thread Glyph
On Mar 2, 2012, at 11:12 AM, exar...@twistedmatrix.com wrote: > We're currently moving into year four of our efforts to convert > Twisted's documentation from Lore to Sphinx. That's really where we > could use some extra help. For reference, the Sphinx migration ticket is .

Re: [Twisted-Python] Non-PDF version of the Twisted book?

2012-03-02 Thread exarkun
On 02:52 pm, rgac...@appropriatesolutions.com wrote: >Is there any interest in taking the existing Twisted documentation and >moving it to a collaborative ePub environment like Booktype? > > >And yes, if the core Twisted team sees value in that, I'd be hap

Re: [Twisted-Python] Non-PDF version of the Twisted book?

2012-03-02 Thread Ray Cote
Is there any interest in taking the existing Twisted documentation and moving it to a collaborative ePub environment like Booktype? And yes, if the core Twisted team sees value in that, I'd be happy to volunteer to do the conversion. --Ray - Or

Re: [Twisted-Python] Twisted/PyPy rocks!

2012-03-02 Thread exarkun
On 01:04 am, tobias.oberst...@tavendo.de wrote: >>Fixing these failing tests, or working on getting the dependencies >>working on >>PyPy, would be a great way to contribute to both Twisted and PyPy. :) >> >>Jean-Paul > >It's funny: kqueue seems to be chasing me;) > >I've got PyPy release built fro