Re: [Twisted-Python] inlineCallbacks vs explicit callbacks: performance concerns?

2010-05-09 Thread Glyph Lefkowitz
On May 9, 2010, at 11:16 PM, Paul Goins wrote: > Question: Is there a performance related reason why Twisted core does not use > inlineCallbacks? Twisted itself (all parts of Twisted, not just Twisted core) does not use inlineCallbacks because it requires syntax only available Python 2.5, and

[Twisted-Python] inlineCallbacks vs explicit callbacks: performance concerns?

2010-05-09 Thread Paul Goins
Question: Is there a performance related reason why Twisted core does not use inlineCallbacks? - I'm trying to figure out how to reduce the CPU load of an app. I've already done a lot of profiling and have trimmed a lot of fat, but we're still not getting as much throughput as we'd like. We

Re: [Twisted-Python] Comparing "Stackless Python + Nonblocking Stackless Modules" with Twisted.

2010-05-09 Thread Peter Cai
On Mon, May 10, 2010 at 8:17 AM, Andrew Francis wrote: > Hi Peter: > I think things get more complex when one is dealing with multiple end-points > in sequence (now callbacks are chained) or one is using iterators > (cooperators/coiterators now needed?). What light-weight threads do is make >

Re: [Twisted-Python] Comparing "Stackless Python + Nonblocking Stackless Modules" with Twisted.

2010-05-09 Thread Andrew Francis
Hi Peter: Message: 7 Date: Sun, 9 May 2010 23:24:00 +0800 From: Peter Cai Subject: [Twisted-Python] Comparing "Stackless Python + Nonblocking Stackless Modules" with Twisted. To: Twisted general discussion Message-ID: Content-Type: text/plain; charset=UTF-8 >Today, a guy gave me an URL

Re: [Twisted-Python] Comparing "Stackless Python + Nonblocking Stackless Modules" with Twisted.

2010-05-09 Thread Glyph Lefkowitz
On May 9, 2010, at 11:24 AM, Peter Cai wrote: > With this module and stackless python, theoretically, we can build a > high concurrency network application framework which has a programming > style close to traditional multi-thread module. > > The guy who gave me that URL asked a question, "Whic

Re: [Twisted-Python] SQLAlchemy and Twisted

2010-05-09 Thread Glyph Lefkowitz
On May 9, 2010, at 4:14 PM, Konrads Smelkovs wrote: > I think that nice syntax contributes towards adoption. Not as much as consistency and coherency. > Subclassing deferred and adding a __get__ function that queues calls for > future > Deferreds is at least worth a shot. Nope. If you want to

Re: [Twisted-Python] win32com client in a twisted thread

2010-05-09 Thread Konrads Smelkovs
perhaps try to defer to a separate process? 2010/5/5, Don Dwiggins : > Andrew, Itamar, thanks. I've taken the hint to CoInitialize the > thread. That gets me a bit further, but there's still some strange > stuff going on. I'm going to have to put this on the back burner for a > while in favor

Re: [Twisted-Python] SQLAlchemy and Twisted

2010-05-09 Thread Konrads Smelkovs
I think that nice syntax contributes towards adoption. Subclassing deferred and adding a __get__ function that queues calls for future Deferreds is at least worth a shot. Perhaps adding a safety net with allowed function names would help. This list could be per "project" - storm orm integration wou

Re: [Twisted-Python] Comparing "Stackless Python + Nonblocking Stackless Modules" with Twisted.

2010-05-09 Thread lasizoillo
2010/5/9 Peter Cai : > Today, a guy gave me an URL > http://code.google.com/p/stacklessexamples/wiki/StacklessNonblockModules > > It's a replacement of standard python socket module. What make it > different is that this module only blocks a tasklet, not an entire > Python thread. > Gevents does m

Re: [Twisted-Python] SQLAlchemy and Twisted

2010-05-09 Thread Daniel Griffin
That is kind of what I found. In my app I basically have the following triggered using callLater: do a select and create a new SSL connection for each item returned Wait for the response Do between 2 and 4 inserts depending on results Close the connection. As measured in connections completed pe

[Twisted-Python] Comparing "Stackless Python + Nonblocking Stackless Modules" with Twisted.

2010-05-09 Thread Peter Cai
Today, a guy gave me an URL http://code.google.com/p/stacklessexamples/wiki/StacklessNonblockModules It's a replacement of standard python socket module. What make it different is that this module only blocks a tasklet, not an entire Python thread. With this module and stackless python, theoretic

Re: [Twisted-Python] Release again in June?

2010-05-09 Thread Jonathan Lange
On Fri, May 7, 2010 at 10:12 AM, Glyph Lefkowitz wrote: ... > I also think this sounds great. > Thanks for stepping forward again, Jonathan. > I would like to volunteer to be assistant release manager for this release > so that I can hopefully get out a 10.2 in a timely manner as well. > Thanks G

Re: [Twisted-Python] [#24487862] Re: SQLAlchemy and Twisted

2010-05-09 Thread exarkun
On 10:17 am, p.may...@imperial.ac.uk wrote: >Erm... Someone appears to have subscribed a ticketing system w/ >autoresponer to the Twisted mailing list; any chance a list admin could >unsubscribe it? The email below claimed a "From:" of the m/l but a >"Reply-To:" of supp...@mpcustomer.com Hopefully

Re: [Twisted-Python] [#24487862] Re: SQLAlchemy and Twisted

2010-05-09 Thread Phil Mayers
Erm... Someone appears to have subscribed a ticketing system w/ autoresponer to the Twisted mailing list; any chance a list admin could unsubscribe it? The email below claimed a "From:" of the m/l but a "Reply-To:" of supp...@mpcustomer.com On 05/09/2010 10:49 AM, twisted-python@twistedmatrix.

Re: [Twisted-Python] SQLAlchemy and Twisted

2010-05-09 Thread Phil Mayers
On 05/09/2010 07:07 AM, Daniel Griffin wrote: > If you let SQLAlchemy block twisted would there be any impact besides > performance? Depends how long it blocks for, and what else your process is doing. With the reactor blocked: * no socket reads or accepts can be done * no callLater or Loopi