[Twisted-Python] buildbots: normal service will resume shortly

2016-06-03 Thread Glyph
We had a minor hiccup earlier today due partially to a new Cryptography release (the Windows builders, which started spuriously failing builds) and some random networking issues (the OS X builders, which went offline). I believe I've gotten them back online and performing to spec and they shoul

Re: [Twisted-Python] buildbots: normal service will resume shortly

2016-06-03 Thread Glyph
> On Jun 3, 2016, at 00:39, Glyph wrote: > > We had a minor hiccup earlier today due partially to a new Cryptography > release (the Windows builders, which started spuriously failing builds) and > some random networking issues (the OS X builders, which went offline). I > believe I've gotten

[Twisted-Python] Why deferToThread is so slow?

2016-06-03 Thread Nagy, Attila
Hi, I have a thread safe synchronous library, which I would like to use in a threadpool using deferToThread. Without using (deferTo)threads I get consistent 1-3 ms response times, with deferring to threadpool, I get 30-300, varying wildly. I've tried to construct a test, which is of course

Re: [Twisted-Python] Why deferToThread is so slow?

2016-06-03 Thread Glyph
> On Jun 3, 2016, at 01:06, Nagy, Attila wrote: > > Hi, > > I have a thread safe synchronous library, which I would like to use in a > threadpool using deferToThread. > > Without using (deferTo)threads I get consistent 1-3 ms response times, with > deferring to threadpool, I get 30-300, vary

Re: [Twisted-Python] buildbots: normal service will resume shortly

2016-06-03 Thread Glyph
> On Jun 3, 2016, at 00:49, Glyph wrote: > > >> On Jun 3, 2016, at 00:39, Glyph wrote: >> >> We had a minor hiccup earlier today due partially to a new Cryptography >> release (the Windows builders, which started spuriously failing builds) and >> some random networking issues (the OS X buil

Re: [Twisted-Python] Why deferToThread is so slow?

2016-06-03 Thread Nagy, Attila
On 06/03/16 10:24, Glyph wrote: On Jun 3, 2016, at 01:06, Nagy, Attila > wrote: Hi, I have a thread safe synchronous library, which I would like to use in a threadpool using deferToThread. Without using (deferTo)threads I get consistent 1-3 ms response times, with defe

Re: [Twisted-Python] Why deferToThread is so slow?

2016-06-03 Thread Mark Williams
On Fri, Jun 03, 2016 at 10:06:43AM +0200, Nagy, Attila wrote: > Hi, > > I have a thread safe synchronous library, which I would like to use > in a threadpool using deferToThread. > > Without using (deferTo)threads I get consistent 1-3 ms response > times, with deferring to threadpool, I get 30-300,

Re: [Twisted-Python] Why deferToThread is so slow?

2016-06-03 Thread Gelin Yan
> > > > In general, if you're writing performance-sensitive code, you should > not use deferToThread. Instead, you should use deferToThreadPool: > > > https://twistedmatrix.com/documents/current/api/twisted.internet.threads.html#deferToThreadPool > > That's because the reactor's threadpool, which

Re: [Twisted-Python] Why deferToThread is so slow?

2016-06-03 Thread Glyph
> On Jun 3, 2016, at 19:10, Gelin Yan wrote: > > Hi Mark > > You mentioned deferToThreadPool. I am curious whether the standard > threadpool in multipleprocessing.dummy works with twisted. deferToThreadPool uses a Twisted threadpool interface, not a stdlib one. -glyph _