[Twisted-Python] Weekly Bug Summary

2008-12-13 Thread exarkun
Bug summary __ Summary for 2008-12-07 through 2008-12-14 Bugs opened: 11Bugs closed: 11 Total open bugs: 1056 (+0) |== Type Changes |== Priority Changes |== Component Changes |Defect: +0 |High:-2 |Conch: +0 |Enhancement: +1 |N

Re: [Twisted-Python] Non-blocking http client?

2008-12-13 Thread Andreas Kostyrka
On Sat, Dec 13, 2008 at 10:08:43AM -0800, Erik Wickstrom wrote: > Hi all, > > I have an application that is doing some web spidering. Right now I'm > using urllib to retrieve the URLs, but it is painfully slow. I was > wondering if it's feasible to swap out urllib with a twisted client > that us

Re: [Twisted-Python] Non-blocking http client?

2008-12-13 Thread Jean-Paul Calderone
On Sat, 13 Dec 2008 10:08:43 -0800, Erik Wickstrom wrote: Hi all, I have an application that is doing some web spidering. Right now I'm using urllib to retrieve the URLs, but it is painfully slow. I was wondering if it's feasible to swap out urllib with a twisted client that uses deferds so

Re: [Twisted-Python] twisted.mail.relaymanager.MXCalculator.getMX in Win32 got problem

2008-12-13 Thread Jean-Paul Calderone
On Sat, 13 Dec 2008 08:46:07 +0800, biziap biziap wrote: The problem is that: the UDP listening ports increase rapidly and eventually come to the end: too many open file in selector. As many as the hosts you lookup, those UDP ports are still alive. It is very different from running this script i

[Twisted-Python] Non-blocking http client?

2008-12-13 Thread Erik Wickstrom
Hi all, I have an application that is doing some web spidering. Right now I'm using urllib to retrieve the URLs, but it is painfully slow. I was wondering if it's feasible to swap out urllib with a twisted client that uses deferds so I can process urls in a more "parallel" fashion? I've done a

Re: [Twisted-Python] PDF I thought may be of interest

2008-12-13 Thread Tristan Seligmann
* Manlio Perillo [2008-12-13 11:54:05 +0100]: > gl...@divmod.com ha scritto: > >> For another, the paper arbitrarily redefines the word "threads" to mean >> "this cool thing that doesn't exist yet", rather than existing things >> that people call "threads". It specifically mentions the defici

Re: [Twisted-Python] PDF I thought may be of interest

2008-12-13 Thread Manlio Perillo
gl...@divmod.com ha scritto: On 10:06 pm, m...@cerenity.org wrote: [...] For another, the paper arbitrarily redefines the word "threads" to mean "this cool thing that doesn't exist yet", rather than existing things that people call "threads". It specifically mentions the deficiencies of curr