Re: [Twisted-Python] debugging a memory leak

2010-02-24 Thread Alec Matusis
In desperation of not finding the real memory leak on the production server, I wrote a test server that I can push to arbitrary high RSS memory. I am far from sure if this the same leak that I observe in production, but I would like to understand what this one is. This is the server code: Server

Re: [Twisted-Python] Newbie question: Is this possible with twisted?

2010-02-24 Thread Tim Bordemann
Hi Reza. > However, I'm going to suggest something different, which seems like a > better fit for what you're trying to do. Check out Celery > (http://celeryproject.org/) which is a distributed task queue. The > idea is that you set up a queue system, like RabbitMQ, which implement > a job queue v

Re: [Twisted-Python] multiprocessing capability?

2010-02-24 Thread Mikhail Terekhov
On Wed, Feb 24, 2010 at 3:04 PM, K. Richard Pixley wrote: > > I'm working on an interface right now to the spread toolkit, > (http://spread.org), which implements virtual synchrony, > (http://en.wikipedia.org/wiki/Virtual_synchrony). > > For distributed, symmetric, fault tolerant parallelism in sm

Re: [Twisted-Python] multiprocessing capability?

2010-02-24 Thread Mark Wright
Weird, I was looking into doing something similar for the Paxos algorithm (http://en.wikipedia.org/wiki/Paxos_algorithm), but I decided I didn't have the time right now. If you haven't, I recommend that you check out Paxos Made Live: http://labs.google.com/papers/paxos_made_live.html That paper h

Re: [Twisted-Python] Newbie question: Is this possible with twisted?

2010-02-24 Thread Reza Lotun
Hi Tim, > first of all: I've no experience with network-programming yet, but need to go > in for creating a "simple" client-server application. No problem. > In the end I'd like to connect a web-form (django) with a twisted-server, > which then should do some long-lasting calculations. > > So

[Twisted-Python] Newbie question: Is this possible with twisted?

2010-02-24 Thread Tim Bordemann
Hi, first of all: I've no experience with network-programming yet, but need to go in for creating a "simple" client-server application. In the end I'd like to connect a web-form (django) with a twisted-server, which then should do some long-lasting calculations. So far I got a simple xmlrpc-ser

Re: [Twisted-Python] multiprocessing capability?

2010-02-24 Thread Darren Govoni
Looks interesting. I'm going to check out that package. My original request was more along the lines of using Python's new support for native CPU core's and processes (the multiprocessing package is for this). Python's built-in thread support has global lock constraints that underperform in some

Re: [Twisted-Python] [ANNOUNCE] Twisted 10.0.0pre1 is now released

2010-02-24 Thread Ralph Meijer
On Wed, 2010-02-24 at 11:20 -0500, Glyph Lefkowitz wrote: > [..] > > Much as I don't like ReST, it's a heck of a lot better than trac markup. You > can't really manipulate trac markup with anything but trac, but ReST gives > you all of docutils. > > If we used ReST, we could integrate it with t

Re: [Twisted-Python] multiprocessing capability?

2010-02-24 Thread K. Richard Pixley
Glyph Lefkowitz wrote: On Feb 21, 2010, at 8:00 PM, Alexandre Quessy wrote Hello everyone, I have done something similar to this, but I used the children IO stream to control them. Maybe I should have done that using some higher level protocol, such as AMP or PB. Using a higher-level proto

Re: [Twisted-Python] multiprocessing capability?

2010-02-24 Thread Glyph Lefkowitz
On Feb 21, 2010, at 8:00 PM, Alexandre Quessy wrote: > Hello everyone, > I have done something similar to this, but I used the children IO > stream to control them. Maybe I should have done that using some > higher level protocol, such as AMP or PB. Using a higher-level protocol is generally bet

Re: [Twisted-Python] Sending jpeg data over TCP/IP

2010-02-24 Thread Glyph Lefkowitz
On Feb 22, 2010, at 9:13 AM, Christopher Armstrong wrote: > On Mon, Feb 22, 2010 at 2:03 AM, gary clark wrote: >> The correct way I think is to use base64 and just one connection after more >> research. Good to research. >> >> Thanks, >> Garyc > > No, base64ing file contents is a terrible thi

Re: [Twisted-Python] [ANNOUNCE] Twisted 10.0.0pre1 is now released

2010-02-24 Thread Glyph Lefkowitz
On Feb 23, 2010, at 11:02 PM, Tim Allen wrote: > On 02/24/2010 02:56 PM, James Y Knight wrote: >> On Feb 23, 2010, at 10:45 PM, Tim Allen wrote: >>> On 02/24/2010 02:21 PM, Glyph Lefkowitz wrote: Here's a not-so-official link to the 10.0.0 prerelease NEWS: http://twistedmatrix.com

Re: [Twisted-Python] [ANNOUNCE] Twisted 10.0.0pre1 is now released

2010-02-24 Thread Kevin Horn
On Mon, Feb 22, 2010 at 12:23 PM, Kevin Horn wrote: > On Sun, Feb 21, 2010 at 9:50 PM, Jonathan Lange wrote: > >> Live from PyCon Atlanta, I'm pleased to herald the approaching >> footsteps of the 10.0 release. >> >> Tarballs for the first Twisted 10.0.0 pre-release are now available at: >> >>

Re: [Twisted-Python] Reactor events help request ..

2010-02-24 Thread Watson, David
Hi Andrew .. I want to thank you for your help .. I just looked at the link articles that you suggested and that sounds like the correct diagnosis to the problem .. I thought that there was a solution somewhere, I was just not able to find the correct information to aid in finding out what was