[Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-04 Thread Nagy, Attila
Hi, I would like to copy a file between two HTTP servers in the most efficient manner, which probably means a streaming down/upload (GET/PUT) with the producer/consumer scheme. Can this be done easily, could somebody write a simple example? Thanks, _

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-04 Thread Phil Mayers
On 04/05/17 13:04, Nagy, Attila wrote: Hi, I would like to copy a file between two HTTP servers in the most efficient manner, which probably means a streaming down/upload (GET/PUT) with the producer/consumer scheme. Can this be done easily, could somebody write a simple example? I guess it

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-04 Thread Nagy, Attila
On 05/04/2017 03:04 PM, Phil Mayers wrote: On 04/05/17 13:04, Nagy, Attila wrote: Hi, I would like to copy a file between two HTTP servers in the most efficient manner, which probably means a streaming down/upload (GET/PUT) with the producer/consumer scheme. Can this be done easily, could s

Re: [Twisted-Python] process manager for twisted daemons?

2017-05-04 Thread Burak Arslan
Hello, On 05/04/17 02:21, jonathan vanasco wrote: > Is anyone deploying their twisted services with something other than > Supervisor? If so, I'd love to know. We're using djb's daemontools (with the -encore patchset) to manage our twisted and non-twisted (C++) daemons. Two advantages: 1. Big

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-04 Thread Phil Mayers
On 04/05/17 14:32, Nagy, Attila wrote: Are there any problems with this approach? You're poking at a private member of the .original IResponse there, and moreover the transport object which seems risky. The single treq.collect call to consumer.write will also not necessarily respect the co

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-04 Thread Nagy, Attila
On 05/04/2017 04:48 PM, Phil Mayers wrote: On 04/05/17 14:32, Nagy, Attila wrote: Are there any problems with this approach? You're poking at a private member of the .original IResponse there, and moreover the transport object which seems risky. I would like to use the simplest (and correct

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-04 Thread Manish Tomar
Have you looked at http://treq.readthedocs.io/en/latest/howto.html#handling-streaming-responses ? Regards, Manish On Thu, May 4, 2017 at 5:04 AM, Nagy, Attila wrote: > Hi, > > I would like to copy a file between two HTTP servers in the most efficient > manner, which probably means a streaming d

[Twisted-Python] [ANN] bloc - group membership framework

2017-05-04 Thread Manish Tomar
Hi all, I've implemented a simple single-master group membership framework on Twisted that can be used for mutually partitioning workload among multiple nodes. https://github.com/manishtomar/bloc Please do try it out and let me know if it helps in any way. Regards, Manish __

Re: [Twisted-Python] [ANN] bloc - group membership framework

2017-05-04 Thread Glyph
> On May 4, 2017, at 12:03 PM, Manish Tomar wrote: > > Hi all, > > I've implemented a simple single-master group membership framework on Twisted > that can be used for mutually partitioning workload among multiple nodes. > > https://github.com/manishtomar/bloc