Re: [Twisted-Python] pb.Copyable knowledge barrier

2014-08-08 Thread Kevin Mcintyre
correction. I was stupidly reprocessing list on remote copy side. Seeing much better results now ~10K per second. On Fri, Aug 8, 2014 at 6:32 PM, Kevin Mcintyre wrote: > I experimented today with a table scan from dynamodb. Taking each record > and converting to a dictionary into a list. In

[Twisted-Python] On problems with inlineCallbacks (was Re: Is there pb documentation somewhere?)

2014-08-08 Thread Jonathan Ballet
Sorry for hijacking the thread, but I actually was going to ask something about this a few days ago, so let's use this reference from Glyph as a starting point instead :) On Fri, Aug 08, 2014 at 02:59:39PM -0700, Glyph Lefkowitz wrote: > I've participated in this discussion several times: > > Hy

Re: [Twisted-Python] Is there pb documentation somewhere?

2014-08-08 Thread Daniel Sank
Twisted dev people dudes, > Nevertheless, *Daniel* didn't lead with the details and refrain from a value judgement, so the > advice applies equally well to him. Lesson learned. Thanks. I agree that this is important. Now to bring the thread back on-topic, I'd like to ask what pb should do *in pr

Re: [Twisted-Python] pb.Copyable knowledge barrier

2014-08-08 Thread Kevin Mcintyre
I experimented today with a table scan from dynamodb. Taking each record and converting to a dictionary into a list. Initial scan and transform took ~8 seconds from amazon to my house over TCP boto which is soapish? i think. ~7800 records. The next call for the remote copy took 7 seconds across

Re: [Twisted-Python] help with listening to UDP broadcast?

2014-08-08 Thread Pantelis Theodosiou
Hi Russell, In an old script I've written, I see the following differences with your code: I hadn't used at all allsetBroadcastAllowed() but joinGroup() (in startPrtotocol). And I don't think the 255.255.255.255 will work. You'll need something like 192.168.1.1 or 127.0.0.1 The code (strippe

[Twisted-Python] help with listening to UDP broadcast?

2014-08-08 Thread Russell E. Owen
I've found an example for UDP broadcasting: However, it combines the sender and receiver in a way that I find confusing. I figured out how output UDP broadcast packets, but not how to make a cli

Re: [Twisted-Python] pb.Copyable knowledge barrier

2014-08-08 Thread Glyph Lefkowitz
On Aug 8, 2014, at 1:31 PM, Kevin Mcintyre wrote: > I think so too, but I'm starting to lean toward websockets. The warnings > alone right? Websockets are a layer well below what PB does. In fact you could run PB over websockets, and it would work roughly the same as over TCP. > But I wi

Re: [Twisted-Python] Is there pb documentation somewhere?

2014-08-08 Thread Glyph Lefkowitz
On Aug 8, 2014, at 11:26 AM, exar...@twistedmatrix.com wrote: >> This was a complaint about a general trend, not about specific words. >> Clearly exarkun gave you the impression that it is "bad", whether he >> specifically said so or not. > > Could you clarify what you think the problem here a

Re: [Twisted-Python] pb.Copyable knowledge barrier

2014-08-08 Thread Kevin Mcintyre
I think so too, but I'm starting to lean toward websockets. The warnings alone right? But I will take another pass and report back any success. Cheers, On Fri, Aug 8, 2014 at 9:04 AM, Daniel Sank wrote: > I think Cacheable exists to handle the case you want. Beware there are > some funny iss

Re: [Twisted-Python] Is there pb documentation somewhere?

2014-08-08 Thread exarkun
On 05:57 pm, gl...@twistedmatrix.com wrote: On Aug 7, 2014, at 10:42 AM, Daniel Sank wrote: glyph, > I really wish we would stop calling things "bad" and "good". My wording of exarkun's wording. He gave a much more detailed description of what he think's is "crazy" about pb. This was a co

Re: [Twisted-Python] Is there pb documentation somewhere?

2014-08-08 Thread Glyph Lefkowitz
On Aug 7, 2014, at 10:42 AM, Daniel Sank wrote: > glyph, > > > I really wish we would stop calling things "bad" and "good". > > My wording of exarkun's wording. He gave a much more detailed description of > what he think's is "crazy" about pb. This was a complaint about a general trend, not

Re: [Twisted-Python] pb.Copyable knowledge barrier

2014-08-08 Thread Daniel Sank
I think Cacheable exists to handle the case you want. Beware there are some funny issues with Cacheable https://twistedmatrix.com/trac/ticket/7274 Daniel On Fri, Aug 8, 2014 at 8:01 AM, Kevin Mcintyre wrote: > The question is what's necessary to get knowitall.py to receive updates to > held c

Re: [Twisted-Python] pb.Copyable knowledge barrier

2014-08-08 Thread Kevin Mcintyre
The question is what's necessary to get knowitall.py to receive updates to held copy. I start server, start knowitall, run wordsmith. Knowitall doesn't receive updates. I understand why, setCopyableState only gets fired once. Guessing jelly doesn't hold onto the RemoteCopy or a reference to Remo

Re: [Twisted-Python] pb.Copyable knowledge barrier

2014-08-08 Thread Daniel Sank
Kevin, Is there a question there? I'd be happy to try to help if I knew what you were asking. On Thu, Aug 7, 2014 at 11:42 PM, Kevin Mcintyre wrote: > wordsmith argument order issues re-take. > > Cheers, > Kevin > > > On Thu, Aug 7, 2014 at 11:29 PM, Kevin Mcintyre wrote: > >> goal: Give know