Re: [Twisted-Python] reactor for Linux io_uring

2021-03-13 Thread Tobias Oberstein
Am 13.03.21 um 01:01 schrieb Ian Haywood: On 12/03/2021 8:29 pm, Tobias Oberstein wrote: since with io_uring the queue/ring to append to never blocks for writes, that buffering in twisted would lead to double buffering (as the ring already buffers) then, io_uring follows a completion IO

Re: [Twisted-Python] reactor for Linux io_uring

2021-03-12 Thread Tobias Oberstein
interesting. thanks! Am 12.03.21 um 09:59 schrieb Ian Haywood: On 12/03/2021 7:21 pm, Tobias Oberstein wrote: sorry, I missed the beginning of the thread / discussion: are you working on a new, full Twisted reactor on top of io_uring? and async filesystem is "just" one part /

Re: [Twisted-Python] reactor for Linux io_uring

2021-03-12 Thread Tobias Oberstein
sorry, I missed the beginning of the thread / discussion: are you working on a new, full Twisted reactor on top of io_uring? and async filesystem is "just" one part / additional effort in that? Am 12.03.21 um 05:42 schrieb Ian Haywood: On 11/01/2021 8:26 pm, Glyph wrote: seems somewhat irrelev

Re: [Twisted-Python] Twisted v21.2.0 breaks Crossbar.io

2021-03-03 Thread Tobias Oberstein
but we have had enough difficulty keeping our CI configuration current based on what cloud provider is falling over this month ;-). Yes, CI seems to be universally one of those things that is conceptually simple but somehow takes hours and hours to maintain. Absolutely agreed, glad that it's

Re: [Twisted-Python] Twisted v21.2.0 breaks Crossbar.io

2021-03-03 Thread Tobias Oberstein
on their end.  If initially, say, crossbar and matrix would like to work with us to set up some kind of repeatable pattern we can suggest to others, that would be great. ok, I'll take that to the team: https://github.com/crossbario/crossbar/issues/1867 tldr: we could run our CI in 2 sets, one

Re: [Twisted-Python] Twisted v21.2.0 breaks Crossbar.io

2021-03-02 Thread Tobias Oberstein
thon mailing list Twisted-Python@twistedmatrix.com https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python -- Tobias Oberstein - phone +49 176 2375 2055 - tobias.oberst...@crossbario.com Crossbar.io GmbH - Waldstrasse 18 - 91054 Erlangen HRB 15870 - Amtsgericht Fuerth - Geschäftsf

Re: [Twisted-Python] Twisted v21.2.0 breaks Crossbar.io

2021-03-02 Thread Tobias Oberstein
Hi Craig, thanks for your answer, tips and questions! much appreciated Am 03.03.21 um 02:58 schrieb Craig Rodrigues: On Tue, Mar 2, 2021 at 12:12 PM Tobias Oberstein mailto:tobias.oberst...@gmail.com>> wrote: this fix broke our workaround for the bug now fixed;) I had to rea

[Twisted-Python] Twisted v21.2.0 breaks Crossbar.io

2021-03-02 Thread Tobias Oberstein
Hi all, rgd Twisted v21.2.0, thanks a lot to all involved in this release! the release, mypy, more py3, .. +1! really appreciated. now, fwiw, just wanted to let you know (sorry, too late) about a regression with https://github.com/crossbario/crossbar that actually originates from https://

Re: [Twisted-Python] Twisted tips for designing highly concurrent twisted REST API

2019-07-14 Thread Tobias Oberstein
ailing list Twisted-Python@twistedmatrix.com <mailto:Twisted-Python@twistedmatrix.com> https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com https://twistedmatrix.com/cgi-

Re: [Twisted-Python] Twisted Conch on v19.2.1: now requires explicit installation of bcrypt

2019-04-13 Thread Tobias Oberstein
Hi Glyph, I'm not sure if it considered a Twisted bug, It's not :). but Twisted Conch on Twisted 19.2.1 now seems to require explicit installation of bcrypt, which wasn't the case on <19.2.1. This is not exactly accurate. What happened here is that your other dependencies /happened/ to le

[Twisted-Python] Twisted Conch on v19.2.1: now requires explicit installation of bcrypt

2019-04-12 Thread Tobias Oberstein
Hi, I'm not sure if it considered a Twisted bug, but Twisted Conch on Twisted 19.2.1 now seems to require explicit installation of bcrypt, which wasn't the case on <19.2.1. Here is our (Crossbar.io) tracking issue: https://github.com/crossbario/crossbar/issues/1555 Not a big deal obviously

Re: [Twisted-Python] ws(s):// urls and host/port duplication in twisted/autobahn code

2019-04-11 Thread Tobias Oberstein
Am 10.04.19 um 19:46 schrieb meejah: Chris Withers writes: Not sure I follow, I specify ws:// and things work. What am I missing? (I know the initial protocol is http and that's "upgraded" into websocket, but the url is still ws:// or wss://, right?) What Tobias is getting at, I think, is th

Re: [Twisted-Python] Twisted 19.2.0rc2 Release Candidate Announcement

2019-04-03 Thread Tobias Oberstein
Hi Amber, I did a quick test for crossbar/autobahn (linux, fresh venvs): looks good! cpython 3.7.2 https://gist.github.com/oberstet/c950a07ca8c3d52d405fa2994f1ce3a9 pypy 7.0.0 https://gist.github.com/oberstet/ce0642528a2a71dd451c13681adda3e8 greets, /Tobias Am 27.03.19 um 10:59 schrieb Am

Re: [Twisted-Python] stop/start client connections with loseConnection in ReconnectingClientFactory

2019-04-02 Thread Tobias Oberstein
Am 02.04.19 um 09:50 schrieb Chris Withers: On 02/04/2019 08:25, Tobias Oberstein wrote: https://github.com/crossbario/autobahn-python/blob/master/examples/twisted/wamp/basic/client_using_clientservice.py Any way to get rid of the ugly duplication between the url in line 69 and the endpoint

Re: [Twisted-Python] stop/start client connections with loseConnection in ReconnectingClientFactory

2019-04-02 Thread Tobias Oberstein
Am 02.04.19 um 09:03 schrieb Chris Withers: On 02/04/2019 07:56, Tobias Oberstein wrote: Would be good to get that converted... yeah, agreed. unlikely to happen though (lack of time) unless someone steps up with a PR Okay, but then don't be surprised when people get tripped up

Re: [Twisted-Python] stop/start client connections with loseConnection in ReconnectingClientFactory

2019-04-01 Thread Tobias Oberstein
The Autobahn guys still show ReconnectingClientFactory in their docs, Where did you find that? That would be a doc bug, but in the _docs_, there is no reference to ReconnectingClientFactory We do have some example code using ReconnectingClientFactory though: Yeah, this one: https://github.c

Re: [Twisted-Python] Drop support for Python 3.4?

2019-03-27 Thread Tobias Oberstein
Python 3.5 is still the default python3 version in Debian stable, so updating beyond that might make it more complex for Debian users to install Twisted. yeah, that, and: as of today, pypy3 is at python 3.5 so _not_ supporting 3.5 would definitely be a problem for us (crossbar.io) dropping 3.4

Re: [Twisted-Python] stop/start client connections with loseConnection in ReconnectingClientFactory

2019-03-26 Thread Tobias Oberstein
Hopefully at least some of this is convincing :) all and each of them is convincing;) -g _______ Twisted-Python mailing list Twisted-Python@twistedmatrix.com https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python -- Tobias Oberstein - phone +4

Re: [Twisted-Python] txtorcon 0.19.0

2017-04-21 Thread Tobias Oberstein
congrats on the release! > * big revamp / re-write of the documentation, including the new >Programming Guide: >https://txtorcon.readthedocs.io/en/latest/guide.html The new docs are very nice .. and the txtorcon logo in "big" looks really cool;) __

Re: [Twisted-Python] Elliptic Curve support

2017-04-17 Thread Tobias Oberstein
Hi, I do think letting users configure the permissible curves (and their priority) using a public tx API, and exposing all of the curves that the underlying openssl provides is important. FWIW, the german BSI (a state IT security institute that provides recommendations, and certifications) n

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-24 Thread Tobias Oberstein
Honestly, in the years I’ve been running Python services of different sizes, I have found that distro-provided system packages – unless you are writing software *for* a distribution – are loaded with so many downsides that they’re almost never worth it. They’re a shortcut and shortcuts usually

[Twisted-Python] ANN: txaio-etcd

2017-02-16 Thread Tobias Oberstein
Hi, txaio-etcd is a etcd3 client library for Twisted that is fully asynchronous and pure Python: https://github.com/crossbario/txaio-etcd It also exposes advanced features like watching keys, transactions and leases: https://github.com/crossbario/txaio-etcd/tree/master/examples Releases a

Re: [Twisted-Python] Streaming HTTP

2015-11-17 Thread Tobias Oberstein
Am 17.11.2015 um 11:49 schrieb Cory Benfield: On 15 Nov 2015, at 10:18, Tobias Oberstein wrote: How does flow-control work with the Go API? How does user code processing chunks received unleash backpressure onto the sender? One caveat: I am not an expert in what Go is doing here, more a

Re: [Twisted-Python] Twisted Web at 630k reqs/sec

2015-11-16 Thread Tobias Oberstein
Are you sure IOCP is able to share sockets between process? It would be great if you can share some info about this. I only use No, I am not sure. But this SO reply seems to suggest http://stackoverflow.com/questions/14388706/socket-options-so-reuseaddr-and-so-reuseport-how-do-they

Re: [Twisted-Python] Streaming HTTP

2015-11-15 Thread Tobias Oberstein
We should then move to an API that is much more like the one used by Go: specifically, that by default all requests/responses are streamed. > Request objects (and, logically, any other object that handles requests/responses, such as Resource) should be extended to have a chunkReceived method >

Re: [Twisted-Python] Twisted Web at 630k reqs/sec

2015-11-15 Thread Tobias Oberstein
Hi Tobias Have you tried to test crossbar on windows? I heard that stdio Yes, I have tried that;) Crossbar.io supports Windows! performs very bad on windows. I noticed crossbar use pipe to transfer data between process. Only for control/management: that is traffic between the node con

Re: [Twisted-Python] Twisted Web at 630k reqs/sec

2015-11-11 Thread Tobias Oberstein
Those are some nice numbers, to be sure! Twisted really benefits from running in a pypy vm. I have read that pypy still doesn’t optimize old-style classes as efficiently as new-style classes; I wonder if there would be any meaningful change in the metrics if resource.Resource was a new-style

[Twisted-Python] Twisted Web at 630k reqs/sec

2015-11-10 Thread Tobias Oberstein
Hi, maybe it's of interest how far it's possible to drive Twisted Web on modern multi-core CPUs. Here are 2 data points from measuring: * 627990 HTTP requests/s at 360 us avg latency * 12.6 GB/s HTTP reply traffic This is using 40 Xeon cores and serves HTTP over loopback TCP to 8 threads of

[Twisted-Python] Crossbar.io 0.11.0

2015-09-07 Thread Tobias Oberstein
Hi all, I am pleased to announce Crossbar.io 0.11.0 https://github.com/crossbario/crossbar#crossbario https://pypi.python.org/pypi/crossbar/0.11.0 Crossbar.io is an open-source WAMP application router that allows to build advanced applications from loosely-coupled components that can talk in

Re: [Twisted-Python] Exception's Implicit Public API, and Python 3

2015-09-06 Thread Tobias Oberstein
Put differently, Twisted's "the first one's free" policy applies to upgrading Twisted itself, and /not/ to upgrading Python (or any other dependency). If you upgrade Python and you need to update your code for that, Twisted won't create any additional problems but it won't go out of its way to so

Re: [Twisted-Python] New Supported Platforms - Python 3.3 and Python 3.4 on Debian 7

2015-05-08 Thread Tobias Oberstein
Awesome work, Hawkie! Thanks for going through all nitty gritty details and - for getting everything reviewed/merged;) Cheers, /Tobias > -Ursprüngliche Nachricht- > Von: twisted-python-boun...@twistedmatrix.com [mailto:twisted-python- > boun...@twistedmatrix.com] Im Auftrag von HawkOwl

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-20 Thread Tobias Oberstein
> > Anyway. I think WAMP is a great choice to hook up components of a > distributed test system - which is what I am after (e.g. I want to orchestrate > 10 TCP load probes running on different machines, stressing a target TCP > echo server). > > > > This difference in opinion might be because we ha

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-19 Thread Tobias Oberstein
All the extra complexity is hidden using WAMP and AutobahnJS. >>>Oh well.  I'm not going to spend much more effort to convince you that this >>>is >>>a bad idea.  Maybe someone else will. >>That's ok for me.  >>I guess we will create something in-house that fits what we need. >I don't think

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-18 Thread Tobias Oberstein
> >> >It seems, reporting the results via a WAMP RPC to a backend should > >> >be quite easy to add in speedcenter.py > >> > >>WAMP? I don't think so. I understand you work in that space a lot > >>but I think you might want to take a step back. The extra complexity > >>of WebSockets is pointless

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-18 Thread Tobias Oberstein
> >>which POSTs structured data (though urlencoded, not JSON) to the > >>codespeed server. > > > >I see. And codespeed parsest that, stores it in a database and produces > >graphics? > > > >It seems, reporting the results via a WAMP RPC to a backend should be > >quite easy to add in speedcenter.py

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-17 Thread Tobias Oberstein
> >>On Jan 12, 2015, at 12:49 PM, Tobias Oberstein But what is the > >>"interface" between test cases from "twisted- benchmarks" to > >>codespeed? > > > >Codespeed runs the benchmark, and they print out this stuff: > >https://bazaar.

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-17 Thread Tobias Oberstein
First, sorry for sluggish response time .. >>>E.g. I need latency histograms, but this seems unsupported (benchmark >>>results can >>>only have avg/min/max/stddev). For me, this isn't "nice to have", but >>>essential. >>>Throughput is one thing. Constistent low latency a completely different. Th

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-12 Thread Tobias Oberstein
> > Probably the test machine was changed, a new version of OpenSSL or > pyOpenSSL, or something else? > > One of those things. There is no infrastructure in place for identifying > events > which impact the performance testing infrastructure. The only performance Yes, this is an important poi

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-10 Thread Tobias Oberstein
>It sounds like http://speed.twistedmatrix.com but far more ambitious :). Are >you familiar with that site, and the benchmarks repository that powers it? >It's nowhere near as comprehensive as what you'd like, but it is a good place >to start. I've look into it a little. I am confused;) E.g.

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-10 Thread Tobias Oberstein
>>I would need to somehow justify/book these investments. I have "ideas" about >>that, but step by step: what do you think about above? >It sounds like http://speed.twistedmatrix.com but far more ambitious :).  Are >you familiar with that site, and the benchmarks repository that powers it?   >It

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-10 Thread Tobias Oberstein
Hi glyph, >>I get strange results. >>Sluggish performance: >Did you ever diagnose this further?  This seems like the sort of thing that we >should start having a performance test for. Not yet. I didn't reply again since you gave me enough homework already: - Run the producer/consumer variant o

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-02 Thread Tobias Oberstein
> >Now, my suspicion is that Twisted is reading off the TCP stack from the > >kernel and buffering in userspace faster than the echo server is > >pushing out stuff to the TCP stack into the kernel. Hence, no TCP > >backpressure results, netperf happily sends more and more, and the > >memory of the

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-02 Thread Tobias Oberstein
>>Unfortunately, it doesn't seem to work (the problem persists): >Your "streaming" flag is wrong.  A TCP transport is an IPushProducer (it will >produce data without being asked).  Try setting it to True and see if that >helps? With streaming == True and cProfile added https://github.com/oberst

Re: [Twisted-Python] Twisted receiving buffers swamped?

2015-01-02 Thread Tobias Oberstein
>>I am aware of  >>http://twistedmatrix.com/documents/14.0.0/core/howto/producers.html, but that >>seems to cover the sending side only. >It covers the receiving side as well.  If you pauseProducing() on a transport, >it stops calling dataReceived on its transport. Not sure I understand that. B

[Twisted-Python] Twisted receiving buffers swamped?

2015-01-01 Thread Tobias Oberstein
Hi, I am doing network performance tests using netperf on a trivial Twisted TCP echo server (code at the end). One of the tests that netperf offers is throughput, and I am running into an issue with this. When running the test (loopback) for 10 seconds on the test box I get a throughput of

[Twisted-Python] Looking for Python/Twisted developer to work on Open-source

2014-12-05 Thread Tobias Oberstein
Hi, we're looking for an experienced, dedicated Python / Twisted developer to work on http://crossbar.io/ helping us move faster. The code base is around 40k LOC right now, all open-source here https://github.com/crossbario/crossbar https://github.com/tavendo/AutobahnPython This stuff is all n

Re: [Twisted-Python] Twisted WebSockets Branch

2014-08-24 Thread Tobias Oberstein
Hi Rob, if your main concern is robust WebSocket on Twisted, why not use Autobahn (https://pypi.python.org/pypi/autobahn) ? Autobahn supports wrapping arbitrary stream-based protocols on top of WebSocket, with full support for advanced features like WebSocket compression and auto-fragmentation

Re: [Twisted-Python] Serving WSGIResource via SSL endpoint

2014-08-15 Thread Tobias Oberstein
>Maybe I generated my certs wrong or something? I just did  Did you set the "Common Name" (CN) correctly? FWIW, you might have look at this recipe https://github.com/crossbario/crossbar/wiki/Secure%20WebSocket%20and%20HTTPS#using-self-signed-certificates Ignore the other stuff / the site in gen

Re: [Twisted-Python] Serving WSGIResource via SSL endpoint

2014-08-15 Thread Tobias Oberstein
>generated a .key file and a .crt file with openssl, and then cat'd them >together to make a pem, and then changed the endpoint to be... >   endpoint = 'ssl:port=8000:privateKey=/path/to/key.pem' you could try to not concat key and cert, but leave them separate: endpoint = 'ssl:port=8000:private

Re: [Twisted-Python] Scalability of timers

2014-08-10 Thread Tobias Oberstein
> Just a final note.. a single no-fds call to select with a 0 timeout seems to > take > around 280ns on my Core 2. Presumably the better interfaces (e.g. epoll, but Are you sure there is actually a context switch happening with this syscall using no FDs and timeout 0? 280ns means your machine c

Re: [Twisted-Python] Scalability of timers

2014-08-10 Thread Tobias Oberstein
>>I want to trade less precision (timers fire at less exact times) for higher >>efficiency (less context switches). >It's easy enough to write one yourself. This might work: >from twisted.internet.task import Clock, LoopingCall > >clock = Clock() >LoopingCall(lambda: clock.advance(0.001)).start(

Re: [Twisted-Python] Scalability of timers

2014-08-10 Thread Tobias Oberstein
ou can set the max hz of select(), but in all > likelihood you > won't have to. As always, benchmarking and profiling real code might reveal > this to be a non-issue. Thanks a lot for those hints! I will read into this material. /Tobias > > > David > > > > >

Re: [Twisted-Python] Scalability of timers

2014-08-10 Thread Tobias Oberstein
> >What I am after is to explicitly _control_ the maximum syscall rate to > >select() - not simply max. out the box on syscall rate. > > > >Like: limit syscall rate to select() at 1000Hz - regardless how many > >timers I issue per second. > > In other words: > > If you ask Twisted to wake up N ti

Re: [Twisted-Python] Scalability of timers

2014-08-10 Thread Tobias Oberstein
I don't want to let the box hit it's syscall rate limit. Because the box will spend a fair amount of resources for context switching all the time with to real gain. Thanks for your hints and patience, Tobias > > > On Sun, Aug 10, 2014 at 05:16:51AM -0700, Tobias Oberstein wro

Re: [Twisted-Python] Scalability of timers

2014-08-10 Thread Tobias Oberstein
>There is only one select() call (or whatever) at any given time, regardless of >how many timers. Yes, I do understand this. >Syscalls are thus O(1). Timers are stored in sorted order. When event loop >wakes up it removes timers that have been reached, which is fast because >they're sorted so

[Twisted-Python] Scalability of timers

2014-08-10 Thread Tobias Oberstein
Hi, I have a question regarding scalability of timers in Twisted. Say I have a massive number of periodic timers (lets say each with period 1s, but all slightly time shifted to each other). As far as I understand, timers are implemented ultimately by setting the timeout parameter when calling

Re: [Twisted-Python] Tubes!

2014-07-11 Thread Tobias Oberstein
> Specifically, I think it would be beneficial to set up a tubes project on > Github > under the Twisted organization and try for a release in the very near future. > > I think this has several advantages over the status quo: +1 for splitting into a separate project. even if Tubes would be cons

Re: [Twisted-Python] Announcing Crossbar.io

2014-06-12 Thread Tobias Oberstein
at content right up front on your project's main page. Tom On Thu, Jun 5, 2014 at 6:00 AM, Tobias Oberstein mailto:tobias.oberst...@tavendo.de>> wrote: Hi Glyph, The process support in Twisted is just awesome! It is well designed and robust across platforms. Both are _big_ things

Re: [Twisted-Python] Announcing Crossbar.io

2014-06-05 Thread Tobias Oberstein
-boun...@twistedmatrix.com [mailto:twisted-python-boun...@twistedmatrix.com] Im Auftrag von Glyph Gesendet: Donnerstag, 5. Juni 2014 05:40 An: Twisted general discussion Betreff: Re: [Twisted-Python] Announcing Crossbar.io Congrats on launching this, Tobias! On Jun 4, 2014, at 3:21 PM, Tobias Ober

[Twisted-Python] Announcing Crossbar.io

2014-06-04 Thread Tobias Oberstein
Hi, this is an early announcement of Crossbar.io, a new application server based on Twisted and Autobahn. Crossbar.io is an open-source application router that allows to build distributed systems out of application components which are loosely coupled and communicate in (soft) real-time. READ

Re: [Twisted-Python] Security Advisory: OpenSSL 1.0.1g

2014-04-08 Thread Tobias Oberstein
> Any machine which is serving traffic over TLS, or which is making outgoing TLS > connections should upgrade it's version of OpenSSL immediately. > > This issue has been assigned CVE-2014-0160. Thanks for bringing this to attention! Here is a test tool that checks for the vuln. https://github.

Re: [Twisted-Python] which async framework?

2014-03-12 Thread Tobias Oberstein
> From my side, I'm looking to experimentally build a network testing tool that > will need to speak a fair few protocols, both classic tcp and multicast-based, Tornado is a _Web_ framework. A requirement for UDP, and multicast UDP, narrows suitable choices to Twisted and asyncio. Twisted is aro

Re: [Twisted-Python] Setting socket options before bind/listen

2014-02-03 Thread Tobias Oberstein
> >Would you mind giving a tip on how to make use of a CustomPort deriving > >of Port? How to "plug" that into Twisted? > > I have two suggestions, one of which I hope you'll like and the other of which > you might not. :) Awesome! This is enough hints to get me started. I already have Twisted e

Re: [Twisted-Python] Setting socket options before bind/listen

2014-02-03 Thread Tobias Oberstein
> >for a multiprocess server, I'd like to set SO_REUSEPORT on a TCP > >listening socket. > > You might find that https://stackoverflow.com/questions/10077745 > /twistedweb-on-multicore-multiprocessor obviates the need for this option (and > thus your follow-up features as well). Jean-Paul, yes,

[Twisted-Python] Setting socket options before bind/listen

2014-02-03 Thread Tobias Oberstein
Hi, for a multiprocess server, I'd like to set SO_REUSEPORT on a TCP listening socket. The option needs to be set _before_ calling bind() and listen() on the socket. Is there a recommended way of doing this? One option might be subclassing `twisted.internet.tcp.Port` and overriding `createInt

Re: [Twisted-Python] Protocol for socket.io

2014-01-26 Thread Tobias Oberstein
Hi Laurens, >Hm. I can't find it in the current version. Either I am misremembering, or >they expect you to use the pubsub thing as an RPC mechanism somehow (i.e. the >room name is the procedure name). I see. Using PubSub to implement RPC seems hackish at best, if it works at all. E.g. how to

Re: [Twisted-Python] Protocol for socket.io

2014-01-26 Thread Tobias Oberstein
>socket.io adds a few things like "RPC support" and "pubsub", ... Do you have pointers for that? I can see socket.io supports "topic based pubsub" like functionality via "rooms" : https://github.com/LearnBoost/socket.io/wiki/Rooms What about RPC? /Tobias _

[Twisted-Python] Autobahn 0.7.0 released

2014-01-02 Thread Tobias Oberstein
Hi, I am happy to announce the release of AutobahnPython 0.7.0 https://github.com/tavendo/AutobahnPython https://pypi.python.org/pypi/autobahn This release brings 4 major features: 1) full support for Twisted endpoints, a wrapping protocol/factory and a generic endpoint forwarder https://gith

Re: [Twisted-Python] Twisted Endpoints and WebSocket / Autobahn

2013-12-31 Thread Tobias Oberstein
Matt, > That's neat! Endpoints rock. I'd like to put this up on twistedftw.org -- I > look > forward to your complete example. Great! All examples and all code is here https://github.com/tavendo/AutobahnPython/tree/master/examples/twisted/websocket/wrapping and here https://github.com/taven

Re: [Twisted-Python] Twisted Endpoints and WebSocket / Autobahn

2013-12-31 Thread Tobias Oberstein
> > Thing is: I was looking for --endpoint "..." argument with twistd, but > > there isn't. > > > > How is the full endpoint "vision" supposed to work out? I mean, being > > able to: > > > > twistd conch --endpoint "autobahn:tcp\:80:url=ws\://myhost.com" > > > > to run a conch server that can be ac

Re: [Twisted-Python] Twisted Endpoints and WebSocket / Autobahn

2013-12-30 Thread Tobias Oberstein
> > Endpoints are cool! > > AWESOME > > I'm just thrilled at more third-party plugins starting to take advantage of > this > powerful extensibility API. This looks great. Thanks for endpoints! I think it's a concept in very good Unix tradition: make everything look the same (stream/endpoi

Re: [Twisted-Python] Twisted Endpoints and WebSocket / Autobahn

2013-12-30 Thread Tobias Oberstein
Hi, I've made Autobahn fully Endpoint aware. You can run WebSocket over any stream-based endpoint https://github.com/tavendo/AutobahnPython/tree/master/examples/twisted/websocket/echo_endpoints and you can run any stream-based endpoint over WebSocket (which in turn runs over any stream-based u

Re: [Twisted-Python] Twisted Endpoints and WebSocket / Autobahn

2013-12-13 Thread Tobias Oberstein
> > I am working on Twisted Endpoint support in Autobahn > https://github.com/tavendo/AutobahnPython. > > Yay! Endpoints are cool. FWIW, here is a working example of WebSocket I tested over both Unix domain sockets and the usual TCP/TLS endpoints: https://github.com/tavendo/AutobahnPython/tree

[Twisted-Python] Twisted Endpoints and WebSocket / Autobahn

2013-12-12 Thread Tobias Oberstein
Hi, I am working on Twisted Endpoint support in Autobahn https://github.com/tavendo/AutobahnPython. So far, I made Autobahn able to talk WebSocket _over_ arbitrary Twisted Endpoints, e.g. WebSocket over Unix domain sockets works. This is already quite nifty. Is there anything like Twisted End

[Twisted-Python] Update: FreeBSD builders

2013-11-20 Thread Tobias Oberstein
Hi, the 3 builders for the new FreeBSD 9.2 x86-64 slave are up and running: http://buildbot.twistedmatrix.com/buildslaves/tavendo-freebsd-9.2-amd64 Nov 20 09:42601a9d1cb6eb... failure freebsd-9.2-amd64-python2.7 #12 Failed 1 test (select) 1 test (poll) 3 tes

Re: [Twisted-Python] FreeBSD buildslaves: change proposal

2013-11-18 Thread Tobias Oberstein
Alright, the new buildslave is active, the old ones retired. http://buildbot.twistedmatrix.com/buildslaves/tavendo-freebsd-9.2-amd64 There are a couple of env issues as well as test issues .. I'll look into both .. /Tobias ___ Twisted-Python mailing

[Twisted-Python] WG: FreeBSD buildslaves: change proposal

2013-11-12 Thread Tobias Oberstein
somehow the Twisted list rejects my posts lately;( Von: Tobias Oberstein Gesendet: Dienstag, 12. November 2013 20:48 An: Twisted general discussion (twisted-python@twistedmatrix.com) Cc: pypy-...@python.org Betreff: FreeBSD buildslaves: change proposal Hi, we (Tavendo) currently operate 2

[Twisted-Python] FreeBSD buildslaves: change proposal

2013-11-12 Thread Tobias Oberstein
Hi, we (Tavendo) currently operate 2 Twisted/FreeBSD buildslaves: a) FreeBSD 8.2, i386 with 1 builder (CPy 2.7) => part of the list of "officially supported" builders b) FreeBSD 9.1, amd64 with 2 builders (CPy 2.7 and PyPy) => only listed under "unsupported" We would like to change that into th

Re: [Twisted-Python] Scaling Twisted Web on multicore

2013-10-31 Thread Tobias Oberstein
> Looks nice. It's something that has been around in poor form for a long time > in > several places (I'm thinking about > http://twistedmatrix.com/trac/browser/sandbox/exarkun/copyover/ which > inspired http://twistedmatrix.com/trac/browser/sandbox/therve/prefork/). Wow. 10 years ago.;) I alread

Re: [Twisted-Python] Scaling Twisted Web on multicore

2013-10-31 Thread Tobias Oberstein
> > I have done some testing of scaling Twisted Web on multicore and wanted to > share: > > > > > https://github.com/oberstet/scratchbox/tree/master/python/twisted/sharedsoc > ket > > > This was PyPy, yes? Yes. All testing details are in the README.md .. __

[Twisted-Python] Scaling Twisted Web on multicore

2013-10-30 Thread Tobias Oberstein
Hi, I have done some testing of scaling Twisted Web on multicore and wanted to share: https://github.com/oberstet/scratchbox/tree/master/python/twisted/sharedsocket For those that are running short in time or want to have a teaser first, here are the results, including comparison with Nginx:

Re: [Twisted-Python] Twisted 13.2.0pre1 Testing Feedback

2013-10-28 Thread Tobias Oberstein
> Brilliant - hynek mentioned a few more SSL tickets in the pipeline which > should hopefully be in 14.0 - so hopefully we can get rid of all of the monkey > patching eventually! :) That would be neat. There are 2 issues in pyOpenSSL which would needed to be resolved for monkey patching going away

Re: [Twisted-Python] Twisted 13.2.0pre1 Testing Feedback

2013-10-28 Thread Tobias Oberstein
> I've yet to hear back from anyone testing the prerelease - if you're able to, > please do! Tested with Autobahn (WebSocket) + Twisted Web based stuff .. no issues found. > It also supports SSL chain certificates, which should also fix up some issues > using TLS with Twisted - this would also be

[Twisted-Python] WG: "mind" introduced strangely in pb howto

2013-10-24 Thread Tobias Oberstein
maybe the mailing list disallows >2 attachments .. again: http://picpaste.com/pics/step1-NB1LoEVR.1382620207.png http://picpaste.com/pics/step2-6zVhXeE6.1382620274.png http://picpaste.com/pics/step3-KTao4B2V.1382620308.png -Ursprüngliche Nachricht- Von: Tobias Oberstein Gesen

Re: [Twisted-Python] "mind" introduced strangely in pb howto

2013-10-24 Thread Tobias Oberstein
> Your server definitely sends three certificates - that's surprising/confusing. > > Could you double-check how you've achieved that? If you google for chain > certs & Twisted you'll find all kinds of monkey patches to achieve that; and > when I run twistd -n web with a pem that has multiple certi

Re: [Twisted-Python] "mind" introduced strangely in pb howto

2013-10-24 Thread Tobias Oberstein
> > A concatenated cert like above works today without the new code that is > upcoming in Twisted. Which is cool also. > > That is completely new to me. Are you sure you're not mixing up Twisted's > behavior with nginx? > > If what you say is true, there would have never been the need for #2061 a

Re: [Twisted-Python] "mind" introduced strangely in pb howto

2013-10-24 Thread Tobias Oberstein
[Twisted-Python] "mind" introduced strangely in pb howto > > Am 24.10.2013 um 09:02 schrieb Tobias Oberstein > : > > >> I just tried to register so I could do that. When I clicked on the > >> register button after filling out the username/password fields my

Re: [Twisted-Python] epoll keep sharing state between process even after fork.

2013-10-23 Thread Tobias Oberstein
Hi, this is funny, I am also working in this area currently. Though I use spawnProcess for various reasons, not multiprocessing - which is also the recommendation on the ticket. And it makes sense. Nevertheless I'd be interested what happens if you try that on a kqueue-reactor OS .. ideally Fr

Re: [Twisted-Python] Flow-control for Pipes / Unix Domains Sockets?

2013-10-23 Thread Tobias Oberstein
x.com [mailto:twisted-python-boun...@twistedmatrix.com] Im Auftrag von Tobias Oberstein Gesendet: Mittwoch, 23. Oktober 2013 00:58 An: Twisted discussion Betreff: Re: [Twisted-Python] Flow-control for Pipes / Unix Domains Sockets? Hi Itamar, once again Twisted surprises me: it just works! I have tested a

Re: [Twisted-Python] Flow-control for Pipes / Unix Domains Sockets?

2013-10-22 Thread Tobias Oberstein
ro bs=1k count=100 | wc -c 100+0 records in 100+0 records out 102400 bytes transferred in 17.454178 secs (58667902 bytes/sec) 102400 real0m17.460s user0m18.389s sys0m7.729s On 22.10.13 02:00, "Itamar Turner-Trauring" wrote: On 10/21/2013 04:48 PM, Tobia

Re: [Twisted-Python] Flow-control for Pipes / Unix Domains Sockets?

2013-10-21 Thread Tobias Oberstein
control... by having the consumers pause the producers when need be. For now I just churn packets as fast as possible. David On Mon, Oct 21, 2013 at 1:48 PM, Tobias Oberstein wrote: > Hi, > > with TCP (either remote or loopback) I can have flow-control using the > producer-consumer machine

[Twisted-Python] Flow-control for Pipes / Unix Domains Sockets?

2013-10-21 Thread Tobias Oberstein
Hi, with TCP (either remote or loopback) I can have flow-control using the producer-consumer machinery that Twisted provides. Is that (flow-control / producer-consumer) also available (and practically usable/recommended) with: a) Unix Domain sockets b) Pipes (spawnProcess) ? Thanks! /Tobias

Re: [Twisted-Python] serial communication - getting started

2013-10-21 Thread Tobias Oberstein
Robert, as Itamar said: don't use thread -- you likely don't need them in your scenario. shameless self-plug: http://www.youtube.com/watch?v=va7j86thW5M https://github.com/tavendo/AutobahnPython/tree/master/examples/wamp/serial2ws The example includes both Arduino code and Twisted/Autobahn code

[Twisted-Python] AutobahnTestsuite 0.5.6

2013-10-13 Thread Tobias Oberstein
Hi, we've just release a new version of AutobahnTestsuite - including WebSocket compression testing. Full announcement: https://groups.google.com/forum/#!topic/autobahnws/_WIk5Z_xJ4U Reports: http://autobahn.ws/testsuite#reports_20131013 Takeaways: 1) Compression: => go to section 12 in repor

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-08 Thread Tobias Oberstein
> Ok. Don't say I didn't warn you. Apologies to anyone who forces themselves > to read all this, and please note I DO NOT claim authority on any of this - > I'm > just a random guy. People should decide for themselves. Nothing to apologize .. I have learned from your post. And the pointers you g

Re: [Twisted-Python] ANN: Crochet 0.9.0 - Use Twisted Anywhere!

2013-10-08 Thread Tobias Oberstein
Hi Itamar, Nifty. Wasn't aware. I add it to my toolbelt;) /Tobias PS: One suggestion for the docs: it could be helpful to contrast the approach crochet takes with the other option of having a Twisted Web WSGI resource for running Flask (and other WSGI stuff) so users can make an informed decis

Re: [Twisted-Python] txThings - simple library for CoAP protocol

2013-10-07 Thread Tobias Oberstein
> > E.g., as a start, we could have a dedicated page on the Twistedmatrix > > Web site "Twisted for Things" for intro and collecting links, articles > > etc > > Fun fact: the very first class in the very first thing that would eventually > become Twisted was called "Thing". ;-) What a prevision;

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-07 Thread Tobias Oberstein
> There are *lots* of TLS extensions that eliminate or obviate the need for the > (horrible) PKIX trust model as deployed. For example, TLS PSK, TLS-SRP, the > PGP method you've found, and others. Sure .. however as far as I understand the IETF has only 2 _cert_ schemes sanctioned: x509 and OpenP

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-07 Thread Tobias Oberstein
>>>So in practice, I _have_ to use a CA that is built into all major browsers. >>You're assuming a lot here.  Perhaps TLS is broken for all the uses you're >>interested in - that doesn't mean it's broken for everyone else's uses. @Jean-Paul: Granted .. good catch. My interest is the Web/browser

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-06 Thread Tobias Oberstein
>> Personally, I assume root CA private keys of any CA vendor are owned by >> the NSA anyway. > > There's no rule that says you have to use a "root CA" signed certificate > for your TLS connections. Sure, in theory, but there are multiple practical problems when using self-signed certs or certs s

  1   2   3   >