Re: [Twisted-Python] Twisted receiving buffers swamped?
First, sorry for sluggish response time .. >>>E.g. I need latency histograms, but this seems unsupported (benchmark >>>results can >>>only have avg/min/max/stddev). For me, this isn't "nice to have", but >>>essential. >>>Throughput is one thing. Constistent low latency a completely different. The >>>latter is >>>much much harder. >>Codespeed is terrible. But this is not one of the ways in which it is >>terrible. Codespeed doesn't care if you label your measurement "latency". I >>think you've just noticed that what the existing benchmarks measure is mostly >>(entirely?) throughput. If you wanted to >>write a latency benchmark, I >>don't think anything's stopping you. >I believe Tobias was not saying "codespeed can't have a measurement called >'latency'" but rather "codespeed can't do histograms of measurements, which we >need for measurement of latency and you don't need for measurement of >throughput". Is that accurate? I don't know if there's a histogram feature >hidden in the UI somewhere. Yes, exactly. That's what I meant. As an example of the kind of analysis and visualization I am after, please have a look here: http://www.brendangregg.com/HeatMaps/latency.html In particular, latency heatmaps are an incredible useful visualization. http://www.brendangregg.com/perf.html#HeatMaps >It would be nice to at least try a little bit to contribute things (like a >histogram feature) to codespeed before charging off in a completely different >direction. It is Django and canvas for gfx. The former I have no know-how and no use/motivation for. Rendering HTML on the server isn't something we do anymore (WebSocket talking WAMP to Crossbar.io, anything else is just static HTML/JS/CSS/Images). For the latter, there is D3 (http://d3js.org/) which is awesome and vector graphics. For heatmaps, canvas _might_ be fine, but for virtually anything chart like, D3 has a lot to bring to the table. In general, I can follow the argument of "contributing instead of reinventing" and "paying back", but in this particular case, I can't justify sinking time into this (codespeed). Cheers, /Tobias ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
Re: [Twisted-Python] Twisted receiving buffers swamped?
> >>On Jan 12, 2015, at 12:49 PM, Tobias Oberstein But what is the > >>"interface" between test cases from "twisted- benchmarks" to > >>codespeed? > > > >Codespeed runs the benchmark, and they print out this stuff: > >https://bazaar.launchpad.net/~twisted-dev/twisted- > >benchmarks/trunk/view/head:/benchlib.py#L12 > > > >POSTing them via JSON would be nicer, structured data is great. > > Nothing parses that output. It's just for humans. > > The code you're looking for is: > > https://bazaar.launchpad.net/~twisted-dev/twisted- > benchmarks/trunk/view/head:/speedcenter.py > > which POSTs structured data (though urlencoded, not JSON) to the > codespeed server. I see. And codespeed parsest that, stores it in a database and produces graphics? It seems, reporting the results via a WAMP RPC to a backend should be quite easy to add in speedcenter.py How is Twisted speedcenter orchestrated / triggered? I mean, a new commit to Twisted repo will trigger rerunning all speed tests? If so, how does that work? /Tobias ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
Re: [Twisted-Python] Twisted receiving buffers swamped?
On 05:00 pm, tobias.oberst...@tavendo.de wrote: >>On Jan 12, 2015, at 12:49 PM, Tobias Oberstein But what is the >>"interface" between test cases from "twisted- benchmarks" to >>codespeed? > >Codespeed runs the benchmark, and they print out this stuff: >https://bazaar.launchpad.net/~twisted-dev/twisted- >benchmarks/trunk/view/head:/benchlib.py#L12 > >POSTing them via JSON would be nicer, structured data is great. Nothing parses that output. It's just for humans. The code you're looking for is: https://bazaar.launchpad.net/~twisted-dev/twisted- benchmarks/trunk/view/head:/speedcenter.py which POSTs structured data (though urlencoded, not JSON) to the codespeed server. I see. And codespeed parsest that, stores it in a database and produces graphics? It seems, reporting the results via a WAMP RPC to a backend should be quite easy to add in speedcenter.py WAMP? I don't think so. I understand you work in that space a lot but I think you might want to take a step back. The extra complexity of WebSockets is pointless for this project. Just HTTP POST some JSON. This can be really simple. Your time is almost certainly better spent elsewhere. Jean-Paul How is Twisted speedcenter orchestrated / triggered? I mean, a new commit to Twisted repo will trigger rerunning all speed tests? If so, how does that work? /Tobias ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
[Twisted-Python] Weekly Bug Summary
Bug summary __ Summary for 2015-01-11 through 2015-01-18 Opened Closed Total Change Enhancements: 2 3 1271 -1 Defects: 1 2756 -1 Tasks: 0 0103 +0 Regressions: 0 0 10 +0 Total: 3 5 2140 -2 |== Type Changes |== Priority Changes |== Component Changes |Defect: -1 |Normal: -2 |Core: +1 |Enhancement: -1 |Low: +0 |Mail: -1 |Web: -2 Total Tickets Open Tickets New / Reopened Bugs __ = Normal = [#7748] Tests for twisted.python should conform to the new style of naming test classes (opened by eeshangarg) enhancement core http://twistedmatrix.com/trac/ticket/7748 [#7750] twisted.web.client.Agent's docstring incorrectly claims it doesn't verify certificates (opened by hynek) (CLOSED, fixed) defect webhttp://twistedmatrix.com/trac/ticket/7750 = Low = [#7749] Code formatting standards? (opened by syndbg) (CLOSED, invalid) enhancement core http://twistedmatrix.com/trac/ticket/7749 Closed Bugs __ = Normal = [#7552] Twisted fails to make HTTPS requests to some hostnames (opened by Alex, closed by glyph, wontfix) defect webhttp://twistedmatrix.com/trac/ticket/7552 [#7750] twisted.web.client.Agent's docstring incorrectly claims it doesn't verify certificates (opened by hynek, closed by hynek, fixed) defect webhttp://twistedmatrix.com/trac/ticket/7750 [#7485] Porting t.w._newclient and t.w.t.test_newclient to Python 3 (opened by maximlacrima, closed by glyph, fixed) enhancement webhttp://twistedmatrix.com/trac/ticket/7485 [#6705] Stop _AttemptManager from using Queue.noisy (opened by shira, closed by hawkowl, fixed) enhancement mail http://twistedmatrix.com/trac/ticket/6705 = Low = [#7749] Code formatting standards? (opened by syndbg, closed by Julian, invalid) enhancement core http://twistedmatrix.com/trac/ticket/7749 Ticket Lifetime Stats __ Oldest open ticket - [#50] conch command-line client doesn't work in win32 (since 2003-07-12 14:41:06). Newest open ticket - [#7748] Tests for twisted.python should conform to the new style of naming test classes (since 2015-01-11 05:36:29.915406). Mean open ticket age: 1487 days, 6:18:41.548908. Median: 1223 days, 14:34:48.616266. Standard deviation: 1039 days, 18:44:03.957929. Interquartile range: 1593 days, 23:55:31. Mean time between ticket creation and ticket resolution: 634 days, 13:29:09.947669. Median: 97 days, 7:03:19. Standard deviation is 904 days, 22:18:34.567376. The interquartile range is 996 days, 2:43:49. Mean time spent in review: 107 days, 18:40:03.680177. Median: 5 days, 8:42:32. Standard deviation: 476 days, 12:27:04.895834. Interquartile range: 24 days, 3:34:44. Mean number of times a ticket is reviewed: 1.93150684932. Median: 1 Standard deviation: 1.51227949677. Interquartile range: 1. Contributor Stats __ In the last 4 weeks, 9 unique ticket reporters 3 unique ticket reviewers 3 unique ticket resolvers In the last 24 weeks, 59 unique ticket reporters 20 unique ticket reviewers 10 unique ticket resolvers In the last 48 weeks, 102 unique ticket reporters 30 unique ticket reviewers 20 unique ticket resolvers ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
