Re: [Openstack] Memory leaks from greenthreads

> Has there been any thinking around only using eventlet/greenlet for webserver > endpoints and using something like multiprocessing for everything else? I was already beginning to think that this would be a good blueprint/discussion topic for the design summit ;-) We've seen a number of issues

Re: [Openstack] Debianizing Documentation

Hi Alexey, It's my understanding that patches are only accepted via Gerrit - http://review.openstack.org/ Gerrit is responsible for managing, among other things, code review and the CLA that is required before signing. https://rackspace.echosign.com/public/hostedForm?formid=3G7VVC397N783J <-- CL

Re: [Openstack] [Netstack] Can't associate floating IP

Hi, I tested it with Quantum and I confirm the field 'host' in the 'network' table stays empty. Someone filled a bug for that ? Doude. On Tue, Feb 28, 2012 at 8:06 AM, Vishvananda Ishaya wrote: > ... > At least that is the case for nova-network without quantum. I don't know > if using Quantum

Re: [Openstack] Running for Nova PTL

2012/2/28 Vishvananda Ishaya : > There is always progress to be made, but while we are toiling away working > on testing, technical debt, and code smell, we have to keep our users in > mind. This part of your e-mail really sticks out, along with this one: > I disagree with this point. There was a

Re: [Openstack] Debianizing Documentation

Yes, patches are accepted only through Gerrit. I've written up a "First time contributors" section here: http://wiki.openstack.org/Documentation/HowTo#First-time_Contributors The Starter Guide is housed in Launchpad at: https://launchpad.net/openstackbook It is reviewed and merged through Launchpa

Re: [Openstack] If I open a bug in launchpad + attach a patch, does it get reviewed ?

On 02/29/2012 10:02 PM, Lorin Hochstein wrote: > No, it only shows up in the Gerrit queue > if you submit the patch using git. See: http://wiki.openstack.org/GerritWorkflow -- Russell Bryant ___ Mailing list: https://lau

Re: [Openstack] [Netstack] Can't associate floating IP

Hi Doude, I was dealing with another issue caused by this NULL 'host', and Dan told me that has been fixed: https://github.com/openstack/nova/commit/43f2492175d11a3f8ea4198e65b2a6a6b38cbbb6 I haven't verified, though. Good luck. Best, Tomoe On Thu, Mar 1, 2012 at 10:11 PM, Doude wrote: > Hi,

[Openstack] Who is eligible for vote ?

Hi, I'd like to ask: Who is eligible for vote ? I have submitted half-a-dozen patches to openstack-manuals (on launchpad), and I wanted to ask if I'm eligible ? -- -Alexey Eromenko "Technologov" ___ Mailing list: https://launchpad.net/~openstack Post

Re: [Openstack] Who is eligible for vote ?

Hi :)You mean, to vote, or to be elected ?Cheers Nuage & Co - Razique Mahroua razique.mahr...@gmail.com Le 1 mars 2012 à 15:30, Alexey Eromenko a écrit :Hi,I'd like to ask: Who is eligible for vote ?I have submitted half-a-dozen patches to openstack-manuals (onlaunchpad), and I wanted to ask if I'

Re: [Openstack] Who is eligible for vote ?

On Thu, Mar 1, 2012 at 4:32 PM, Razique Mahroua wrote: > > Hi :) > You mean, to vote, or to be elected ? vote. -- -Alexey Eromenko "Technologov" ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe

Re: [Openstack] Who is eligible for vote ?

Alexey, This depends on which election you're talking about (the PPB elections or the individual project PTL elections). The attached email from Stefano a couple of weeks ago should answer your questions. In a nutshell, if you are a member of the OpenStack group on Launchpad you're eligible to v

[Openstack] Essex OpenStack Global Hack-In

LLoyd and others, The blog post announcement for this event [1] mentions "working on resolving high priority bugs" -- I'm assuming that the following list is what identifies them? (I have filtered on essex-4 and rc1) http://goo.gl/Qe17g That includes "In Progress" ones. This one excludes those,

Re: [Openstack] Who is eligible for vote ?

Sure - "How to register to vote for Project Policy BoardAny registered member of the OpenStack Launchpad group is eligible to vote for the Project Policy Board. If you want to vote you need to register to Launchpad and add yourself to the public OpenStack group onhttps://launchpad.net/~openstack be

Re: [Openstack] Who is eligible for vote ?

Alexey Eromenko wrote: > I'd like to ask: Who is eligible for vote ? > > I have submitted half-a-dozen patches to openstack-manuals (on > launchpad), and I wanted to ask if I'm eligible ? The process was explained by the election officials there: http://www.openstack.org/blog/2012/02/openstack-g

Re: [Openstack] Who is eligible for vote ?

Hi Alexey - To be eligible to vote you must follow the OpenStack election guidelines. [1] Your timing and the method you named are not enough to qualify you for this voting season. These are the guidelines for voting for members of the Project Policy Board, or PPB. "Any registered member of the

Re: [Openstack] Essex-4 milestone proposed candidates

This is a great milestone and I was wondering about upgrade. At the last design summit there was a discussion about how hard/easy it would be to upgrade to Essex. What is the final answer? Are their (going to be) instructions on how to upgrade an operating diablo cluster to essex? And is the an

Re: [Openstack] A brief update on the invites to the Design Summit

On Fri, 2012-02-24 at 09:45 -0800, Stefano Maffulli wrote: > > On March 1st access to the summit will be open to anybody interested > on a first come first served basis. I'm confident we'll be able to > accommodate the demand. As promised: anyone can now register for the OpenStack Spring 2012 'F

Re: [Openstack] Essex-4 milestone proposed candidates

For keystone, we are writing migration docs from Diablo - both with and without keystone configurations. We've implemented export and import mechanisms to bring in data to the new keystone instance, so it's mostly a matter of just explaining how to use it. -joe On Mar 1, 2012, at 7:34 AM, Davi

Re: [Openstack] A brief update on the invites to the Design Summit

Has anyone else had trouble registering for the Design Summit for Free? We have not been able to 'register for the Design Summit only for free.' Any one been able to without paying the $500 for the conference? -BillF On 3/1/12 8:39 AM, Stefano Maffulli wrote: On Fri, 2012-02-24 at 09:45 -0

[Openstack] Fail to reboot VM with Nova + Quantum/OVS

When I try reboot a VM, the nova-compute fails and the daemon stop. It fails on unpluging VIF interface of the rebooted VM. I use Nova with Quantum and OVS. 2012-03-01 18:12:31 DEBUG nova.rpc.common [-] Making asynchronous call on network ... from (pid=21485) multicall /usr/local/src/nova/nova/rpc

Re: [Openstack] New OpenStack Meetup Group: Atlanta

Stef, et al, I never announced the OpenStack Colorado group on the list. We're already listed in the Global Hack In (and were underway today :^) I'll subscribe to the Int'l User Groups. -dave http://meetup.com/OpenStack-Colorado/ On Wed, 2012-02-29 at 10:51 -0800, Stefano Maffulli wrote: > O

Re: [Openstack] New OpenStack Meetup Group: Atlanta

Woo! /me high-fives the Colorado team! d On Thu, Mar 1, 2012 at 12:23 PM, David Medberry wrote: > Stef, et al, > > I never announced the OpenStack Colorado group on the list. We're > already listed in the Global Hack In (and were underway today :^) > > I'll subscribe to the Int'l User Groups. >

Re: [Openstack] Fail to reboot VM with Nova + Quantum/OVS

Hi Doude, At a glance, it seems that unplug() being called twice, with the second call failing because the first call successfully unplugged the vif already. The unplug() action on the bridge does nothing, so there's no harm in calling it twice, which may explain why this is only seen with OVS.

Re: [Openstack] A brief update on the invites to the Design Summit

yeah likewise. On Thu, Mar 1, 2012 at 11:14 AM, William L. Franklin wrote: > Has anyone else had trouble registering for the Design Summit for Free? > We have not been able to 'register for the Design Summit only for free.' > Any one been able to without paying the $500 for the conference? > > -

Re: [Openstack] Essex OpenStack Global Hack-In

I don't know if there is a specific list yet. I just noticed a few new bugs reported by rajalakshmi ganesan that probably could be looked into. https://bugs.launchpad.net/~rajalakshmi-ganesan/+bugs (specifically the nova ones) On Mar 1, 2012, at 6:51 AM, Duncan McGreggor wrote: > LLoyd and o

Re: [Openstack] Fail to reboot VM with Nova + Quantum/OVS

https://review.openstack.org/#change,4754 my devstack setup seems to be having problems with latest trunks, so it may take me a bit longer to test latest. Are you able to test it locally? Two-line change (only one line strictly required). Dan On Thu, Mar 1, 2012 at 9:41 AM, Dan Wendlandt wro

Re: [Openstack] Running for Nova PTL

On Mar 1, 2012, at 5:21 AM, Soren Hansen wrote: > 2012/2/28 Vishvananda Ishaya : >> There is always progress to be made, but while we are toiling away working >> on testing, technical debt, and code smell, we have to keep our users in >> mind. > > This part of your e-mail really sticks out, alon

[Openstack] Keystone should to Apache HTTPD.

I wrote up why I think that, at least for Keystone, we should move the front end over to Apache HTTPD. http://adam.younglogic.com/2012/03/keystone-should-move-to-apache-httpd/ I've reposted it below. Keystone and the other Openstack components run in an href="http://www.eventlet.net";>Eventl

Re: [Openstack] Memory leaks from greenthreads

I wrote up why I think that, at least for Keystone, we should move the front end over to Apache HTTPD. http://adam.younglogic.com/2012/03/keystone-should-move-to-apache-httpd/ I've reposted it below. Keystone and the other Openstack components run in an href="http://www.eventlet.net";>Eve

Re: [Openstack] Memory leaks from greenthreads

So there is the question here of thread safe (which I don't think python is going toward?) and then making it multiprocess safe (http://docs.python.org/library/multiprocessing.html). I'm not sure if one is easier than the other (but the multiprocess model forces queues, object exchange via queu

Re: [Openstack] Keystone should to Apache HTTPD.

I like the recommendation. Particularly with regards to using PKI authentication. On Thu, Mar 1, 2012 at 2:05 PM, Adam Young wrote: > I wrote up why I think that, at least for Keystone, we should move the front > end over to Apache HTTPD. > > http://adam.younglogic.com/2012/03/keystone-should-mo

Re: [Openstack] Keystone should to Apache HTTPD.

This seems like it could also be done for every other WSGI endpoint right? It seems like it should be possible for all WS endpoints to be hosted in apache (or other server) without problems happening. This might be connected to extracting/abstractig out eventlet (since a pre-forked apache doesn't

[Openstack] Essex-4 milestone available for Keystone, Glance, Nova and Horizon

Hi everyone, The last milestone of the Essex cycle is now available for Keystone, Glance, Nova and Horizon. It provides a feature-complete beta of the upcoming 2012.1 release, scheduled for final release on April 5. You can see the full list of new features and fixed bugs, as well as tarball down

Re: [Openstack] Keystone should to Apache HTTPD.

On 03/01/2012 02:26 PM, Joshua Harlow wrote: This seems like it could also be done for every other WSGI endpoint right? It seems like it should be possible for all WS endpoints to be hosted in apache (or other server) without problems happening. This might be connected to extracting/abstractig o

Re: [Openstack] Keystone should to Apache HTTPD.

I mentioned this to Adam prior to his posting, but since he posted here as well I suppose I have to respond here too: -- SNIP -- Nice write-up Adam :) As a veteran of standing up and scaling popular websites myself, I never intended for a single eventlet wsgi server to handle all the load and av

Re: [Openstack] eventlet weirdness

There are plenty eventlet discussion recently but I'll stick my question to this thread, although it's pretty much a separate question. :) How is MySQL access handled in eventlet? Presumably it's external C library so it's not going to be monkey patched. Does that make every db access call a block

Re: [Openstack] A brief update on the invites to the Design Summit

I apologize to everyone for the confusion. Bill, you are right that without entering a code on the first page of registration, you cannot select just the Design Summit (and not include a conference pass for $500). Here's the solution for OpenStack Contributors who only want to attend the Design Su

Re: [Openstack] Memory leaks from greenthreads

On Mar 1, 2012, at 9:39 AM, Adam Young wrote: > > What would the drawbacks be? Probably the first thing people would look to > from Eventlet is performance. I don't have the hard numbers to compare > Eventlet to Apache HTTPD, but I do know that Apache is used in enough high > volume sites tha

Re: [Openstack] Keystone should to Apache HTTPD.

Oh, I should also add: I don't support standardizing on Apache, but I do support making sure that we run fine under Apache so that it is an option going forward. Mostly that just means ensuring that our WSGI interfaces conform to standards and that we don't do anything that would be incompatible wi

Re: [Openstack] Memory leaks from greenthreads

On 03/01/2012 02:48 PM, Vishvananda Ishaya wrote: On Mar 1, 2012, at 9:39 AM, Adam Young wrote: What would the drawbacks be? Probably the first thing people would look to from Eventlet is performance. I don't have the hard numbers to compare Eventlet to Apache HTTPD, but I do know that Apache

Re: [Openstack] Essex-4 milestone available for Keystone, Glance, Nova and Horizon

> https://launchpad.net/keystone/essex/essex-4 > https://launchpad.net/glance/essex/essex-4 > https://launchpad.net/nova/essex/essex-4 > https://launchpad.net/horizon/essex/essex-4 Great news, indeed ! I would like to ask about "openstack-manuals-M4" and "swift-M4". What about those projects ? (S

Re: [Openstack] eventlet weirdness

It seems that there used to be a db_pool in session.py but got removed by this commit. https://github.com/openstack/nova/commit/f3dd56e916232e38e74d9e2f24ce9a738cac63cf due to this bug: https://bugs.launchpad.net/nova/+bug/838581 But still I'm confused by the discussion. Are we saying eventlet +

Re: [Openstack] eventlet weirdness

On 03/01/2012 02:45 PM, Yun Mao wrote: There are plenty eventlet discussion recently but I'll stick my question to this thread, although it's pretty much a separate question. :) How is MySQL access handled in eventlet? Presumably it's external C library so it's not going to be monkey patched. Do

Re: [Openstack] eventlet weirdness

Yes it does. We actually tried to use a pool at diablo release and it was very broken. There was discussion about moving over to a pure-python mysql library, but it hasn't been tried yet. Vish On Mar 1, 2012, at 11:45 AM, Yun Mao wrote: > There are plenty eventlet discussion recently but I'll

Re: [Openstack] Keystone should to Apache HTTPD.

On Thu, Mar 1, 2012 at 12:22 PM, Esker, Robert wrote: > Hi Andy, > > You mention PKI, SSL, multi-factor auth, et cetera as having factored in > to your thought process. Are any of these expressed in the form of a > blueprint(s) yet? > I have a very low opinion of the blueprint system (for a v

Re: [Openstack] Keystone should to Apache HTTPD.

On Thu, 2012-03-01 at 14:05 -0500, Adam Young wrote: > The traffic in an Openstack deployment to a Keystone server is going > to be about two orders of magnitude less than any other traffic, and > is highly unlikely to be the bottleneck. Not quite. I wrote this up, back in November: http://et

Re: [Openstack] quantum and openvswitch issue

Hi Jay, The steps you have taken so far seem correct. Have you spun up any VMs yet? The current output from the OVS agent implies you may not have. Quantum networks are logical entities, so you won't see the result of creating a network until you actually spin up a VM that uses that network. W

Re: [Openstack] eventlet weirdness

On Mar 1, 2012, at 12:27 PM, Adam Young wrote: > On 03/01/2012 02:45 PM, Yun Mao wrote: >> There are plenty eventlet discussion recently but I'll stick my >> question to this thread, although it's pretty much a separate >> question. :) >> >> How is MySQL access handled in eventlet? Presumably it

Re: [Openstack] eventlet weirdness

On Mar 1, 2012, at 12:36 PM, Vishvananda Ishaya wrote: > Yes it does. We actually tried to use a pool at diablo release and it was > very broken. There was discussion about moving over to a pure-python mysql > library, but it hasn't been tried yet. > I know some people have tried this... and

Re: [Openstack] eventlet weirdness

>> How is MySQL access handled in eventlet? Presumably it's external C >> library so it's not going to be monkey patched. Does that make every >> db access call a blocking call? Thanks, > Nope, it goes through a thread pool. I feel like this might be an over-simplification. If the question is: "

Re: [Openstack] eventlet weirdness

Just because MySQL is a C library doesn't necessarily mean it can't be made to work with coroutines. ZeroMQ is supported through eventlet.green.zmq and there exists geventmysql (although it appears to me as more a proof-of-concept). Moving to a pure-python mysql library might be the path of leas

Re: [Openstack] eventlet weirdness

Someone might have already said this (sure wish the listserv sent me mail faster), but we tried out PyMysql and it was exceptionally slow, even under almost no load. I have a branch in my github that I was using to test out unblocking the database access. For my cases I found that it was unbloc

Re: [Openstack] [Netstack] Can't associate floating IP

On Thu, Mar 1, 2012 at 12:51 PM, Yapeng Wu wrote: > > In the multi-host quantum OVS plugin case, I am not clear how and when > this 'host' in the 'network' table should be updated. > From the code update, I doubt this would work in multi-host case. > It is documented that Quantum does not suppor

Re: [Openstack] Keystone should to Apache HTTPD.

On 03/01/2012 03:52 PM, Kevin L. Mitchell wrote: On Thu, 2012-03-01 at 14:05 -0500, Adam Young wrote: The traffic in an Openstack deployment to a Keystone server is going to be about two orders of magnitude less than any other traffic, and is highly unlikely to be the bottleneck. Not quite. I

Re: [Openstack] Memory leaks from greenthreads

On 03/01/2012 02:48 PM, Vishvananda Ishaya wrote: On Mar 1, 2012, at 9:39 AM, Adam Young wrote: What would the drawbacks be? Probably the first thing people would look to from Eventlet is performance. I don't have the hard numbers to compare Eventlet to Apache HTTPD, but I do know that Apache

[Openstack] Essex-4 milestone available for Quantum

Hi all, The Essex-4 milestone for Quantum and updated documentation is available at: https://launchpad.net/quantum/essex/essex-4 Lots of great improvements in this release, including three new plugins (Linux Bridge, Nicira NVP, and Ryu Controller) as well as significant updates to the OVS plugin.

Re: [Openstack] Memory leaks from greenthreads

Sad, especially since so much is using the database :-( On 3/1/12 2:43 PM, "Adam Young" wrote: On 03/01/2012 02:48 PM, Vishvananda Ishaya wrote: > On Mar 1, 2012, at 9:39 AM, Adam Young wrote: > >> What would the drawbacks be? Probably the first thing people would look to >> from Eventlet is pe

Re: [Openstack] Memory leaks from greenthreads

I agree. It would be awesome if someone could actually make it work. We had a totally broken version using the eventlet db pool 6 months ago. Vish On Mar 1, 2012, at 4:20 PM, Joshua Harlow wrote: > Sad, especially since so much is using the database :-( > > On 3/1/12 2:43 PM, "Adam Young" w

[Openstack] Test Dependencies

Is there any interest in adding unittest2 to the test dependencies for openstack projects? I have found its enhanced assertions and 'with self.assertRaises' very useful in writing tests. I see there have been past bugs that mentioned unittest2, and am wondering if the reasons for not adopting

Re: [Openstack] eventlet weirdness

The standard python postgresql driver (psycopg2) does have an async mode. There are non db api compliant async mysql drivers for gevent. Excerpts from Vishvananda Ishaya's message of 2012-03-01 15:36:43 -0500: > Yes it does. We actually tried to use a pool at diablo release and it was > very b

Re: [Openstack] eventlet weirdness

As long as we allocate a thread in the eventlet thread pool for the number of mysql connections we want to actually maintain in our connection pool, we shouldn't have problems getting the results we want even with the blocking mysql c drivers. Devin On Thursday, March 1, 2012 at 5:23 PM, Kap

Re: [Openstack] [Netstack] Essex-4 milestone available for Quantum

Hi Now the Dashboard whether can manage the Quantum? And whether the Devstack script can let dashbaord and Quantum working? On Fri, Mar 2, 2012 at 7:49 AM, Dan Wendlandt wrote: > Hi all, > > The Essex-4 milestone for Quantum and updated documentation is available > at: https://launchpad.net

Re: [Openstack] [Netstack] Essex-4 milestone available for Quantum

On Thu, Mar 1, 2012 at 5:39 PM, Shake Chen wrote: > Hi > > Now the Dashboard whether can manage the Quantum? > > And whether the Devstack script can let dashbaord and Quantum working? > Hi Shake, Unfortunately, the Horizon + Quantum integration is still in bad shape. Devin (Horizon PTL) and I

Re: [Openstack] eventlet weirdness

I actually didn't mean to send the parent.. but since we're here. Additional threads/pool make the problem potentially worse, they are the origin of the greenlet switching issue that was the start of this thread. ie. with the monkey patching, most stdlib socket, thread module usage by python c

Re: [Openstack] [Netstack] Essex-4 milestone available for Quantum

Did you mean network creation using the dash. Quantum manager works with nova Sent from my iPhone On Mar 1, 2012, at 5:45 PM, "Shake Chen" wrote: > Hi > > Now the Dashboard whether can manage the Quantum? > > And whether the Devstack script can let dashbaord and Quantum working? > > > > >

Re: [Openstack] [Netstack] Essex-4 milestone available for Quantum

On Fri, Mar 2, 2012 at 9:48 AM, Debo Dutta (dedutta) wrote: > Did you mean network creation using the dash. Quantum manager works with > nova > > yes, I hope the quantum can manage in Dashboard. > Sent from my iPhone > > On Mar 1, 2012, at 5:45 PM, "Shake Chen" wrote: > > Hi > > Now the Dashboa

Re: [Openstack] Essex-4 milestone available for Keystone, Glance, Nova and Horizon

Hi In ubuntu 12.04, pool seem not update . the package still is old, like keystone: http://archive.ubuntu.com/ubuntu/pool/universe/k/keystone/ # apt-cache policy keystone keystone: Installed: (none) Candidate: 2012.1~e4~20120203.1574-0ubuntu2 Version table: 2012.1~e4~20120203.1574-0u

Re: [Openstack] Test Dependencies

Apologies to Maru for the double-email. Left out the list by mistake. When you say "non-replay mocking," are you talking about ensuring that a particular function is not called, or replacing a function/whatever with a lambda that doesn't care if it gets called or how often it gets called but stil

Re: [Openstack] Test Dependencies

Mark: I think Maru is talking about the distinction between record/replay mocking and action/assertion mocking. In record/replay mocking (e.g., mox) you define the expected behavior *before* executing the code under test (i.e., "I expect A, B, and C to happen, now go execute the code under tes

[Openstack] Essex-4 horizon error

hi , all: i get horizon(essex-4) software package from https://launchpad.net/horizon/essex/essex-4/+download/horizon-2012.1%7Ee4.tar.gz, but i tar xf horizon compress package after, when i exec python setup.py install emerge error , as follows: Traceback (most recent call last): File "setup

Re: [Openstack] eventlet weirdness

We were using the eventlet db pool class. You can see the code here: https://github.com/openstack/nova/blob/2011.3/nova/db/sqlalchemy/session.py there were a few bugs about it, but here is one: https://bugs.launchpad.net/nova/+bug/838581 Vish On Mar 1, 2012, at 6:11 PM, Kapil Thangavelu wrote