Re: [openstack-dev] [all] [clients] [keystone] lack of retrying tokens leads to overall OpenStack fragility

2014-09-12 Thread Angus Lees
On Thu, 11 Sep 2014 03:00:02 PM Duncan Thomas wrote: > On 11 September 2014 03:17, Angus Lees wrote: > > (As inspired by eg kerberos) > > 2. Ensure at some environmental/top layer that the advertised token > > lifetime exceeds the timeout set on the request, before making the > > request. This im

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Flavio Percoco
On 09/12/2014 03:29 AM, Clint Byrum wrote: > Excerpts from Zane Bitter's message of 2014-09-11 15:21:26 -0700: >> On 09/09/14 19:56, Clint Byrum wrote: >>> Excerpts from Samuel Merritt's message of 2014-09-09 16:12:09 -0700: On 9/9/14, 12:03 PM, Monty Taylor wrote: > On 09/04/2014 01:30 AM

Re: [openstack-dev] [TripleO] Propose adding StevenK to core reviewers

2014-09-12 Thread mar...@redhat.com
On 09/09/14 21:32, Gregory Haynes wrote: > Hello everyone! > > I have been working on a meta-review of StevenK's reviews and I would > like to propose him as a new member of our core team. > > As I'm sure many have noticed, he has been above our stats requirements > for several months now. More i

Re: [openstack-dev] [Ceilometer] Complex resource_metadata could fail to store in MongoDB

2014-09-12 Thread Igor Degtiarov
Hi! After some local discussions with Dmitiy Uklov we have found solution. To solve the problem with dots inside keys in metadata dictionary we propose to reconstruct it before storing in MongoDB. Ex. If we get metadata: {'a.s.d': 'v'} it could be stored in MongoDB after a reconstruction {'a'

Re: [openstack-dev] [all] [clients] [keystone] lack of retrying tokens leads to overall OpenStack fragility

2014-09-12 Thread Angus Lees
On Thu, 11 Sep 2014 03:21:52 PM Steven Hardy wrote: > On Wed, Sep 10, 2014 at 08:46:45PM -0400, Jamie Lennox wrote: > > For service to service communication there are two types. > > 1) using the user's token like nova->cinder. If this token expires there > > is really nothing that nova can do excep

Re: [openstack-dev] [all] i need some help on this bug Bug #1365892

2014-09-12 Thread Angus Lees
On Wed, 10 Sep 2014 01:04:02 PM Mike Bayer wrote: > In this case it appears to be a “safety” in case someone uses the > ConnectionContext object outside of being a context manager. I’d fix that > and require that it be used as a context manager only. Oh look, I have a new pylint hammer that is de

Re: [openstack-dev] [TripleO] Propose adding StevenK to core reviewers

2014-09-12 Thread Derek Higgins
+1 On 09/09/14 19:32, Gregory Haynes wrote: > Hello everyone! > > I have been working on a meta-review of StevenK's reviews and I would > like to propose him as a new member of our core team. > > As I'm sure many have noticed, he has been above our stats requirements > for several months now. Mor

Re: [openstack-dev] [neutron][db] Need help resolving a strange error with db connections in tests

2014-09-12 Thread Kevin Benton
Can you explain a bit about that test? I'm having trouble reproducing it. On the system (upstream Jenkins) that it's failing on, is postgres available with that database? On Thu, Sep 11, 2014 at 7:07 AM, Anna Kamyshnikova < akamyshnik...@mirantis.com> wrote: > Hello everyone! > > I'm working on i

Re: [openstack-dev] [Neutron][Architecture]Suggestions for the third vendors' plugin and driver

2014-09-12 Thread Germy Lure
On Fri, Sep 12, 2014 at 11:11 AM, Kevin Benton wrote: > > > Maybe I missed something, but what's the solution? > > There isn't one yet. That's why it's going to be discussed at the summit. > So my suggestion is remove all vendors' plugins and drivers except opensource as built-in. By leaving open

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Flavio Percoco
On 09/12/2014 12:14 AM, Zane Bitter wrote: > On 09/09/14 15:03, Monty Taylor wrote: >> On 09/04/2014 01:30 AM, Clint Byrum wrote: >>> Excerpts from Flavio Percoco's message of 2014-09-04 00:08:47 -0700: Greetings, Last Tuesday the TC held the first graduation review for Zaqar. During

Re: [openstack-dev] [Cinder] Request for J3 FFE - add reset-state function for backups

2014-09-12 Thread Thierry Carrez
Jay Bryant wrote: > It isn't a huge change. I am ok with it if we can get the issues > addressed. Especially Duncan's concern. Given the gate backlog, if it's not already in-flight, I fear that it would push too much down into the stabilization period and delay RC1. At this point, unless it's

Re: [openstack-dev] [zaqar] Juno Performance Testing (Round 2)

2014-09-12 Thread Flavio Percoco
On 09/12/2014 01:36 AM, Boris Pavlovic wrote: > Kurt, > > Speaking generally, I’d like to see the project bake this in over > time as > part of the CI process. It’s definitely useful information not just for > the developers but also for operators in terms of capacity planning. >

[openstack-dev] [Fuel] Hard Code Freeze for milestones 5.1, 5.0.2 reached

2014-09-12 Thread Mike Scherbakov
Hi Fuelers, I'm glad to announce that we've reached formal Hard Code Freeze (HCF) [1] criteria for milestones 5.1 and 5.0.2. As stable/5.1 branch is already open, we don't need to do anything particular. All further bugs found in 5.1 / 5.0.2 with priority lower than Critical should be closed as Wo

Re: [openstack-dev] [all] [clients] [keystone] lack of retrying tokens leads to overall OpenStack fragility

2014-09-12 Thread Flavio Percoco
On 09/11/2014 01:44 PM, Sean Dague wrote: > On 09/10/2014 08:46 PM, Jamie Lennox wrote: >> >> - Original Message - >>> From: "Steven Hardy" >>> To: "OpenStack Development Mailing List (not for usage questions)" >>> >>> Sent: Thursday, September 11, 2014 1:55:49 AM >>> Subject: Re: [opens

Re: [openstack-dev] [Cinder] Request for J3 FFE - add reset-state function for backups

2014-09-12 Thread Duncan Thomas
On 12 September 2014 09:54, Thierry Carrez wrote: > At this point, unless it's critical to the success of the release (like, > it completes a feature that is 99% there, or it increases consistency by > plugging a feature gap, or it fixes a potential security vulnerability), > I would rather avoid

Re: [openstack-dev] [qa] Tempest Bug triage

2014-09-12 Thread Kashyap Chamarthy
On Thu, Sep 11, 2014 at 03:52:56PM -0400, David Kranz wrote: > So we had a Bug Day this week and the results were a bit disappointing due > to lack of participation. We went from 124 New bugs to 75. > > There were also many cases where bugs referred to logs that no longer > existed. This suggests

Re: [openstack-dev] [Zaqar] Zaqar graduation (round 2) [was: Comments on the concerns arose during the TC meeting]

2014-09-12 Thread Thierry Carrez
Clint Byrum wrote: > Excerpts from Flavio Percoco's message of 2014-09-11 04:14:30 -0700: >> Is Zaqar being optimized as a *queuing* service? I'd say no. Our goal is >> to optimize Zaqar for delivering messages and supporting different >> messaging patterns. > > Awesome! Just please don't expect p

Re: [openstack-dev] [Neutron][Architecture]Suggestions for the third vendors' plugin and driver

2014-09-12 Thread Kevin Benton
> So my suggestion is remove all vendors' plugins and drivers except opensource as built-in. Yes, I think this is currently the view held by the PTL (Kyle) and some of the other cores so what you're suggesting will definitely come up at the summit. > Why do we need a different repo to store vend

Re: [openstack-dev] [neutron][db] Need help resolving a strange error with db connections in tests

2014-09-12 Thread Anna Kamyshnikova
This is implementing ModelsMigrationsSync test from oslo [1]. For running it locally on Postgres you have to do the following things (it is mentioned in comments to test): For the opportunistic testing you need to set up a db named 'openstack_citest' with user 'openstack_citest' and password

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Thierry Carrez
Flavio Percoco wrote: > On 09/12/2014 12:14 AM, Zane Bitter wrote: >> The final question is the one of arbitrary access to messages in the >> queue (or "queue" if you prefer). Flavio indicated that this effectively >> came for free with their implementation of Pub-Sub. IMHO it is >> unnecessary and

Re: [openstack-dev] [nova] Averting the Nova crisis by splitting out virt drivers

2014-09-12 Thread Daniel P. Berrange
On Thu, Sep 11, 2014 at 02:02:00PM -0400, Dan Prince wrote: > I've always referred to the virt/driver.py API as an internal API > meaning there are no guarantees about it being preserved across > releases. I'm not saying this is correct... just that it is what we've > got. While OpenStack attempts

Re: [openstack-dev] [Cinder] Request for J3 FFE - add reset-state function for backups

2014-09-12 Thread Thierry Carrez
Duncan Thomas wrote: > On 12 September 2014 09:54, Thierry Carrez wrote: >> At this point, unless it's critical to the success of the release (like, >> it completes a feature that is 99% there, or it increases consistency by >> plugging a feature gap, or it fixes a potential security vulnerability

[openstack-dev] [metrics] Old reviews (2011) with strange uploaded dates in review.openstack.org

2014-09-12 Thread Daniel Izquierdo
Hi there, I was checking some datasets [1] by the Activity Board [2] and realized that there are some inconsistencies in the old reviews, around July 2011, at the very beginning. An example of this [3] shows that the uploaded date is Dec 16, 2012, while the review was opened on the 25th of J

[openstack-dev] [openstack][neutron] tox -e py27 is not working in the latest neutron code

2014-09-12 Thread Kelam, Koteswara Rao
Hi All, I am trying to run unit test cases in neutron code using "tox -e py27" but it is not working. I commented out pbr in requirements.txt to avoid issues related to pbr but still I am getting following errors. I removed .tox folder and tried again but still same issue. Please help me here.

Re: [openstack-dev] [Zaqar] Zaqar graduation (round 2) [was: Comments on the concerns arose during the TC meeting]

2014-09-12 Thread Mark McLoughlin
On Wed, 2014-09-10 at 14:51 +0200, Thierry Carrez wrote: > Flavio Percoco wrote: > > [...] > > Based on the feedback from the meeting[3], the current main concern is: > > > > - Do we need a messaging service with a feature-set akin to SQS+SNS? > > [...] > > I think we do need, as Samuel puts it,

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Mark McLoughlin
On Wed, 2014-09-10 at 12:46 -0700, Monty Taylor wrote: > On 09/09/2014 07:04 PM, Samuel Merritt wrote: > > On 9/9/14, 4:47 PM, Devananda van der Veen wrote: > >> The questions now before us are: > >> - should OpenStack include, in the integrated release, a > >> messaging-as-a-service component? >

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Some updates/concerns/questions. The status of introducing a new driver to gate is: - - all the patches for mysql-connector are merged in all projects; - - all devstack patches to support switching the driver are merged; - - new sqlalchemy-migrate

Re: [openstack-dev] masking X-Auth-Token in debug output - proposed consistency

2014-09-12 Thread Sean Dague
On 09/11/2014 08:49 PM, Jamie Lennox wrote: > > > - Original Message - >> From: "Travis S Tripp" >> To: "OpenStack Development Mailing List (not for usage questions)" >> >> Sent: Friday, 12 September, 2014 10:30:53 AM >> Subject: [openstack-dev] masking X-Auth-Token in debug output - p

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Sean Dague
On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: > Some updates/concerns/questions. > > The status of introducing a new driver to gate is: > > - all the patches for mysql-connector are merged in all projects; > - all devstack patches to support switching the driver are merged; > - new sqlalchemy-mi

[openstack-dev] [Openstack-dev][Cinder] FFE request for adding Huawei SDSHypervisor driver and connector

2014-09-12 Thread Zhangni
I'd like to request an Juno feature freeze exception for this blueprint and Spec: https://blueprints.launchpad.net/cinder/+spec/huawei-sdshypervisor-driver https://review.openstack.org/#/c/101688/ as implemented by the following patch: https://review.openstack.org/#/c/108609 __

[openstack-dev] [all] Design Summit planning

2014-09-12 Thread Thierry Carrez
Hi everyone, I visited the Paris Design Summit space on Monday and confirmed that it should be possible to split it in a way that would allow to have per-program "contributors meetups" on the Friday. The schedule would go as follows: Tuesday: cross-project workshops Wednesday, Thursday: tradition

[openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Sean Dague
I assume you, gentle OpenStack developers, often find yourself in a hair tearing out moment of frustration about why local unit tests are doing completely insane things. The code that it is stack tracing on is no where to be found, and yet it fails. And then you realize that part of oslo doesn

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Flavio Percoco
On 09/12/2014 11:36 AM, Thierry Carrez wrote: > Flavio Percoco wrote: >> On 09/12/2014 12:14 AM, Zane Bitter wrote: >>> The final question is the one of arbitrary access to messages in the >>> queue (or "queue" if you prefer). Flavio indicated that this effectively >>> came for free with their impl

Re: [openstack-dev] [Infra][Cinder] Coraid CI system

2014-09-12 Thread Roman Bogorodskiy
Hi, Mykola has some problems sending emails to the list, so he asked me to post a response, here it goes: --- Remy, I have improved Coraid CI system and added logs of all components of devstack. Please have a look: http://38.111.159.9:8080/job/Coraid_CI/164/ According to the requirement

Re: [openstack-dev] [nova] Server Groups - remove VM from group?

2014-09-12 Thread Russell Bryant
On 09/11/2014 05:01 PM, Jay Pipes wrote: > On 09/11/2014 04:51 PM, Matt Riedemann wrote: >> On 9/10/2014 6:00 PM, Russell Bryant wrote: >>> On 09/10/2014 06:46 PM, Joe Cropper wrote: Hmm, not sure I follow the concern, Russell. How is that any different from putting a VM into the group w

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Zane Bitter
On 11/09/14 19:05, Jay Pipes wrote: On 09/11/2014 04:09 PM, Zane Bitter wrote: Swift is the current exception here, but one could argue, and people have[2], that Swift is also the only project that actually conforms to our stated design tenets for OpenStack. I'd struggle to tell the Zaqar folks

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Zane Bitter
On 12/09/14 04:50, Flavio Percoco wrote: On 09/12/2014 12:14 AM, Zane Bitter wrote: >However, Zaqar also supports the Pub-Sub model of messaging. I believe, >but would like Flavio to confirm, that this is what is meant when the >Zaqar team say that Zaqar is about messaging in general and not jus

Re: [openstack-dev] [neutron][db] Need help resolving a strange error with db connections in tests

2014-09-12 Thread Kevin Benton
This one was tricky. :-) This failure can be produced consistently by running the following two tests: neutron.tests.unit.brocade.test_brocade_plugin.TestBrocadePortsV2.test_delete_network_port_exists_owned_by_network neutron.tests.unit.db.test_migration.TestModelsMigrationsSyncMl2Psql.test_models

Re: [openstack-dev] [all] Design Summit planning

2014-09-12 Thread Zane Bitter
On 12/09/14 07:37, Thierry Carrez wrote: Hi everyone, I visited the Paris Design Summit space on Monday and confirmed that it should be possible to split it in a way that would allow to have per-program "contributors meetups" on the Friday. The schedule would go as follows: Tuesday: cross-proje

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 13:20, Sean Dague wrote: > On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: >> Some updates/concerns/questions. >> >> The status of introducing a new driver to gate is: >> >> - all the patches for mysql-connector are merged in all >> proj

Re: [openstack-dev] [metrics] Old reviews (2011) with strange uploaded dates in review.openstack.org

2014-09-12 Thread Jeremy Stanley
On 2014-09-12 11:54:19 +0200 (+0200), Daniel Izquierdo wrote: [...] > And a question: was there a migration around the 2012-12-16 of the > review system or some other noticeable event?. On such date there > was around 1,200 submitted reviews, while around those days, in > mean, there are some dozen

Re: [openstack-dev] [qa] Tempest Bug triage

2014-09-12 Thread David Kranz
On 09/12/2014 05:11 AM, Kashyap Chamarthy wrote: On Thu, Sep 11, 2014 at 03:52:56PM -0400, David Kranz wrote: So we had a Bug Day this week and the results were a bit disappointing due to lack of participation. We went from 124 New bugs to 75. There were also many cases where bugs referred to l

Re: [openstack-dev] [openstack][neutron] tox -e py27 is not working in the latest neutron code

2014-09-12 Thread Jeremy Stanley
On 2014-09-12 10:02:49 + (+), Kelam, Koteswara Rao wrote: > I am trying to run unit test cases in neutron code using “tox –e > py27” but it is not working. [...] > 'TOX_INDEX_URL': 'http://pypi.openstack.org/openstack', [...] > 'PIP_INDEX_URL': 'http://pypi.openstack.org/openstack', [...] >

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Gordon Sim
On 09/12/2014 09:50 AM, Flavio Percoco wrote: Zaqar supports once and only once delivery. For the transfer from Zaqar to consumers it does (providing the claim id can be recovered). For transfer from producers to Zaqar I believe it is more limited. If the connection to Zaqar fails during a

Re: [openstack-dev] [Zaqar] Zaqar graduation (round 2) [was: Comments on the concerns arose during the TC meeting]

2014-09-12 Thread Gordon Sim
On 09/11/2014 07:46 AM, Flavio Percoco wrote: On 09/10/2014 03:18 PM, Gordon Sim wrote: On 09/10/2014 09:58 AM, Flavio Percoco wrote: Other OpenStack components can integrate with Zaqar to surface events to end users and to communicate with guest agents that run in the "over-cloud" layer.

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Jeremy Stanley
On 2014-09-12 12:41:42 +0200 (+0200), Ihar Hrachyshka wrote: [...] > That said, those failures were solved by pinning the version of the > library in openstack/requirements and those projects. This is in major > contrast to how we handled the new testtools release just several > weeks ago, when the

Re: [openstack-dev] [solum] Consistency of development environment

2014-09-12 Thread Alexander Vollschwitz
Hello Adrian, thanks for the quick reply, and sorry for my delayed response. On 09/03/2014 04:42 PM, Adrian Otto wrote: > We have noticed lately that our devstack setup does not always work. > [...] We have discussed ways to mitigate this. One idea was to > select a particular devstack from a pr

Re: [openstack-dev] [all] Design Summit planning

2014-09-12 Thread Eoghan Glynn
> I visited the Paris Design Summit space on Monday and confirmed that it > should be possible to split it in a way that would allow to have > per-program "contributors meetups" on the Friday. The schedule would go > as follows: > > Tuesday: cross-project workshops > Wednesday, Thursday: traditi

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Brad Topol
+1!!! This is awesome. I *always* ran into this was about to get find . -name "*.pyc" -delete tattooed on the inside of my forearm. Now I don't have to. Thanks!!! --Brad Brad Topol, Ph.D. IBM Distinguished Engineer OpenStack (919) 543-0646 Internet: bto...@us.ibm.com Assistant: Kendra Wi

Re: [openstack-dev] [solum] Consistency of development environment

2014-09-12 Thread Paul Czarkowski
> >While I installed dnsmasq 2.63 manually, they used Ubuntu 14.04 to get >around the problem. Is it maybe time to upgrade the base for the dev env >to 14.04, or would that cause many other problems? Have you tried that >out? If you have a pointer to an appropriate 14.04 image I can configure >in

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 7:20 AM, Sean Dague wrote: > > Because we are in Feature Freeze. Now is the time for critical bug fixes > only, as we start to stabalize the tree. Releasing dependent libraries > that can cause breaks, for whatever reason, should be soundly avoided. > > If this was August,

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 16:33, Mike Bayer wrote: > I agree with this, changing the MySQL driver now is not an option. That was not the proposal. The proposal was to introduce support to run against something different from MySQLdb + a gate job for that alternat

Re: [openstack-dev] [TripleO] Propose adding StevenK to core reviewers

2014-09-12 Thread Jiří Stránský
On 9.9.2014 20:32, Gregory Haynes wrote: Hello everyone! I have been working on a meta-review of StevenK's reviews and I would like to propose him as a new member of our core team. +1 As I'm sure many have noticed, he has been above our stats requirements for several months now. More import

Re: [openstack-dev] [Zaqar] Zaqar graduation (round 2) [was: Comments on the concerns arose during the TC meeting]

2014-09-12 Thread Victoria Martínez de la Cruz
2014-09-12 10:44 GMT-03:00 Gordon Sim : > On 09/11/2014 07:46 AM, Flavio Percoco wrote: > >> On 09/10/2014 03:18 PM, Gordon Sim wrote: >> >>> On 09/10/2014 09:58 AM, Flavio Percoco wrote: >>> Other OpenStack components can integrate with Zaqar to surface events to end users and

Re: [openstack-dev] [metrics] Old reviews (2011) with strange uploaded dates in review.openstack.org

2014-09-12 Thread Daniel Izquierdo
On 12/09/14 15:38, Jeremy Stanley wrote: On 2014-09-12 11:54:19 +0200 (+0200), Daniel Izquierdo wrote: [...] And a question: was there a migration around the 2012-12-16 of the review system or some other noticeable event?. On such date there was around 1,200 submitted reviews, while around those

Re: [openstack-dev] [neutron][db] Need help resolving a strange error with db connections in tests

2014-09-12 Thread Anna Kamyshnikova
Kevin Benton Thank you very much!!! I lost hope to find a way to fix these tests! Regards, Ann Kamyshnikova On Fri, Sep 12, 2014 at 5:17 PM, Kevin Benton wrote: > This one was tricky. :-) > > This failure can be produced consistently by running the following two > tests: > > neutron.tests.unit

Re: [openstack-dev] [all] Design Summit planning

2014-09-12 Thread Russell Bryant
On 09/12/2014 07:37 AM, Thierry Carrez wrote: > If you think this is wrong and think the "design summit suggestion" > website is a better way to do it, let me know why! If some programs > really can't stand the 'etherpad/IRC' approach I'll see how we can spin > up a limited instance. I think this

Re: [openstack-dev] [Zaqar] Comments on the concerns arose during the TC meeting

2014-09-12 Thread Flavio Percoco
On 09/12/2014 01:56 PM, Flavio Percoco wrote: > On 09/12/2014 11:36 AM, Thierry Carrez wrote: >> Flavio Percoco wrote: >>> On 09/12/2014 12:14 AM, Zane Bitter wrote: The final question is the one of arbitrary access to messages in the queue (or "queue" if you prefer). Flavio indicated tha

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: > I assume you, gentle OpenStack developers, often find yourself in a hair > tearing out moment of frustration about why local unit tests are doing > completely insane things. The code that it is stack tracing on is no > where to be found, and yet i

[openstack-dev] battling stale .pyc files

2014-09-12 Thread Mike Bayer
I’ve just found https://bugs.launchpad.net/nova/+bug/1368661, "Unit tests sometimes fail because of stale pyc files”. The issue as stated in the report refers to the phenomenon of .pyc files that remain inappropriately, when switching branches or deleting files. Specifically, the kind of scenar

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 9:23 AM, Ihar Hrachyshka wrote: > Signed PGP part > On 12/09/14 13:20, Sean Dague wrote: > > On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: > >> Some updates/concerns/questions. > >> > >> The status of introducing a new driver to gate is: > >> > >> - all the patches for mysql

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: > I assume you, gentle OpenStack developers, often find yourself in a hair > tearing out moment of frustration about why local unit tests are doing > completely insane things. The code that it is stack tracing on is no > where to be found, and yet i

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Sean Dague
On 09/12/2014 11:21 AM, Mike Bayer wrote: > > On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: > >> I assume you, gentle OpenStack developers, often find yourself in a hair >> tearing out moment of frustration about why local unit tests are doing >> completely insane things. The code that it is st

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Sean Dague
On 09/12/2014 11:19 AM, Doug Hellmann wrote: > > On Sep 12, 2014, at 9:23 AM, Ihar Hrachyshka wrote: > >> Signed PGP part >> On 12/09/14 13:20, Sean Dague wrote: >>> On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: Some updates/concerns/questions. The status of introducing a new dri

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka wrote: > Signed PGP part > On 12/09/14 16:33, Mike Bayer wrote: >> I agree with this, changing the MySQL driver now is not an option. > > That was not the proposal. The proposal was to introduce support to > run against something different from MySQ

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 11:24 AM, Sean Dague wrote: > On 09/12/2014 11:21 AM, Mike Bayer wrote: >> >> On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: >> >>> I assume you, gentle OpenStack developers, often find yourself in a hair >>> tearing out moment of frustration about why local unit tests are

Re: [openstack-dev] global-reqs on tooz pulls in worrisome transitive dep

2014-09-12 Thread Brant Knudson
On Thu, Sep 11, 2014 at 2:17 AM, Thomas Goirand wrote: > > On my side (as the Debian package maintainer of OpenStack), I was more > than happy to see that Ceilometer made the choice to use a Python module > for memcache which supports Python 3. Currently python-memcache does > *not* support Pytho

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 11:33 AM, Mike Bayer wrote: > > On Sep 12, 2014, at 11:24 AM, Sean Dague wrote: > >> On 09/12/2014 11:21 AM, Mike Bayer wrote: >>> >>> On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: >>> I assume you, gentle OpenStack developers, often find yourself in a hair t

Re: [openstack-dev] [Openstack-dev][Cinder] FFE request for adding Huawei SDSHypervisor driver and connector

2014-09-12 Thread Thierry Carrez
Zhangni wrote: > I'd like to request an Juno feature freeze exception for this blueprint > and Spec: > > https://blueprints.launchpad.net/cinder/+spec/huawei-sdshypervisor-driver > > https://review.openstack.org/#/c/101688/ > > as implemented by the following patch: > > https://review.openstack

Re: [openstack-dev] [all] Design Summit planning

2014-09-12 Thread Anita Kuno
On 09/12/2014 07:37 AM, Thierry Carrez wrote: > Hi everyone, > > I visited the Paris Design Summit space on Monday and confirmed that it > should be possible to split it in a way that would allow to have > per-program "contributors meetups" on the Friday. The schedule would go > as follows: > > T

Re: [openstack-dev] [all] Design Summit planning

2014-09-12 Thread Thierry Carrez
Eoghan Glynn wrote: >> If you think this is wrong and think the "design summit suggestion" >> website is a better way to do it, let me know why! If some programs >> really can't stand the 'etherpad/IRC' approach I'll see how we can spin >> up a limited instance. > > +1 on a collaborative schedulin

Re: [openstack-dev] [all] Design Summit planning

2014-09-12 Thread Thierry Carrez
Russell Bryant wrote: > On 09/12/2014 07:37 AM, Thierry Carrez wrote: >> If you think this is wrong and think the "design summit suggestion" >> website is a better way to do it, let me know why! If some programs >> really can't stand the 'etherpad/IRC' approach I'll see how we can spin >> up a limi

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 11:21 AM, Mike Bayer wrote: > > On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: > >> I assume you, gentle OpenStack developers, often find yourself in a hair >> tearing out moment of frustration about why local unit tests are doing >> completely insane things. The code that

Re: [openstack-dev] [all] Design Summit planning

2014-09-12 Thread Thierry Carrez
Anita Kuno wrote: > My question involves third party discussions. Now I know at least > Neutron is going to have a chat about drivers which involves third party > ci accounts as a supportive aspect of that discussion, but I am > wondering about the framework for a discussion which I can recommend >

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Julien Danjou
On Fri, Sep 12 2014, Sean Dague wrote: > Which sets PYTHONDONTWRITEBYTECODE=true in the unit tests. > > This prevents pyc files from being writen in your git tree (win!). It > doesn't seem to impact what pip installs... and if anyone knows how to > prevent those pyc files from getting created, tha

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Johannes Erdfelt
On Fri, Sep 12, 2014, Doug Hellmann wrote: > I don’t think we will want to retroactively change the migration scripts > (that’s not something we generally like to do), We don't allow semantic changes to migration scripts since people who have already run it won't get those changes. However, we ha

Re: [openstack-dev] battling stale .pyc files

2014-09-12 Thread Julien Danjou
On Fri, Sep 12 2014, Mike Bayer wrote: > Just my 2.5c on this issue as to the approach I think is best. Leave > the Python interpreter’s behavior as much as “normal” as possible in > our default test environment. I definitely agree with all of that. :) -- Julien Danjou // Free Software hacker /

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 11:56 AM, Johannes Erdfelt wrote: > On Fri, Sep 12, 2014, Doug Hellmann wrote: >> I don’t think we will want to retroactively change the migration scripts >> (that’s not something we generally like to do), > > We don't allow semantic changes to migration scripts since peopl

Re: [openstack-dev] global-reqs on tooz pulls in worrisome transitive dep

2014-09-12 Thread Morgan Fainberg
I do not see python-memcache library in either keystone client’s requirements.txt[0] or test-requirements.txt[1]. For purposes of ensuring that we do not break people deploying auth_token in keystoneclient (for older releases) I don’t see the soft dependency on python-memcache from going away.

Re: [openstack-dev] [all] [clients] [keystone] lack of retrying tokens leads to overall OpenStack fragility

2014-09-12 Thread Steven Hardy
On Thu, Sep 11, 2014 at 08:43:22PM -0400, Jamie Lennox wrote: > > > - Original Message - > > From: "Steven Hardy" > > To: "OpenStack Development Mailing List (not for usage questions)" > > > > Sent: Friday, 12 September, 2014 12:21:52 AM > > Subject: Re: [openstack-dev] [all] [clients]

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Sean Dague
On 09/12/2014 11:33 AM, Mike Bayer wrote: > > On Sep 12, 2014, at 11:24 AM, Sean Dague wrote: > >> On 09/12/2014 11:21 AM, Mike Bayer wrote: >>> >>> On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: >>> I assume you, gentle OpenStack developers, often find yourself in a hair tearing out

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Sean Dague
On 09/12/2014 11:52 AM, Doug Hellmann wrote: > > On Sep 12, 2014, at 11:21 AM, Mike Bayer wrote: > >> >> On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: >> >>> I assume you, gentle OpenStack developers, often find yourself in a hair >>> tearing out moment of frustration about why local unit test

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 11:55 AM, Julien Danjou wrote: > On Fri, Sep 12 2014, Sean Dague wrote: > >> Which sets PYTHONDONTWRITEBYTECODE=true in the unit tests. >> >> This prevents pyc files from being writen in your git tree (win!). It >> doesn't seem to impact what pip installs... and if anyone k

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 12:03 PM, Sean Dague wrote: > On 09/12/2014 11:33 AM, Mike Bayer wrote: >> >> On Sep 12, 2014, at 11:24 AM, Sean Dague wrote: >> >>> On 09/12/2014 11:21 AM, Mike Bayer wrote: On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: > I assume you, gentle OpenSt

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Sean Dague
On 09/12/2014 12:07 PM, Mike Bayer wrote: > > On Sep 12, 2014, at 12:03 PM, Sean Dague wrote: > >> On 09/12/2014 11:33 AM, Mike Bayer wrote: >>> >>> On Sep 12, 2014, at 11:24 AM, Sean Dague wrote: >>> On 09/12/2014 11:21 AM, Mike Bayer wrote: > > On Sep 12, 2014, at 7:39 AM, Sean D

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Jeremy Stanley
On 2014-09-12 11:36:20 -0400 (-0400), Mike Bayer wrote: [...] > not to mention PYTHONHASHSEED only works on Python 3. What is the > issue in tox you’re referring to ? Huh? The overrides we added to numerous projects' tox.ini files to stem the breakage in Python 2.x unit tests from hash seed rando

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Daniel P. Berrange
On Fri, Sep 12, 2014 at 12:03:38PM -0400, Sean Dague wrote: > On 09/12/2014 11:52 AM, Doug Hellmann wrote: > > > > On Sep 12, 2014, at 11:21 AM, Mike Bayer wrote: > > > > I have to agree with Mike here. Cleaning up our dev environments using a > > little automation is better than disabling a fe

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Jeremy Stanley
On 2014-09-12 12:07:41 -0400 (-0400), Mike Bayer wrote: [...] > corresponding to PYTHONHASHSEED, right? That whole thing is > Python 3 only. See other reply, but I really don't understand where you got that idea. Yes Python 2.x does not randomize the hash seed by default like Py3K (you have to pa

Re: [openstack-dev] [qa] Tempest Bug triage

2014-09-12 Thread Mauro S M Rodrigues
On 09/11/2014 04:52 PM, David Kranz wrote: So we had a Bug Day this week and the results were a bit disappointing due to lack of participation. We went from 124 New bugs to 75. There were also many cases where bugs referred to logs that no longer existed. This suggests that we really need to ke

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Jeremy Stanley
On 2014-09-12 17:16:11 +0100 (+0100), Daniel P. Berrange wrote: [...] > Agreed, the problem with stale .pyc files is that it never occurs to > developers that .pyc files are causing the problem until after you've > wasted (potentially hours of) time debugging the problem. Avoiding > this pain for a

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Chris Dent
On Fri, 12 Sep 2014, Julien Danjou wrote: I guess the problem is more likely that testrepository load the tests From the source directory whereas maybe we could make it load them from what's installed into the venv? This rather ruins TDD doesn't it? -- Chris Dent tw:@anticdent freenode:cdent

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Daniel P. Berrange
On Fri, Sep 12, 2014 at 04:23:09PM +, Jeremy Stanley wrote: > On 2014-09-12 17:16:11 +0100 (+0100), Daniel P. Berrange wrote: > [...] > > Agreed, the problem with stale .pyc files is that it never occurs to > > developers that .pyc files are causing the problem until after you've > > wasted (po

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Chris Dent
On Fri, 12 Sep 2014, Doug Hellmann wrote: We could use a git hook (see my earlier message in this thread) or we could add a command to tox to remove them before starting the tests. Neither of those solutions would affect the runtime behavior in a way that makes our dev environments fundamentally

Re: [openstack-dev] [all][oslo] official recommendations to handle oslo-incubator sync requests

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 There seems to be no objections to that wording, so I went forward and added it to [1], plus added the note about those rules to [2]. [1]: https://wiki.openstack.org/wiki/Oslo#Syncing_Code_from_Incubator [2]: https://wiki.openstack.org/wiki/StableBr

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 17:30, Mike Bayer wrote: > > On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka > wrote: > >> Signed PGP part On 12/09/14 16:33, Mike Bayer wrote: >>> I agree with this, changing the MySQL driver now is not an >>> option. >> >> That was no

Re: [openstack-dev] masking X-Auth-Token in debug output - proposed consistency

2014-09-12 Thread Tripp, Travis S
>From Jamie Lennox: >> We handle this in the keystoneclient Session object by just printing >> REDACTED or something similar. >> The problem with using a SHA1 is that for backwards compatability we often >> use the SHA1 of a PKI token >> as if it were a UUID token and so this is still sensitive

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 1:03 PM, Ihar Hrachyshka wrote: > Signed PGP part > On 12/09/14 17:30, Mike Bayer wrote: > > > > On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka > > wrote: > > > >> Signed PGP part On 12/09/14 16:33, Mike Bayer wrote: > >>> I agree with this, changing the MySQL driver now is n

Re: [openstack-dev] [Zaqar] Zaqar graduation (round 2) [was: Comments on the concerns arose during the TC meeting]

2014-09-12 Thread Clint Byrum
Excerpts from Thierry Carrez's message of 2014-09-12 02:16:42 -0700: > Clint Byrum wrote: > > Excerpts from Flavio Percoco's message of 2014-09-11 04:14:30 -0700: > >> Is Zaqar being optimized as a *queuing* service? I'd say no. Our goal is > >> to optimize Zaqar for delivering messages and support

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 12:03 PM, Sean Dague wrote: > On 09/12/2014 11:52 AM, Doug Hellmann wrote: >> >> On Sep 12, 2014, at 11:21 AM, Mike Bayer wrote: >> >>> >>> On Sep 12, 2014, at 7:39 AM, Sean Dague wrote: >>> I assume you, gentle OpenStack developers, often find yourself in a hair >

Re: [openstack-dev] [all] PYTHONDONTWRITEBYTECODE=true in tox.ini

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 12:48 PM, Chris Dent wrote: > On Fri, 12 Sep 2014, Doug Hellmann wrote: > >> We could use a git hook (see my earlier message in this thread) or we >> could add a command to tox to remove them before starting the tests. >> Neither of those solutions would affect the runtime b

  1   2   >