Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/10/2014 04:13 AM, Robert Collins wrote: On 5 January 2014 02:02, Sean Dague wrote: So we used to do that the apps against release libraries. And the result was more and more full day gate breaks. We did 2 consecutive ones in 2 weeks. Basically, once you get to be a certain level of coup

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 5 January 2014 02:02, Sean Dague wrote: > So we used to do that the apps against release libraries. And the result was > more and more full day gate breaks. We did 2 consecutive ones in 2 weeks. > > Basically, once you get to be a certain level of coupled in OpenStack we can > no longer let yo

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On Mon, Jan 6, 2014 at 6:21 PM, Jeremy Stanley wrote: > On 2014-01-06 17:23:31 -0500 (-0500), Doug Hellmann wrote: > [...] > > The global requirements syncing seems to have fixed the issue for > > apps, although it just occurred to me that I'm not sure we check > > that the requirements lists are

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

velopment Mailing List (not for usage questions)" mailto:openstack-dev@lists.openstack.org>> Subject: Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade On Sun, Jan 5, 2014 at 5:02 PM, James E. Blair mailto:jebl...@openstack.org>> wrote: Joshua Harl

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 2014-01-06 17:23:31 -0500 (-0500), Doug Hellmann wrote: [...] > The global requirements syncing seems to have fixed the issue for > apps, although it just occurred to me that I'm not sure we check > that the requirements lists are the same when we cut a release. > Do we do that already? Not yet

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On Sun, Jan 5, 2014 at 5:02 PM, James E. Blair wrote: > Joshua Harlow writes: > > > It seems simple to have variations of venvs (or something similar) > > that taskflow tox.ini can have that specify the different 0.7, 0.8, > > 0.9, when sqlalchemy 1.0 comes out then this should become a nonissue

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On Sat, Jan 4, 2014 at 8:02 AM, Sean Dague wrote: > On 01/03/2014 08:27 PM, Robert Collins wrote: > >> On 4 January 2014 08:44, Doug Hellmann >> wrote: >> >>> It seems safer to gate changes to libraries against the apps' trunk (to >>> avoid making backwards-incompatible changes), and then gate c

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Joshua Harlow writes: > It seems simple to have variations of venvs (or something similar) > that taskflow tox.ini can have that specify the different 0.7, 0.8, > 0.9, when sqlalchemy 1.0 comes out then this should become a nonissue > (hopefully). I will bug the infra folks to see what can be don

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Agreed, we are going to expand it and work on figuring out how to test against multiple versions. It does work with 0.8 and it seems even like 0.9 works fine also. But all compatible also means I can't guarantee 0.10 (if it comes out) will work since afaik semver means sqlalchemy could still bre

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

I've skimmed the rest of the thread and not seen something mentioned that seems like it matters a lot. If I missed this suggestion buried deep in the ensuing discussion, I apologize for that. Since TaskFlow wants to be generally consumable and not only driven as an OpenStack component, it should n

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

With regards to the futures module it should just work fine with the packaging of https://pypi.python.org/pypi/futures which is a backport of the 3.2 concurrent futures package into 2.6,2.7, so that's the package there. Feel free to bug me on irc if u want any other help with dependencies, the

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 5 January 2014 04:22, Thomas Goirand wrote: > Sean, > > Before everything, I'd like to thank you for insisting in making the > transition to SQLA 0.8.x. > > Since it has been uploaded to Sid, this SQLA <0.7.99 has been without > any doubt the biggest reoccurring pain in the but with the packagi

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

I was more of referring to general dependency issues, sqlalchemy hopefully never again but one never knows :P Sent from my really tiny device... > On Jan 4, 2014, at 8:40 AM, "Thomas Goirand" wrote: > >> On 01/05/2014 12:12 AM, Joshua Harlow wrote: >> it won't >> be the last time a library tha

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/05/2014 12:12 AM, Joshua Harlow wrote: > it won't > be the last time a library that is used in various projects > causes dependency issues Please, tell me the opposite thing. Please tell me that this is the last time we're having a discussion about problems with SQLA 0.8. Please tell me that

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Such a bad state seems like FUD. Taskflow was just syncing its requirements with the same requirements that everyone else is... Those global requirements have <0.7.99 in them as we speak (which is why taskflow picked up that version). The issue here will be worked through and fixed, it won't b

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/04/2014 07:53 AM, Joshua Harlow wrote: > So another idea that was talked about on IRC. > > Taskflow exposes entrypoints for these storage backends (like your storage > callback/interface idea). > > It currently provides 3 such 'default' backends [sqlalchemy, file/dir > based, in-memory <-->

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/04/2014 06:10 AM, Ivan Melnikov wrote: > On 04.01.2014 01:29, Sean Dague wrote: >> On 01/03/2014 04:17 PM, Doug Hellmann wrote: > [...] >>> That's what made me think of the solution. But isn't setuptools in fact >>> telling us that somehow the versions of things we expected to have >>> instal

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Sean, Before everything, I'd like to thank you for insisting in making the transition to SQLA 0.8.x. Since it has been uploaded to Sid, this SQLA <0.7.99 has been without any doubt the biggest reoccurring pain in the but with the packaging of OpenStack. Without people like you, insisting again an

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 08:27 PM, Robert Collins wrote: On 4 January 2014 08:44, Doug Hellmann wrote: It seems safer to gate changes to libraries against the apps' trunk (to avoid making backwards-incompatible changes), and then gate changes to the apps against the released libraries (to ensure they work

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 4 January 2014 08:44, Doug Hellmann wrote: > > > > I understand that moving taskflow into oslo would avoid the policy decision > we have in place to not do symmetric gating on unreleased versions of things > not "owned" by the OpenStack project. However, I don't know if we want to be > testing

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

So another idea that was talked about on IRC. Taskflow exposes entrypoints for these storage backends (like your storage callback/interface idea). It currently provides 3 such 'default' backends [sqlalchemy, file/dir based, in-memory <--> mainly for testing]. A 4th one is in progress for icehous

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 06:14 PM, Joshua Harlow wrote: Since the library model is what most everyone else uses outside of openstack (I assume?) what can we do to get there so that this model works as well? Expanding dependencies recursively seems like it could help? This could then detect transitive depen

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Since the library model is what most everyone else uses outside of openstack (I assume?) what can we do to get there so that this model works as well? Expanding dependencies recursively seems like it could help? This could then detect transitive dependency issues (and doesn't seem so hard to do).

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 05:10 PM, Ivan Melnikov wrote: On 04.01.2014 01:29, Sean Dague wrote: On 01/03/2014 04:17 PM, Doug Hellmann wrote: [...] That's what made me think of the solution. But isn't setuptools in fact telling us that somehow the versions of things we expected to have installed are no lon

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 04.01.2014 01:29, Sean Dague wrote: > On 01/03/2014 04:17 PM, Doug Hellmann wrote: [...] >> That's what made me think of the solution. But isn't setuptools in fact >> telling us that somehow the versions of things we expected to have >> installed are no longer installed and so something *is* bro

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 04:17 PM, Doug Hellmann wrote: On Fri, Jan 3, 2014 at 4:08 PM, Sean Dague mailto:s...@dague.net>> wrote: On 01/03/2014 03:30 PM, Doug Hellmann wrote: On Fri, Jan 3, 2014 at 3:13 PM, Sean Dague mailto:s...@dague.net>

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On Fri, Jan 3, 2014 at 4:08 PM, Sean Dague wrote: > On 01/03/2014 03:30 PM, Doug Hellmann wrote: > >> >> >> >> On Fri, Jan 3, 2014 at 3:13 PM, Sean Dague > > wrote: >> >> On 01/03/2014 02:44 PM, Doug Hellmann wrote: >> >> >> >> >> On Fri, Jan 3, 2014 at 12:45 PM

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 03:30 PM, Doug Hellmann wrote: On Fri, Jan 3, 2014 at 3:13 PM, Sean Dague mailto:s...@dague.net>> wrote: On 01/03/2014 02:44 PM, Doug Hellmann wrote: On Fri, Jan 3, 2014 at 12:45 PM, Joshua Harlow mailto:harlo...@yahoo-inc.com>

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On Fri, Jan 3, 2014 at 3:13 PM, Sean Dague wrote: > On 01/03/2014 02:44 PM, Doug Hellmann wrote: > >> >> >> >> On Fri, Jan 3, 2014 at 12:45 PM, Joshua Harlow > > wrote: >> >> Ok, I think I'm fine with that (although not really sure what that >> entails). >>

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 2014-01-03 14:44:40 -0500 (-0500), Doug Hellmann wrote: [...] > It seems safer to gate changes to libraries against the apps' > trunk (to avoid making backwards-incompatible changes), and then > gate changes to the apps against the released libraries (to > ensure they work with something availab

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 02:44 PM, Doug Hellmann wrote: On Fri, Jan 3, 2014 at 12:45 PM, Joshua Harlow mailto:harlo...@yahoo-inc.com>> wrote: Ok, I think I'm fine with that (although not really sure what that entails). What does the living under the 'oslo program' change? Does that ent

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

penStack Development Mailing List (not for usage questions)" mailto:openstack-dev@lists.openstack.org>>, Sean Dague mailto:s...@dague.net>> Subject: Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade On Fri, Jan 3, 2014 at 12:45 PM, Joshua Harlow mailt

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On Fri, Jan 3, 2014 at 12:45 PM, Joshua Harlow wrote: > Ok, I think I'm fine with that (although not really sure what that > entails). > > What does the living under the 'oslo program' change? > > Does that entail getting sucked into the incubator (which seems to be what > your graduating link is

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Sounds good to me. Talked on #openstack-infra with some folks there and just awaiting next steps. Doesn't seem like should be anything to hard to adjust/move/... -Josh On 1/3/14, 11:27 AM, "Sean Dague" wrote: >On 01/03/2014 12:45 PM, Joshua Harlow wrote: >> Ok, I think I'm fine with that (al

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 12:45 PM, Joshua Harlow wrote: Ok, I think I'm fine with that (although not really sure what that entails). What does the living under the 'oslo program' change? Does that entail getting sucked into the incubator (which seems to be what your graduating link is about). I don't thi

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Ok, I think I'm fine with that (although not really sure what that entails). What does the living under the 'oslo program' change? Does that entail getting sucked into the incubator (which seems to be what your graduating link is about). I don't think its a good idea for taskflow to be in the 'i

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

On 01/03/2014 11:37 AM, Joshua Harlow wrote: So taskflow was tested with the version of sqlalchemy that was available and in the requirements at the time of its 0.1 release (taskflow syncs it's requirements from the same global requirements). From what I remember this is the same requirement that

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

So taskflow was tested with the version of sqlalchemy that was available and in the requirements at the time of its 0.1 release (taskflow syncs it's requirements from the same global requirements). From what I remember this is the same requirement that everyone else is bound to: SQLAlchemy>=0.7

[openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

Given that sqla 0.9 just came out, I wanted to explore, again, what the state of the world was with sqla 0.8 (especially given that Ubuntu and Red Hat are both shipping 0.8 in their OpenStack bundles) - https://review.openstack.org/#/c/64831/ The answer is not great. But more importantly, the