Re: [openstack-dev] [cinder] Cinder with remote LVM proposal

2017-02-01 Thread Philipp Marek
Hi everybody, > > Hi, I'd like to know if it is possible to use openstack-cinder-volume with > > a remote LVM. This could be a new feature proposal if the idea is good. > > More precisely, I'm thinking a solution where openstack-cinder-volume runs > > on a dedicated node and LVM on another node (c

Re: [openstack-dev] [Cinder] [stable] [all] Changing stable policy for drivers

2016-08-08 Thread Philipp Marek
> Ok, to turn the question around, we (the cinder team) have recognised a > definite and strong need to have somewhere for vendors to share patches on > versions of Cinder older than the stable branch policy allows. > > Given this need, what are our options? > > 1. We could do all this outside Op

Re: [openstack-dev] [Cinder] [stable] [all] Changing stable policy for drivers

2016-08-06 Thread Philipp Marek
> I want to propose > we officially make a change to our stable policy to call out that > drivers bugfixes (NOT new driver features) be allowed at any time. Emphatically +1 from me. With the small addendum that "bugfixes" should include compatibility changes for libraries used. Thanks for bring

Re: [openstack-dev] [nova][cinder] Limits on volume read throughput?

2016-03-02 Thread Philipp Marek
Hi Preston, > The benchmark scripts are in: > > https://github.com/pbannister/openstack-bootstrap in case that might help, here are a few notes and hints about doing benchmarks for the DRDB block device driver: http://blogs.linbit.com/p/897/benchmarking-drbd/ Perhaps there's something

[openstack-dev] [Cinder][DRBD] questions about pep8/flake8 etc.

2015-12-21 Thread Philipp Marek
Hi everybody, in the current patch https://review.openstack.org/#/c/259973/1 the test script needs to use a lot of the constant definitions of the backend driver it's using (DRBDmanage). As the DRBDmanage libraries need not be installed on the CI nodes, I'm providing a minimum of upstream file

[openstack-dev] [ThirdParty][CI] [patch] Status page at http://ci-watch.tintri.com/project

2015-12-21 Thread Philipp Marek
Hi all, I quite like the page at http://ci-watch.tintri.com/project - it gives a very quick overview about the failures one should look into, and which to ignore ;) Please let me state before anything else that I don't know any of the restrictions that may have led into the current design - i

Re: [openstack-dev] [cinder]Do we have project scope for cinder?

2015-11-29 Thread Philipp Marek
Hi Hao Wang, > In fact, there is a reason that I ask this question. Recently I have a > confusion about if cinder should provide the ability of Disaster > Recovery to storage resources, like volume. I mean we have volume > replication v1&v2, but for DR, specially DR between two independent > OpenS

Re: [openstack-dev] [cinder][glance]Upload encrypted volumes to images

2015-11-22 Thread Philipp Marek
> About uploading encrypted volumes to image, there are three options: > 1. Glance only keeps non-encrypted images. So when uploading encrypted >volumes to image, cinder de-crypts the data and upload. > 2. Glance maintain encrypted images. Cinder just upload the encrypted >data to image.

Re: [openstack-dev] [cinder] LVM snapshot performance issue -- why isn't thin provisioning the default?

2015-09-15 Thread Philipp Marek
> > I'm currently trying to work around an issue where activating LVM > > snapshots created through cinder takes potentially a long time. [[ thick LVM snapshot performance problem ]] > > Given the above, is there any reason why we couldn't make thin > > provisioning the default? > > My intention

Re: [openstack-dev] [Cinder] A possible solution for HA Active-Active

2015-08-05 Thread Philipp Marek
> > Well, SUSE and Redhat (7) use Pacemaker by default, Debian/Ubuntu have it > > (along with others)... > > > > That gives it quite some market share, wouldn't you think? > > > > Yes, I guess the "most popular" meaning is a good match here. > > I see, so in the same way that "nano is *the* Lin

Re: [openstack-dev] [Cinder] A possible solution for HA Active-Active

2015-08-05 Thread Philipp Marek
> > > [...] > > > > Pacemaker is *the* Linux HA Stack. > > > [...] > > > > > > Can you expand on this assertion? It doesn't look to me like it's > > > part of the Linux source tree and I see strong evidence to suggest > > > it's released and distributed completely separately from the kernel. > >

Re: [openstack-dev] [Cinder] A possible solution for HA Active-Active

2015-08-05 Thread Philipp Marek
> [...] > > Pacemaker is *the* Linux HA Stack. > [...] > > Can you expand on this assertion? It doesn't look to me like it's > part of the Linux source tree and I see strong evidence to suggest > it's released and distributed completely separately from the kernel. If you read "Linux" as "GNU/Linux

Re: [openstack-dev] [Cinder] A possible solution for HA Active-Active

2015-08-05 Thread Philipp Marek
> >Well, is it already decided that Pacemaker would be chosen to provide HA in > >Openstack? There's been a talk "Pacemaker: the PID 1 of Openstack" IIRC. > > > >I know that Pacemaker's been pushed aside in an earlier ML post, but IMO > >there's already *so much* been done for HA in Pacemaker that

Re: [openstack-dev] [Cinder] A possible solution for HA Active-Active

2015-08-04 Thread Philipp Marek
> If we end up using a DLM then we have to detect when the connection to > the DLM is lost on a node and stop all ongoing operations to prevent > data corruption. > > It may not be trivial to do, but we will have to do it in any solution > we use, even on my last proposal that only uses the DB in

Re: [openstack-dev] [infra] [cinder] CI via infra for the DRBD Cinder driver

2015-06-22 Thread Philipp Marek
ck.org/render/?width=600&height=344&_salt=1434709688.361&from=-7days&title=DRBD%20Cinder%2FDevstack%20stats&colorList=red%2Cgreen%2Cblue&target=stats_counts.zuul.pipeline.check.job.check-tempest-dsvm-full-drbd-devstack-nv.FAILURE&target=stats_counts.zuul.pipeline.check.job.check-tempest-dsvm-full-

Re: [openstack-dev] [Manila] Ask for help on supportting the 3-rd party CI for HDFS driver

2015-06-12 Thread Philipp Marek
utor's brain, that is). To repeat the important point: Thanks to all people that are helping on IRC, this is one of the most important assets Openstack has today! -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http

Re: [openstack-dev] [Manila] Ask for help on supportting the 3-rd party CI for HDFS driver

2015-06-10 Thread Philipp Marek
CINDER_ENABLED_BACKENDS=,drbd:drbdmanage" + CINDER_ENABLED_BACKENDS=drbd:drbdmanage" A small comma in the setup definition - and several tests fail, instead of them getting skipped... -- : Ing. Philipp

Re: [openstack-dev] [Nova][Cinder] Questions re progress

2015-03-19 Thread Philipp Marek
We've got github repositories where I try to keep these branches up-to-date for people who want to test, BTW.) Of course, if the hypervisor crashes, you'll have to restart the VMs (or create new ones). If you've got any questions, please don't hesitate to ask me (or drbd

[openstack-dev] [infra] [cinder] CI via infra for the DRBD Cinder driver

2015-02-20 Thread Philipp Marek
filtering proxy could break such things easily. * Apart from the cinder-backend script in devstack (which I'll have to finish first, see eg. package installation), is any other information needed from us? Thank you for your feedback and any help you can offer! Regards, Phi

Re: [openstack-dev] [cinder] qemu-img disk corruption bug to patch or not?

2015-02-20 Thread Philipp Marek
> > Potentially corrupted images are bad; depending on the affected data it > > might only be diagnosed some time after installation, so IMO the fix is > > needed. > > Sure but there is a (potentially hefty) performance impact. Well, do you want fast or working/consistent images? > > Only a min

Re: [openstack-dev] [cinder] qemu-img disk corruption bug to patch or not?

2015-02-19 Thread Philipp Marek
have a check for the qemu version, and only then kick in. Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.com : DRBD® and LINBIT® are registered trademarks of LINBIT, Austria.

Re: [openstack-dev] [nova] Request Spec Freeze Exception (DRBD for Nova)

2015-02-16 Thread Philipp Marek
hat now in Kilo. I sent the Spec Freeze Exception request in January: http://lists.openstack.org/pipermail/openstack-dev/2015-January/054225.html Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.c

Re: [openstack-dev] [nova] Request Spec Freeze Exception (DRBD for Nova)

2015-02-16 Thread Philipp Marek
Hi all, Nikola just told me that I need an FFE for the code as well. Here it is: please grant a FFE for https://review.openstack.org/#/c/149244/ which is the code for the spec at https://review.openstack.org/#/c/134153/ Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way

Re: [openstack-dev] [nova][cinder][neutron][security] Rootwrap on root-intensive nodes

2015-02-05 Thread Philipp Marek
need to "proof" in some way that the arguments they pass on are sane - that's more or less the same thing that this new library would need to do too. Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting

Re: [openstack-dev] [nova][cinder][neutron][security] Rootwrap on root-intensive nodes

2015-02-04 Thread Philipp Marek
evel already exists at the current rootwrap caller site, too - and if that one can be tricked to do something against "image.img & rm -rf /", then the additional layer can be tricked, too. I'm trying to get at the point everything that can be forgot to check at the

Re: [openstack-dev] [nova][cinder][neutron][security] Rootwrap on root-intensive nodes

2015-02-04 Thread Philipp Marek
ould buy us, but perhaps I just don't understand something here. So, IMO, solution 1 (one) would be the way to go ... it gets to security asymptotically (and might never reach it), but at least it provides a bit of help. And if the rootwrap filter specification would be linked to i

Re: [openstack-dev] [nova] Request Spec Freeze Exception (DRBD for Nova)

2015-01-30 Thread Philipp Marek
nodes _at the same time_, so it wouldn't matter if one of them crashes for whatever reason. Please help us *now* to get the change in. It's only a few lines in a separate driver, so until it gets configured it won't even be noticed! And yes, of course we're planning to do

Re: [openstack-dev] [cinder] [nova] [scheduler] Nova node name passed to Cinder

2015-01-28 Thread Philipp Marek
gards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.com : DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. __ OpenStack

Re: [openstack-dev] [cinder] [nova] [scheduler] Nova node name passed to Cinder

2015-01-26 Thread Philipp Marek
me which Nova host will be used to access the data. but it's not passed in there: > > The arguments passed to this functions already include an > > "attached_host" value, sadly it's currently given as "None"... Therefore my question where/when that value

[openstack-dev] [cinder] [nova] [scheduler] Nova node name passed to Cinder

2015-01-26 Thread Philipp Marek
e"... Thank you for any tips, ideas, and pointers into the code - and, of course, even more so for full-blown patches on review.openstack.org ;) Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.

[openstack-dev] [nova] Request Spec Freeze Exception (DRBD for Nova)

2015-01-12 Thread Philipp Marek
rds, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.com : DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. __ OpenStack D

Re: [openstack-dev] [cinder] [nova] Consistency groups?

2014-11-17 Thread Philipp Marek
tect that case. > Otherwise, it sounds like we need to add a group level API for this > purpose. Perhaps just adding a "volume is in consistency group X" data item would be enough, too? Sorry about being so vague; I'm just not familiar enough with all the interdependencies from

[openstack-dev] [cinder] [nova] Consistency groups?

2014-11-13 Thread Philipp Marek
inters to existing proposals, ideas, opinions, etc. Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.com : DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. __

[openstack-dev] openstack/requirements and tarball subdirs

2014-07-14 Thread Philipp Marek
and install matching distribution packages? Or is that out of scope of OpenStack/Cinder development anyway, and so I can/should ignore that? Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.

[openstack-dev] [cinder][replication-api] replication_rpo_range - why two values?

2014-07-11 Thread Philipp Marek
27;t use that one if replication is too fast?" Because we'd like to revert to an older state? I believe that using snapshots would be more sane for that use case. Or I just don't understand the reason, which is very likely, too. -- : Ing. Philipp Marek : LINBIT | Your Way

[openstack-dev] [cinder][replication-api] extra_specs too constant

2014-07-11 Thread Philipp Marek
is heavily loaded, the RPO will vary, too - from a few seconds to a few hours. So, should we announce a range of (0,7200)? Ad 1: because Openstack sees by itself which nodes are available. -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting

[openstack-dev] [cinder][replication-api] Questions about #64026

2014-07-11 Thread Philipp Marek
be easily found. To provide a bit of separation I'll do one question per mail, and each in a subthread of this mail. Thanks for the patience, I'm looking forward to hearing your helpful ideas! Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability :

Re: [openstack-dev] openstack/requirements and tarball subdirs

2014-07-09 Thread Philipp Marek
il about that now. -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.com : DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. ___ OpenStack-dev mailing l

Re: [openstack-dev] openstack/requirements and tarball subdirs

2014-07-08 Thread Philipp Marek
irectory. Nova does the same thing for some of its > dependencies. But such a change would affect _all_ people, right? Hmmm... If you think such a change will be accepted? Thank you for your help! Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA supp

Re: [openstack-dev] openstack/requirements and tarball subdirs

2014-07-08 Thread Philipp Marek
Jenkins use the pre-packaged versions instead of downloading and compiling the tarball? Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.com : DRBD® and LINBIT® are registered trademarks of LINBIT, A

Re: [openstack-dev] openstack/requirements and tarball subdirs

2014-07-07 Thread Philipp Marek
perhaps the cached download is broken? The most current releases are available on http://dbus.freedesktop.org/releases/dbus-python/ though; perhaps the 1.2.0 release works better? But how could I specify to use _that_ source URL? Thank you! Regards, Phil -- : Ing. Philipp Marek

[openstack-dev] openstack/requirements and tarball subdirs

2014-07-07 Thread Philipp Marek
e subdirectory within that tarball includes the version number, as in "dbus-python-0.84.0/". How can I tell the extract script that it should look into that one? Thank you for your help! Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA

Re: [openstack-dev] [Cinder] DRBD integration as volume driver

2014-06-10 Thread Philipp Marek
Hrmpf, sent too fast again. I guess https://wiki.openstack.org/wiki/Requirements is the link I was looking for. Sorry for the noise. ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/

Re: [openstack-dev] [Cinder] DRBD integration as volume driver

2014-06-10 Thread Philipp Marek
So, I now tried to push the proof-of-concept driver to Gerrit, and got this: > Downloading/unpacking dbus (from -r /home/jenkins/workspace/gate- cinder-pep8/requirements.txt (line 32)) > http://pypi.openstack.org/openstack/dbus/ uses an insecure transport scheme (http). Consider using https if

Re: [openstack-dev] [Cinder] DRBD integration as volume driver

2014-06-09 Thread Philipp Marek
lines, allowing to start the services via "pudb") by committing commit 7b6c6685ba3fb40b6ed65d8e3697fa9aac899d85 Author: Philipp Marek Date: Fri Jun 6 11:48:52 2014 +0200 Make starting cinder services possible with "pudb", too. I had that rebased to be on top of 6

[openstack-dev] [Cinder] DRBD integration as volume driver

2014-06-03 Thread Philipp Marek
Hi everybody, at the Juno Design Summit we held a presentation about using DRBD 9 within OpenStack. Here's an overview about the situation; I apologize in advance that the mail got a bit longer, but I think it makes sense to capture all that information in a single piece. WHAT WE HAVE