Re: [pve-devel] pve-qemu-kvm: enable glusterfs backend

2013-08-12 Thread Dietmar Maurer
Seems they provide debian packages for wheezy: http://download.gluster.org/pub/gluster/glusterfs/3.4/3.4.0/Debian/apt/pool/main/g/glusterfs/ Can we use those packages instead? > -Original Message- > From: Alexandre DERUMIER [mailto:aderum...@odiso.com] > Sent: Montag, 12. August 2013 12:

Re: [pve-devel] [PATCH 07/09] Explicite use user root when making ssh call.

2013-08-12 Thread Dietmar Maurer
Why is that required? > -Original Message- > From: pve-devel-boun...@pve.proxmox.com [mailto:pve-devel- > boun...@pve.proxmox.com] On Behalf Of m...@datanom.net > Sent: Montag, 12. August 2013 20:09 > To: pve-devel@pve.proxmox.com > Subject: [pve-devel] [PATCH 07/09] Explicite use user roo

Re: [pve-devel] Plugin to add support for native ZFS on shared storage

2013-08-12 Thread Dietmar Maurer
> This newest version fixes a serious bug cause my asynchronious AJAX calls from > web gui. I do not understand that description. We have a simple programming model using processes, so there are no threads involved. Specially, run_command() is syncrounous, so the output from one command cannot

[pve-devel] Resource Pool problems when cloning

2013-08-12 Thread Andrew Thrift
Hi, We have noticed on two separate clusters that when we perform a clone, and select a destination resource pool that the resulting cloned machine is NOT in the pool we selected (it is in the root pool) We also noticed that when logged in as a restricted user (that only has access to the one

Re: [pve-devel] Plugin to add support for native ZFS on shared storage

2013-08-12 Thread Michael Rasmussen
On Mon, 12 Aug 2013 20:24:20 +0200 (CEST) Alexandre DERUMIER wrote: > Thanks, I'll really try to test it this month ! > I might even mean you trash NexentaStore;-) Omnios requires so much less memory and performs way better and at the same time gives you a true Solaris/OpenIndiana/Illumos

Re: [pve-devel] Plugin to add support for native ZFS on shared storage

2013-08-12 Thread Alexandre DERUMIER
Thanks, I'll really try to test it this month ! - Mail original - De: m...@datanom.net À: pve-devel@pve.proxmox.com Envoyé: Lundi 12 Août 2013 20:12:48 Objet: [pve-devel] Plugin to add support for native ZFS on shared storage This newest version fixes a serious bug cause my

[pve-devel] [PATCH 01/01] Added support for ZFS Storage Plugin

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- www/manager/Makefile | 1 + www/manager/Utils.js | 2 + www/manager/dc/StorageView.js | 11 +++ www/manager/qemu/Clone.js | 3 +- www/manager/qemu/HDEdit.js | 3 +- www/manager/storage/ZFSEdit.js

[pve-devel] Plugin to add support for native ZFS on shared storage

2013-08-12 Thread mir
This newest version fixes a serious bug cause my asynchronious AJAX calls from web gui. The problem displays its ugly face when the content tab is invoked in the gui. This request calls to plugin method 'list_images' which will produce a list of all images available on the storage server. After th

[pve-devel] [PATCH 09/09] This newest version fixes a serious bug cause my asynchronious AJAX calls from web gui.

2013-08-12 Thread mir
From: Michael Rasmussen The problem displays its ugly face when the content tab is invoked in the gui. This request calls to plugin method 'list_images' which will produce a list of all images available on the storage server. After the gui receives this list it will call the plugins method 'path'

[pve-devel] [PATCH 06/09] Refactored code according to suggestions by Alexandre. Also fixed bug so that parent to an image is returned.

2013-08-12 Thread mir
From: Michael Rasmussen The fix solves timeout problems in pve GUI since refactored code runs 5 times faster than original code. Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 70 1 file changed, 35 insertions(+), 35 deletions(-

[pve-devel] [PATCH 02/09] If remove of a base-image fails because of dependent clones we must recreate the lun since dependent clones require access to the image.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 14 ++ 1 file changed, 10 insertions(+), 4 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index 909f71f..b02a87a 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/St

[pve-devel] [PATCH 01/09] Added support for ZFS Storage Plugin

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage.pm | 2 + PVE/Storage/Makefile | 2 +- PVE/Storage/Plugin.pm| 2 +- PVE/Storage/ZFSPlugin.pm | 646 +++ 4 files changed, 650 insertions(+), 2 deletions(-)

[pve-devel] Plugin to add support for native ZFS on shared storage

2013-08-12 Thread mir
This newest version fixes a serious bug cause my asynchronious AJAX calls from web gui. The problem displays its ugly face when the content tab is invoked in the gui. This request calls to plugin method 'list_images' which will produce a list of all images available on the storage server. After th

[pve-devel] [PATCH 05/09] Only append volumes which is created by pve-manager

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 5 - 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index e39b965..ff32b97 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Storage/ZFSPlu

[pve-devel] [PATCH 07/09] Explicite use user root when making ssh call.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 12 +--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index 0ec6632..a562635 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Stora

[pve-devel] [PATCH 08/09] When resizing a disk also resize the LUN.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 16 ++-- 1 file changed, 14 insertions(+), 2 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index a562635..c5bf8c4 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/

[pve-devel] [PATCH 04/09] Fix small variable name conflict.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index 0addd0b..e39b965 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Storage/ZF

[pve-devel] [PATCH 03/09] Remove unnecessary output from error message.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index b02a87a..0addd0b 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Storage/ZFSPlugin.

[pve-devel] [PATCH 04/09] Fix small variable name conflict.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index 0addd0b..e39b965 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Storage/ZF

[pve-devel] [PATCH 07/09] Explicite use user root when making ssh call.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 12 +--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index 0ec6632..a562635 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Stora

[pve-devel] [PATCH 05/09] Only append volumes which is created by pve-manager

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 5 - 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index e39b965..ff32b97 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Storage/ZFSPlu

[pve-devel] [PATCH 01/09] Added support for ZFS Storage Plugin

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage.pm | 2 + PVE/Storage/Makefile | 2 +- PVE/Storage/Plugin.pm| 2 +- PVE/Storage/ZFSPlugin.pm | 646 +++ 4 files changed, 650 insertions(+), 2 deletions(-)

[pve-devel] [PATCH 03/09] Remove unnecessary output from error message.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index b02a87a..0addd0b 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/Storage/ZFSPlugin.

[pve-devel] [PATCH 08/09] When resizing a disk also resize the LUN.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 16 ++-- 1 file changed, 14 insertions(+), 2 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index a562635..c5bf8c4 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/

[pve-devel] [PATCH 06/09] Refactored code according to suggestions by Alexandre. Also fixed bug so that parent to an image is returned.

2013-08-12 Thread mir
From: Michael Rasmussen The fix solves timeout problems in pve GUI since refactored code runs 5 times faster than original code. Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 70 1 file changed, 35 insertions(+), 35 deletions(-

[pve-devel] [PATCH 09/09] This newest version fixes a serious bug cause my asynchronious AJAX calls from web gui.

2013-08-12 Thread mir
From: Michael Rasmussen The problem displays its ugly face when the content tab is invoked in the gui. This request calls to plugin method 'list_images' which will produce a list of all images available on the storage server. After the gui receives this list it will call the plugins method 'path'

[pve-devel] [PATCH 02/09] If remove of a base-image fails because of dependent clones we must recreate the lun since dependent clones require access to the image.

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- PVE/Storage/ZFSPlugin.pm | 14 ++ 1 file changed, 10 insertions(+), 4 deletions(-) diff --git a/PVE/Storage/ZFSPlugin.pm b/PVE/Storage/ZFSPlugin.pm index 909f71f..b02a87a 100644 --- a/PVE/Storage/ZFSPlugin.pm +++ b/PVE/St

[pve-devel] [PATCH 01/01] Added support for ZFS Storage Plugin

2013-08-12 Thread mir
From: Michael Rasmussen Signed-off-by: Michael Rasmussen --- www/manager/Makefile | 1 + www/manager/Utils.js | 2 + www/manager/dc/StorageView.js | 11 +++ www/manager/qemu/Clone.js | 3 +- www/manager/qemu/HDEdit.js | 3 +- www/manager/storage/ZFSEdit.js

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
> cluster.data-self-heal-algorithm (default reset) > > Selects between "full", "diff", and “reset”. The "full" algorithm copies the > entire > file from source to sinks. The "diff" algorithm copies to sinks only those > blocks > whose checksums don't match with those of source. Reset uses a heu

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
> Also, It is extremely slow here. Fixed, performance is OK now - was a problem on the switch. ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
Oh, I found 2 interesting volume options ! cluster.data-self-heal-algorithm (default reset) Selects between "full", "diff", and “reset”. The "full" algorithm copies the entire file from source to sinks. The "diff" algorithm copies to sinks only those blocks whose checksums don't match with th

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
Not sure we can have the progress. We can only see files which need to be repair - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER" Cc: pve-devel@pve.proxmox.com Envoyé: Lundi 12 Août 2013 14:04:25 Objet: RE: [pve-devel] pve-storage: add Glusterfs Plugin > Check th

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
> Check the status of healing, by using the command, > >gluster volume heal info That does not really display any useful info (progress). ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
more infos here : https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage/2.1-RC/html/Administration_Guide/sect-User_Guide-Managing_Volumes-Self_heal.html - Mail original - De: "Alexandre DERUMIER" À: "Dietmar Maurer" Cc: pve-devel@pve.proxmox.com Envoyé: Lundi 12 Ao

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
Initiate self heal also, by gluster volume heal Check the status of healing, by using the command, gluster volume heal info - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER" Cc: pve-devel@pve.proxmox.com Envoyé: Lundi 12 Août 2013 13:53:12 Objet: RE:

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
> I really don't known how it's works, > as by nature, glusterfs is done to manage file and not blocks. > So maybe it need to copy the whole file instead missing blocks ? Also, It is extremely slow here. And there are no logs about self healing (status/progress)? _

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
I really don't known how it's works, as by nature, glusterfs is done to manage file and not blocks. So maybe it need to copy the whole file instead missing blocks ? from doc: http://www.gluster.org/community/documentation/index.php/GlusterFS_Technical_FAQ#What_about_deletion_self.2Fauto_healing

[pve-devel] weird errors and inconsistencies from a database

2013-08-12 Thread Dietmar Maurer
Form http://gluster.org/community/documentation/index.php/Basic_Gluster_Troubleshooting [QUOTE] 15. I am getting weird errors and inconsistencies from a database I am running in a Gluster volume Unless your database does almost nothing, this is expected. Gluster does not support structured dat

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
I tested with your single 3-node setup. But I do not understand how that self-healing work. I simply installed a VM, and rebooted one node during install. After that there is a high processor use with glusterfs/glusterfsd on all nodes. But how can I display recovery status? Seems they simply co

Re: [pve-devel] pve-qemu-kvm: enable glusterfs backend

2013-08-12 Thread Alexandre DERUMIER
Works fine, thanks ! - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER" Cc: pve-devel@pve.proxmox.com Envoyé: Lundi 12 Août 2013 11:38:54 Objet: RE: [pve-devel] pve-qemu-kvm: enable glusterfs backend fixed- please test again. > -Original Message- > From: Al

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
better : http://gluster.org/community/documentation/index.php/Gluster_3.2:_Setting_Volume_Options#auth.allow auth.allow 'IP addresses/Host name' of the clients which should be allowed to access the the volume.* (allow all) So this is when we create the volume. - Mail original -

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
>>Where do I specify them? Any idea?  Not sure about it: https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage_Software_Appliance/3.2/html/User_Guide/chap-User_Guide-Managing_Volumes.html nfs.rpc-auth-allowAllow a comma separated list of addresses and/or hostnames to connec

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
> GlusterFS as of now supports only IP/port based authentication. You specify a > range of IP addresses separately for clients and management nodes to allow > access. Where do I specify them? Any idea? ___ pve-devel mailing list pve-devel@pve.proxmox.c

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
>>Seems I can mount the glusterfs storage from any server. Is there some kind  >>of access control, to limit access to selected servers?  Good point, I don't have read too much glusterfs doc. According http://gluster.org/community/documentation/index.php/GlusterFS_Technical_FAQ How to make Glus

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
Seems I can mount the glusterfs storage from any server. Is there some kind of access control, to limit access to selected servers? ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] pve-qemu-kvm: enable glusterfs backend

2013-08-12 Thread Dietmar Maurer
fixed- please test again. > -Original Message- > From: Alexandre DERUMIER [mailto:aderum...@odiso.com] > Sent: Montag, 12. August 2013 11:31 > To: Dietmar Maurer > Cc: pve-devel@pve.proxmox.com > Subject: Re: [pve-devel] pve-qemu-kvm: enable glusterfs backend > > I can't clone the git re

Re: [pve-devel] pve-qemu-kvm: enable glusterfs backend

2013-08-12 Thread Alexandre DERUMIER
I can't clone the git repo... git clone git://git.proxmox.com/git/glusterfs.git Cloning into 'glusterfs'... fatal: The remote end hung up unexpectedly - Mail original - De: "Dietmar Maurer" À: "Alexandre Derumier" , pve-devel@pve.proxmox.com Envoyé: Lundi 12 Août 2013 11:19:35 Obje

Re: [pve-devel] pve-qemu-kvm: enable glusterfs backend

2013-08-12 Thread Dietmar Maurer
Please can you test: https://git.proxmox.com/?p=glusterfs.git;a=summary > -Original Message- > From: pve-devel-boun...@pve.proxmox.com [mailto:pve-devel- > boun...@pve.proxmox.com] On Behalf Of Alexandre Derumier > Sent: Montag, 12. August 2013 09:58 > To: pve-devel@pve.proxmox.com > Sub

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Dietmar Maurer
> But qemu access directly to the vm images, so performance is good. Just curious, what performance can we expect (glusterfs was quite slow in past)? ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/

Re: [pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre DERUMIER
Small tuto to create a glusterfs storage on proxmox node node2 - apt-get install glusterfs-server mkdir /var/lib/vz/gluster node3 - apt-get install glusterfs-server mkdir /var/lib/vz/gluster node1 - apt-get install gluster

[pve-devel] pve-storage: add Glusterfs Plugin

2013-08-12 Thread Alexandre Derumier
This add glusterfs plugin. It's use a fuse mount point for volume management (create/delete/snapshot,rollback,...) But qemu access directly to the vm images, so performance is good. ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmo

[pve-devel] [PATCH] add Glusterfs Plugin

2013-08-12 Thread Alexandre Derumier
storage.cfg glusterfs: glusterstore path /mnt/pve/gluster server server.fqdn (optional, default is localhost) volume glustervolume content images maxfiles 1 Signed-off-by: Alexandre Derumier --- PVE/Storage.pm |2 + PVE/Storage

[pve-devel] pve-qemu-kvm: enable glusterfs backend

2013-08-12 Thread Alexandre Derumier
this need glusterfs-common package backported from debian sid (http://packages.debian.org/sid/glusterfs-common) It's compile under wheezy without problem or additional patch ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi

[pve-devel] [PATCH] enable glusterfs backend

2013-08-12 Thread Alexandre Derumier
Signed-off-by: Alexandre Derumier --- debian/control |4 ++-- debian/rules |2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/debian/control b/debian/control index 7b40a99..81e7629 100644 --- a/debian/control +++ b/debian/control @@ -2,12 +2,12 @@ Source: pve-qemu-kv