[pve-devel] pveceph : disabling cephx auth + debug when we init ceph.conf ?

2017-04-19 Thread Alexandre DERUMIER
Hi, to have good performance with ceph, they are 2 boosts possible: Maybe we could add them as command option in ceph init ? 1)disabling cephx auth. [global] auth_cluster_required = none auth_service_required = none auth_client_required = none - I always disabling them on my cluster, it's g

Re: [pve-devel] back from holiday, I'll more time to work on proxmox

2017-04-19 Thread Alexandre DERUMIER
>>Also client side, a new qemu optimisation has been done, reducing memory copy >>between qemu and librbd, so reduce latency. >> >>https://lists.gnu.org/archive/html/qemu-devel/2017-02/msg04545.html >> >>this patch is not yet upstream (I think it has missed the qemu 2.9 windows), >>but it's in go

Re: [pve-devel] [RFC qemu-server 0/4] Fix live-migration with local disks for Qemu 2.9

2017-04-19 Thread Alexandre DERUMIER
>>@Alexandre: since this code is originally by you, could you take a look at >>these as well? Thanks! Yes, sure. I'll test theme next week. (need to upgrade my test cluster to stretch before) - Mail original - De: "Fabian Grünbichler" À: "pve-devel" Cc: "aderumier" Envoyé: Mercredi 19

Re: [pve-devel] RFC V2 Storage Replica

2017-04-19 Thread Wolfgang Link
Hi Alexandre, this it planed, but first we will make a VM/CT centric storage replication cluster intern replica. On 04/20/2017 07:37 AM, Alexandre DERUMIER wrote: >>> I'm thinking of using this for disaster recovery, with ceph + rbd snapshots >>> export/import, >>> >>> on 2 ceph clusters on re

Re: [pve-devel] RFC V2 Storage Replica

2017-04-19 Thread Alexandre DERUMIER
>>I'm thinking of using this for disaster recovery, with ceph + rbd snapshots >>export/import, >> >>on 2 ceph clusters on remote datacenter. >>Could be great to be able to define 2 storeid in /etc/pve/storage.cfg. Thinking about that, What I would like in the future, it's more 2 proxmox cluste

Re: [pve-devel] RFC V2 Storage Replica

2017-04-19 Thread Alexandre DERUMIER
Hi Wolfgang, I don't have read all the patches, but you do you define source and target storage ? I'm thinking of using this for disaster recovery, with ceph + rbd snapshots export/import, on 2 ceph clusters on remote datacenter. Could be great to be able to define 2 storeid in /etc/pve/stor

[pve-devel] applied: [PATCH manager] filter templates in bulk start/stop

2017-04-19 Thread Dietmar Maurer
The VMSelector class still contains some debugging code - please can we remove that (see console.log in setValue())? ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] applied: [PATCH manager] add skylake to cpu types

2017-04-19 Thread Dietmar Maurer
applied ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] applied: [PATCH manager] set default focus and default button for edit window

2017-04-19 Thread Dietmar Maurer
applied ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] kernel BUG at ./include/linux/swapops.h:129!

2017-04-19 Thread Michael Rasmussen
On Wed, 19 Apr 2017 22:29:23 +0200 (CEST) Fabian Grünbichler wrote: > > we are aware of this issue (and have been chasing it for around two weeks > already, it is most likely affecting all of the Ubuntu Zesty based 4.10 > kernels we have released in the PVE 5 Beta so far). unfortunately there

Re: [pve-devel] kernel BUG at ./include/linux/swapops.h:129!

2017-04-19 Thread Fabian Grünbichler
> Eric Blevins hat am 19. April 2017 um 21:59 geschrieben: > I believe 4.10.8-6 is affected by this bug: > https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1674838 > > My server just experienced this problem, had to power cycle to recover. > If there is any info I can provide that might help

[pve-devel] kernel BUG at ./include/linux/swapops.h:129!

2017-04-19 Thread Eric Blevins
I believe 4.10.8-6 is affected by this bug: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1674838 My server just experienced this problem, had to power cycle to recover. If there is any info I can provide that might help fix this let me know but I mostly mailed pve-devel to make you aware o

Re: [pve-devel] [PATCH manager] set default focus and default button for edit window

2017-04-19 Thread Emmanuel Kasper
Tested OK, and looks good to me. A nice improvement for power users. On 04/18/2017 04:55 PM, Dominik Csapak wrote: > this patch sets following defaults for the edit window: > > defaultFocus: 'field' > > sets the focus on the first field it finds in its child items, > works for most edit windows

Re: [pve-devel] [PATCH] qemu-server : scsi_fmt : add rerror

2017-04-19 Thread Alexandre DERUMIER
>>Are all values supported? I thought only the default was supported >>there. (Although that may have also been the case for werror). >>If it works, though, better just remove %rerror_fmt and move its >>contents into %drivedesc_base to where werror is already, as it is then >>part of every drive f

[pve-devel] [PATCH] API2/Ceph.pm : remove filestore xattr use omap

2017-04-19 Thread Alexandre Derumier
it's not used anymore since emperor Signed-off-by: Alexandre Derumier --- PVE/API2/Ceph.pm | 1 - 1 file changed, 1 deletion(-) diff --git a/PVE/API2/Ceph.pm b/PVE/API2/Ceph.pm index 1ed225bd..6ffa528e 100644 --- a/PVE/API2/Ceph.pm +++ b/PVE/API2/Ceph.pm @@ -757,7 +757,6 @@ __PACKAGE__->registe

[pve-devel] [PATCH] ceph : use jemalloc for build

2017-04-19 Thread Alexandre Derumier
Signed-off-by: Alexandre Derumier --- patches/0007-use-jemmaloc-for-build.patch | 47 +++ patches/series| 1 + 2 files changed, 48 insertions(+) create mode 100644 patches/0007-use-jemmaloc-for-build.patch diff --git a/patches/0007-use-je

[pve-devel] [RFC qemu-server 1/4] start: keep VM paused when migrating via unix socket

2017-04-19 Thread Fabian Grünbichler
this (correctly!) errored out with Qemu 2.9 when live-migrating local disks, because the NBD server blocks the VM from being resumed. was probably missed when migrating via unix domains was originally introduced.. Signed-off-by: Fabian Grünbichler --- PVE/QemuServer.pm | 2 +- 1 file changed, 1

[pve-devel] [RFC qemu-server 3/4] migrate: cleanup nbd source disks earlier

2017-04-19 Thread Fabian Grünbichler
Signed-off-by: Fabian Grünbichler --- PVE/QemuMigrate.pm | 5 + 1 file changed, 5 insertions(+) diff --git a/PVE/QemuMigrate.pm b/PVE/QemuMigrate.pm index b513a67..04118bd 100644 --- a/PVE/QemuMigrate.pm +++ b/PVE/QemuMigrate.pm @@ -885,6 +885,11 @@ sub phase3_cleanup { if ($self->{li

[pve-devel] [RFC qemu-server 2/4] fix #1338: migrate: stop nbd before resuming

2017-04-19 Thread Fabian Grünbichler
since Qemu 2.9, block device write access is limited to one writer unless shared_rw is set to true. there is an exception for live-migrating local disks via NBD as long as the VM is suspended. stop the NBD server before resuming the VM accordingly to unbreak local disk live-migration. Signed-off-

[pve-devel] [RFC qemu-server 4/4] migrate: clarify comment

2017-04-19 Thread Fabian Grünbichler
Signed-off-by: Fabian Grünbichler --- PVE/QemuMigrate.pm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/PVE/QemuMigrate.pm b/PVE/QemuMigrate.pm index 04118bd..68ec69f 100644 --- a/PVE/QemuMigrate.pm +++ b/PVE/QemuMigrate.pm @@ -899,7 +899,7 @@ sub phase3_cleanup {

[pve-devel] [RFC qemu-server 0/4] Fix live-migration with local disks for Qemu 2.9

2017-04-19 Thread Fabian Grünbichler
@Alexandre: since this code is originally by you, could you take a look at these as well? Thanks! Fabian Grünbichler (4): start: keep VM paused when migrating via unix socket fix #1338: migrate: stop nbd before resuming migrate: cleanup nbd source disks earlier migrate: clarify comment P

[pve-devel] [PATCH manager] filter templates in bulk start/stop

2017-04-19 Thread Dominik Csapak
because we cannot start/stop templates Signed-off-by: Dominik Csapak --- www/manager6/form/VMSelector.js | 26 ++ 1 file changed, 14 insertions(+), 12 deletions(-) diff --git a/www/manager6/form/VMSelector.js b/www/manager6/form/VMSelector.js index 81093f1e..59d2b587 100

[pve-devel] [PATCH manager] add skylake to cpu types

2017-04-19 Thread Dominik Csapak
Signed-off-by: Dominik Csapak --- www/manager6/form/CPUModelSelector.js | 1 + 1 file changed, 1 insertion(+) diff --git a/www/manager6/form/CPUModelSelector.js b/www/manager6/form/CPUModelSelector.js index bb3d30d5..f29afdc2 100644 --- a/www/manager6/form/CPUModelSelector.js +++ b/www/manager6

Re: [pve-devel] [PATCH] qemu-server : scsi_fmt : add rerror

2017-04-19 Thread Wolfgang Bumiller
Are all values supported? I thought only the default was supported there. (Although that may have also been the case for werror). If it works, though, better just remove %rerror_fmt and move its contents into %drivedesc_base to where werror is already, as it is then part of every drive format hash

[pve-devel] [PATCH lvm 2/4] update sources to 2.02.168-2

2017-04-19 Thread Fabian Grünbichler
Signed-off-by: Fabian Grünbichler --- Makefile | 2 +- LVM2.2.02.168.tgz | Bin 10137600 -> 10147840 bytes 2 files changed, 1 insertion(+), 1 deletion(-) diff --git a/Makefile b/Makefile index d220523..4bf00b2 100644 --- a/Makefile +++ b/Makefile @@ -1,6 +1,6 @@ LVMVERSION=2.02.168

[pve-devel] applied: [PATCH lvm 0/4] LVM updates

2017-04-19 Thread Fabian Grünbichler
sync with Debian stretch and fix config file contents Fabian Grünbichler (4): actually apply config patches for real update sources to 2.02.168-2 rename source archive to .tar bump version to 2.02.168-pve2 changelog.Debian | 8 Makefile

[pve-devel] [PATCH lvm 3/4] rename source archive to .tar

2017-04-19 Thread Fabian Grünbichler
because that's what it is ;) Signed-off-by: Fabian Grünbichler --- Makefile | 2 +- LVM2.2.02.168.tgz => LVM2.2.02.168.tar | Bin 2 files changed, 1 insertion(+), 1 deletion(-) rename LVM2.2.02.168.tgz => LVM2.2.02.168.tar (100%) diff --git a/Makefile b/Makefile

[pve-devel] [PATCH lvm 1/4] actually apply config patches for real

2017-04-19 Thread Fabian Grünbichler
Signed-off-by: Fabian Grünbichler --- Makefile | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/Makefile b/Makefile index 903fc85..d220523 100644 --- a/Makefile +++ b/Makefile @@ -31,8 +31,10 @@ ${DEBS}: ${LVMSRC} tar xf ${LVMSRC} echo "git clone git://git

[pve-devel] [PATCH lvm 4/4] bump version to 2.02.168-pve2

2017-04-19 Thread Fabian Grünbichler
Signed-off-by: Fabian Grünbichler --- changelog.Debian | 8 Makefile | 2 +- 2 files changed, 9 insertions(+), 1 deletion(-) diff --git a/changelog.Debian b/changelog.Debian index 7230d19..89ac090 100644 --- a/changelog.Debian +++ b/changelog.Debian @@ -1,3 +1,11 @@ +lvm2 (2.02.

[pve-devel] [RFC_V2 qemu-sever 1/3] Insert new properties in the Qemu config for the PVE Replica.

2017-04-19 Thread Wolfgang Link
This patch will include all necessary properties for the replication. Also will it enable and disable a replication job when appointed flags are set or deleted. --- PVE/API2/Qemu.pm | 42 ++ PVE/QemuServer.pm | 31 +++ 2 files ch

[pve-devel] [RFC_V2 pve-container 3/3] Destroy all remote and local replication datasets when a CT will destroyed.

2017-04-19 Thread Wolfgang Link
--- src/PVE/API2/LXC.pm | 4 1 file changed, 4 insertions(+) diff --git a/src/PVE/API2/LXC.pm b/src/PVE/API2/LXC.pm index 47dcb08..a913982 100644 --- a/src/PVE/API2/LXC.pm +++ b/src/PVE/API2/LXC.pm @@ -19,6 +19,7 @@ use PVE::LXC::Migrate; use PVE::API2::LXC::Config; use PVE::API2::LXC::Sta

[pve-devel] [RFC_V2 qemu-sever 3/3] Destroy all remote and local replication datasets when a VM will destroyed.

2017-04-19 Thread Wolfgang Link
--- PVE/API2/Qemu.pm | 3 +++ 1 file changed, 3 insertions(+) diff --git a/PVE/API2/Qemu.pm b/PVE/API2/Qemu.pm index ca92b65..3abe795 100644 --- a/PVE/API2/Qemu.pm +++ b/PVE/API2/Qemu.pm @@ -1327,6 +1327,9 @@ __PACKAGE__->register_method({ syslog('info', "destroy VM $vmid: $upid\n")

[pve-devel] [RFC_V2 pve-storage 6/8] This patch will include storage asynchronous replication.

2017-04-19 Thread Wolfgang Link
It is possible to synchronise a volume to an other node in a defined interval. So if a node fail there will be an copy of the volumes from a VM on an other node. With this copy it is possible to start the VM on this node. --- Makefile | 12 +- PVE/API2/Makefile

[pve-devel] [RFC_V2 pve-storage 3/8] Add ip parameter in zfs_request to execute on remote host.

2017-04-19 Thread Wolfgang Link
We need this function to delete remote snapshots. --- PVE/Storage/ZFSPoolPlugin.pm | 37 ++--- 1 file changed, 18 insertions(+), 19 deletions(-) diff --git a/PVE/Storage/ZFSPoolPlugin.pm b/PVE/Storage/ZFSPoolPlugin.pm index 8cc3f05..2cf1bc7 100644 --- a/PVE/Storage

[pve-devel] [RFC_V2 qemu-sever 0/3] This is the implementation for storage replica in Qemu.

2017-04-19 Thread Wolfgang Link
This patches are the basic for pve-storage storage replica series. Wolfgang Link (3): Insert new properties in the Qemu config for the PVE Replica. Integrate replica in the qemu migration. Destroy all remote and local replication datasets when a VM will destroyed. PVE/API2/Qemu.pm |

[pve-devel] [RFC_V2 pve-container 2/3] Integrate storage replica in lxc migration.

2017-04-19 Thread Wolfgang Link
Now it is possible to migrate a CT when replica is enabled. It will reduce replication to an minimal amount. --- src/PVE/LXC/Migrate.pm | 34 +- 1 file changed, 29 insertions(+), 5 deletions(-) diff --git a/src/PVE/LXC/Migrate.pm b/src/PVE/LXC/Migrate.pm index 6b96

[pve-devel] [RFC_V2 qemu-sever 2/3] Integrate replica in the qemu migration.

2017-04-19 Thread Wolfgang Link
Now it is possible to migrate a VM offline when replica is enabled. It will reduce replication to an minimal amount. --- PVE/QemuMigrate.pm | 35 ++- 1 file changed, 30 insertions(+), 5 deletions(-) diff --git a/PVE/QemuMigrate.pm b/PVE/QemuMigrate.pm index e6f147e

[pve-devel] [RFC_V2 pve-container 1/3] Insert new properties in the LXC config for the PVE Storage Replica.

2017-04-19 Thread Wolfgang Link
--- src/PVE/LXC/Config.pm | 81 ++- 1 file changed, 80 insertions(+), 1 deletion(-) Include update_conf to apply config changes. diff --git a/src/PVE/LXC/Config.pm b/src/PVE/LXC/Config.pm index 05cd970..ee45cf0 100644 --- a/src/PVE/LXC/Config.pm ++

[pve-devel] [RFC_V2 pve-storage 0/8] This is the implementation for storage asyncorn replica in the storage lib.

2017-04-19 Thread Wolfgang Link
This patch serie will include storage asyncron replica. [RFC V2]: Make changes as Wolfgang and Thomans replite to the V1 patch series. Note: cron will later chaged to systemd .timer Add update_conf to update the replica file. Wolfgang Link (8): Include new storage function volume

[pve-devel] [RFC_V2 pve-storage 7/8] Include incremental zfs send in storage_migrate.

2017-04-19 Thread Wolfgang Link
When replica is enabled and the target host is the reptarget, the most VM data are on the new target. --- PVE/Storage.pm | 20 +--- 1 file changed, 17 insertions(+), 3 deletions(-) diff --git a/PVE/Storage.pm b/PVE/Storage.pm index 68c39ca..6b8d108 100755 --- a/PVE/Storage.pm +++

[pve-devel] [RFC_V2 pve-container 0/3] This is the implementation for storage replica in LXC.

2017-04-19 Thread Wolfgang Link
This patches are the basic for pve-storage storage replica series. Wolfgang Link (3): Insert new properties in the LXC config for the PVE Storage Replica. Integrate storage replica in lxc migration. Destroy all remote and local replication datasets when a CT will destroyed. src/PVE/API

[pve-devel] [RFC_V2 pve-storage 8/8] Include pve-replica cronjob.

2017-04-19 Thread Wolfgang Link
This is the timer for pvesr run. --- Makefile| 5 + conffiles | 2 ++ pve-replica | 3 +++ 3 files changed, 10 insertions(+) create mode 100644 conffiles create mode 100644 pve-replica diff --git a/Makefile b/Makefile index 0d80ce5..ef911cc 100644 --- a/Makefile +++ b/Makefile @@ -10,

[pve-devel] [RFC_V2 pve-storage 1/8] Include new storage function volume_send.

2017-04-19 Thread Wolfgang Link
If the storage backend support import and export we can send the contend to a remote host. --- PVE/Storage.pm | 18 PVE/Storage/Plugin.pm| 8 PVE/Storage/ZFSPlugin.pm | 7 +++ PVE/Storage/ZFSPoolPlugin.pm | 49 ++

[pve-devel] [RFC_V2 pve-storage 5/8] Add replicate as new storage feature.

2017-04-19 Thread Wolfgang Link
This feature shows that the storage can send and receive images. --- PVE/Storage/ZFSPoolPlugin.pm | 1 + 1 file changed, 1 insertion(+) diff --git a/PVE/Storage/ZFSPoolPlugin.pm b/PVE/Storage/ZFSPoolPlugin.pm index 7579472..c98dc86 100644 --- a/PVE/Storage/ZFSPoolPlugin.pm +++ b/PVE/Storage/ZFSPo

[pve-devel] [RFC_V2 pve-storage 2/8] Include new storage function volume_snapshot_list.

2017-04-19 Thread Wolfgang Link
Returns a list of snapshots (youngest snap first) form a given volid. It is possible to use a prefix to filter the list. --- PVE/Storage.pm | 17 + PVE/Storage/Plugin.pm| 9 + PVE/Storage/ZFSPlugin.pm | 6 ++ PVE/Storage/ZFSPoolPlugin.pm | 38

[pve-devel] RFC V2 Storage Replica

2017-04-19 Thread Wolfgang Link
Changes as suggest by Wolfgang and Thomas. add update_conf to apply config changes. ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] [RFC_V2 pve-storage 4/8] Add function volume_snapshot_delete_remote.

2017-04-19 Thread Wolfgang Link
This function we need for replica to handle snapshots on remote nodes. --- PVE/Storage.pm | 15 +++ PVE/Storage/Plugin.pm| 7 +++ PVE/Storage/ZFSPoolPlugin.pm | 13 - 3 files changed, 34 insertions(+), 1 deletion(-) diff --git a/PVE/Storage.pm b/