Re: [pve-devel] KVM Live Backup performance improvement, but the VM is crashing

2014-03-14 Thread Dietmar Maurer
> http://forum.proxmox.com/threads/18011-Proxmox-VE-3-2- > released!?p=92037#post92037 > > Any idea for fix? Do you have any information about the error? What does not work? Backup log? How to reproduce? ___ pve-devel mailing list pve-devel@pve.proxmox

[pve-devel] KVM Live Backup performance improvement, but the VM is crashing

2014-03-14 Thread Cesar Peschiera
[pve-devel] KVM Live Backup performance Eric Blevins eric at netwalk.com Thu Dec 5 18:57:19 CET 2013 I just uploaded the qemu 1.7 package with new backup patches: You should be able to install with: # wget ftp://download.proxmox.com/tmp/pve-libspice-server1_0.12.4-3_amd64.deb # wget ftp://downlo

Re: [pve-devel] ZFS Storage Patches

2014-03-14 Thread Michael Rasmussen
On Fri, 14 Mar 2014 12:24:10 -0700 Chris Allen wrote: > Oops forgot to attach the script. Here's the script I mentioned. > I have added this line so that my MUA can sort the mail correct: msg += 'Date: %s \n' % time.strftime("%a, %d %b %Y %X %z") -- Hilsen/Regards Michael Rasmussen Get my pu

Re: [pve-devel] ZFS Storage Patches

2014-03-14 Thread Michael Rasmussen
On Fri, 14 Mar 2014 12:24:10 -0700 Chris Allen wrote: > Oops forgot to attach the script. Here's the script I mentioned. > Thanks. -- Hilsen/Regards Michael Rasmussen Get my public GnuPG keys: michael rasmussen cc http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E mir datanom n

Re: [pve-devel] ZFS Storage Patches

2014-03-14 Thread Michael Rasmussen
On Fri, 14 Mar 2014 12:21:43 -0700 Chris Allen wrote: > 8k for me too is much better than 4k. With 4k I tend to hit my IOPS limit > easily, with not much throughput, and I get a lot of IO delay on VMs when > the SAN is fairly busy. Currently I'm leaning towards 16k, sparse, with > lz4 compressi

Re: [pve-devel] ZFS Storage Patches

2014-03-14 Thread Chris Allen
Oops forgot to attach the script. Here's the script I mentioned. On Fri, Mar 14, 2014 at 12:21 PM, Chris Allen wrote: > > I have already made some test and I have not be able to make any > > conclusive tests proving performance should be hurt by using sparse. > > Yeah it shouldn't affect the Z

Re: [pve-devel] ZFS Storage Patches

2014-03-14 Thread Chris Allen
> I have already made some test and I have not be able to make any > conclusive tests proving performance should be hurt by using sparse. Yeah it shouldn't affect the ZFS mechanics at all, the ZVOL will just lack a reservation. > Is sparse a way to provision more than a 100% then? Yes. That, an

Re: [pve-devel] ZFS Storage Patches

2014-03-14 Thread Michael Rasmussen
On Fri, 14 Mar 2014 10:11:17 -0700 Chris Allen wrote: > > It was also part of latest 3.1. Double-click the mouse over your > > storage specification in Datacenter->storage and the panel pops up. > > Patched panel attached. > I forgot to mention that at the moment the code for creating ZFS storag

Re: [pve-devel] ZFS Storage Patches

2014-03-14 Thread Chris Allen
> It was also part of latest 3.1. Double-click the mouse over your > storage specification in Datacenter->storage and the panel pops up. > Patched panel attached. Thank you, I was unaware of this. > BTW. Have you made any performance measures sparse vs non-sparse and > write cache vs no write ca

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Alexandre DERUMIER
>>Should we log anything else? I'll test it this weekend, but I think it's ok like this - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER" Cc: "Eric Blevins" , pve-devel@pve.proxmox.com Envoyé: Vendredi 14 Mars 2014 13:21:12 Objet: RE: [pve-devel] pve-firewall: using

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Dietmar Maurer
> >>The whole point is that I want to have local files with "easy to > >>parse" format, so that we can view them easily and "fast" (those files can > have many entries!). > yes, no problem for local file Just applied a patch to improve the log format to: see https://git.proxmox.com/?p=pve

Re: [pve-devel] pve-firewall : add support to suricata ips with NFQUEUE target

2014-03-14 Thread Alexandre DERUMIER
>>Bu you should really sleep a few hours (mail sent a 3:55?) I was doing some servers maintenance for work this night ;-) >>Feel free to add that. Ok, I'll check that next week. (I'm working currently on ipset) - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER" ,

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Alexandre DERUMIER
>>The whole point is that I want to have local files with "easy to parse" >>format, so that we can view them >>easily and "fast" (those files can have many entries!). yes, no problem for local file >>So I would like to have code to send data direct to log servers (using syslog >>protocol, or

Re: [pve-devel] pve-firewall : add support to suricata ips with NFQUEUE target

2014-03-14 Thread Dietmar Maurer
> I have secret plan to integrate suricata ips at the proxmox host level. > (I have critical vms, and customers require an ips sometime) You are always a step ahead ;-) Bu you should really sleep a few hours (mail sent a 3:55?) > ips can use a lot of cpu, and be able to enable it on specific v

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Dietmar Maurer
> can now output in json format, and then logstash or splunk can read them > easily. > > code is here : > http://git.netfilter.org/ulogd2/tree/output/ulogd_output_JSON.c?id=2b39df > 550fbad944b4aab77617d4272c5d62ba70 > > > It could be wonderfull to add this kind of output format I am quite unsur