Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Alexandre DERUMIER
>>Should we log anything else? I'll test it this weekend, but I think it's ok like this - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER" Cc: "Eric Blevins" , pve-devel@pve.proxmox.com Envoyé: Vendredi 14 Mars 2014

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Dietmar Maurer
> >>The whole point is that I want to have local files with "easy to > >>parse" format, so that we can view them easily and "fast" (those files can > have many entries!). > yes, no problem for local file Just applied a patch to improve the log format to: see https://git.proxmox.com/?p=pve

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Alexandre DERUMIER
x27;ll check about logstash and input formats. - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER" Cc: "Eric Blevins" , pve-devel@pve.proxmox.com Envoyé: Vendredi 14 Mars 2014 09:02:28 Objet: RE: [pve-devel] pve-firewall: using NFLOG > c

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-14 Thread Dietmar Maurer
> can now output in json format, and then logstash or splunk can read them > easily. > > code is here : > http://git.netfilter.org/ulogd2/tree/output/ulogd_output_JSON.c?id=2b39df > 550fbad944b4aab77617d4272c5d62ba70 > > > It could be wonderfull to add this kind of output format I am quite unsur

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Alexandre DERUMIER
uot; , "Eric Blevins" , pve-devel@pve.proxmox.com Envoyé: Jeudi 13 Mars 2014 17:49:44 Objet: Re: [pve-devel] pve-firewall: using NFLOG > > logstash can read just about anything, it can also listen on UDP or > > TCP and accept data in a format you specify. > > > >

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Eric Blevins
So you think we can use whatever format we like? And use nxlog to feed logstash? I do not know much about nxlog but I believe it can feed log data as JSON into logstash http://logstash.net/docs/1.3.3/codecs/json logstash has a large number of inputs and some inputs can also use codecs. htt

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Dietmar Maurer
> > logstash can read just about anything, it can also listen on UDP or > > TCP and accept data in a format you specify. > > > > So you think we can use whatever format we like? And use nxlog to feed logstash? ___ pve-devel mailing list pve-devel@pve.p

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Dietmar Maurer
> logstash can read just about anything, it can also listen on UDP or TCP and > accept data in a format you specify. > So you think we can use whatever format we like? ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Eric Blevins
I'm thinking about log centralisation in kibana webinterface, like this: https://home.regit.org/2014/03/suricata-ulogd-splunk-logstash/ Well, looks like we just need to write a format those tools can read? logstash can read just about anything, it can also listen on UDP or TCP and accept da

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Dietmar Maurer
> By the way, do you think it's possible to add ulogd if advanced user want it ? > > I'm thinking about log centralisation in kibana webinterface, like this: > > https://home.regit.org/2014/03/suricata-ulogd-splunk-logstash/ Well, looks like we just need to write a format those tools can read? _

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Alexandre DERUMIER
By the way, do you think it's possible to add ulogd if advanced user want it ? I'm thinking about log centralisation in kibana webinterface, like this: https://home.regit.org/2014/03/suricata-ulogd-splunk-logstash/ - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER (aderum..

Re: [pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Alexandre DERUMIER
>>any objections? No, good job ! - Mail original - De: "Dietmar Maurer" À: "Alexandre DERUMIER (aderum...@odiso.com)" , pve-devel@pve.proxmox.com Envoyé: Jeudi 13 Mars 2014 13:48:12 Objet: pve-firewall: using NFLOG Hi Alexandre, I just switched from LOG to NFLOG, and implemented a si

[pve-devel] pve-firewall: using NFLOG

2014-03-13 Thread Dietmar Maurer
Hi Alexandre, I just switched from LOG to NFLOG, and implemented a simple log daemon called "pvefw-logger". It is just 677 lines of code, so I think this is simpler and more flexible for us than using ulogd. https://git.proxmox.com/?p=pve-firewall.git;a=commitdiff;h=ba0b3a0a1eae4d40ea2cdeeea33