Re: [lopsa-tech] log forwarder for graylog2

2014-09-15 Thread Brad Bendily
I've used logstash to do this. It basically tail's the log file and sends entries to greylog. > On Sep 10, 2014, at 4:53 PM, Yves Dorfsman wrote: > > > Anybody uses graylog2? > > Is there a simple "forwarder" that can be configured to send a list of files > or directory to graylog2? > > All

Re: [lopsa-tech] log forwarder for graylog2

2014-09-13 Thread David Lang
On Fri, 12 Sep 2014, David Nolan wrote: On Friday, September 12, 2014, David Lang wrote: In general, I dislike the methodology of writing data to disk for another file to scrape and do something with. There are just so many things that can go wrong It depends on your requirements for tho

Re: [lopsa-tech] log forwarder for graylog2

2014-09-12 Thread David Nolan
On Friday, September 12, 2014, David Lang wrote: > > > In general, I dislike the methodology of writing data to disk for another > file to scrape and do something with. There are just so many things that > can go wrong > > > It depends on your requirements for those logs and whether losing an entr

Re: [lopsa-tech] log forwarder for graylog2

2014-09-12 Thread David Lang
On Fri, 12 Sep 2014, David Lang wrote: On Thu, 11 Sep 2014, Yves Dorfsman wrote: On 2014-09-10 22:26, David Lang wrote: How many different logs are you talking about? It depends on the server, apps server can have a dozen logs + the regular system logs. Do you have another method of gettin

Re: [lopsa-tech] log forwarder for graylog2

2014-09-12 Thread David Lang
On Thu, 11 Sep 2014, Yves Dorfsman wrote: On 2014-09-10 22:26, David Lang wrote: How many different logs are you talking about? It depends on the server, apps server can have a dozen logs + the regular system logs. Do you have another method of getting the logs other than scraping the files

Re: [lopsa-tech] log forwarder for graylog2

2014-09-11 Thread Craig Cook
You may also want to consider heka to ship logs. https://blog.mozilla.org/services/2013/04/30/introducing-heka/ Just one of many functions it will do. https://blog.safaribooksonline.com/2013/11/03/getting-started-with-log-analysis/ http://blog.librato.com/posts/sf-metrics-meetup-heka-echo Cra

Re: [lopsa-tech] log forwarder for graylog2

2014-09-11 Thread Yves Dorfsman
On 2014-09-10 22:26, David Lang wrote: > How many different logs are you talking about? It depends on the server, apps server can have a dozen logs + the regular system logs. > Do you have another method of getting the logs other than scraping the files? No, I thought graylog2 would come with it

Re: [lopsa-tech] log forwarder for graylog2

2014-09-10 Thread David Lang
sorry, I noticed just after I hit send that you are wanting to get logs _to_ graylog2, not from it. If the logs start out as flat files, and you have no other way of getting the logs, then you need something to scrape them and send them. you have lots of options rsyslog will do this (but has

Re: [lopsa-tech] log forwarder for graylog2

2014-09-10 Thread David Lang
Yes, you will need to HUP rsyslog if you replace the file it's reading. what does graylog2 do with it's logs today? is there any option other than just writing to a file? David Lang On Wed, 10 Sep 2014, Nathan Hruby wrote: We used rsyslog with the imfile option to hoover in httpd logs writt

Re: [lopsa-tech] log forwarder for graylog2

2014-09-10 Thread Nathan Hruby
We used rsyslog with the imfile option to hoover in httpd logs written with cronolog and forward them to graylog. worked well enough, though we did need to hup it after cronolog switched the current logfile sysmlink since it didn't read / recheck the file periodically. This was using the rsyslog

[lopsa-tech] log forwarder for graylog2

2014-09-10 Thread Yves Dorfsman
Anybody uses graylog2? Is there a simple "forwarder" that can be configured to send a list of files or directory to graylog2? All the solutions I am finding are specific to apps (using log4j etc...) or very amateurish, such as "tail -f blah | netcat -" without consideration for when files ar