On Fri, 21 Aug 2015, Edward Ned Harvey (lopser) wrote:
I want to know if a web server gets overrun by too much traffic requests. I
certainly know how to monitor memory, and tweak the MPM and stuff in apache
config files, but I assume if it runs out of threads or memory or anything, it
will throw errors into the log file, which are immediately buried.
I can definitely figure this out, but I know I definitely shouldn't. It's
already been done.
I am familiar with zabbix and spiceworks and other monitoring systems. I'm
looking for something more specific than monitoring and alerting - I'm looking
for something that knows how to process the logs of apache specifically, and
mysql, and whatever other services we're using. So I'm looking for log
processing.
Something out there already knows how to process all the log files, including
the apache logs, and tell me the important stuff.
How's it done?
the problem is defining 'the important stuff' for you :-)
having something watch the logs and alert when it sees things it's been told to
look for is a really good thing to do. Apache has a lot of flexibility in what
you log and one of the things that you can log (but isn't logged by default) is
information about how long it took to process the request. Creating a new log
that has just the information you will care about looking at and then having
something watch for anomolies in that log would be rather easy to do.
if you can set some threshold that 'all responses that take longer than X should
generate alerts' it trivial. If you want to alert when the response time is
'unusual' it gets much more interesting.
There are companies out there that will process your logs for a fee, but I don't
know if that's what you are looking for.
I tend to go the route of gathering all the logs and then using various tools to
analyze them, some in real-time, some in periodic reports.
I can go on for a long time on specifics if you want, but first off, are you
just looking for something to just buy? or are you looking for the tools to let
you process the logs for what you care about?
David Lang
_______________________________________________
Tech mailing list
Tech@lists.lopsa.org
https://lists.lopsa.org/cgi-bin/mailman/listinfo/tech
This list provided by the League of Professional System Administrators
http://lopsa.org/
_______________________________________________
Tech mailing list
Tech@lists.lopsa.org
https://lists.lopsa.org/cgi-bin/mailman/listinfo/tech
This list provided by the League of Professional System Administrators
http://lopsa.org/
