Re: Logfile condenser

2010-10-20 Thread Dom Latter
On 20/10/10 18:43, Mark Scholten wrote: I'd like to get some script to process logfiles and gives back the following information: - From (address) - From server (hostname and/or IP) - Destination (address) - Destination server (hostname and/or IP) - Message ID - Time and date (for the receiving

Re: Logfile condenser

2010-10-20 Thread Dom Latter
On 19/10/10 19:42, Jeroen Geilman wrote: "timestamp - client IP [hostname] - orig_envelope_from > orig_envelope_to - Queue ID - final_envelope_from > final_envelope_to - transport:nexthop - server IP [hostname] - delays" You have a copy of the script now, of course, but if you or anybody else

Re: OT Gmail

2010-10-20 Thread Dom Latter
On 20/10/10 05:26, Julio Cesar Covolato wrote: How to scale for milions acounts, how do they do it? http://en.wikipedia.org/wiki/MapReduce may interest you.

Re: Logfile condenser

2010-10-19 Thread Dom Latter
On 19/10/10 21:53, Jeroen Geilman wrote: I am definitely interested, I wasn't baiting you. This is a decidedly untrivial task, given the flexibility of logging. That's okay, I'm taking a very trivial approach - no idea how it would behave when faced with more complicated logs. I'll send it to

Re: Logfile condenser

2010-10-19 Thread Dom Latter
[as subject] On 19/10/10 19:42, Jeroen Geilman wrote: How does it deal with address rewriting and alias expansion, which is the routing core of postfix ? Badly? It's a site-specific script hacked up quickly for my own purposes. "timestamp - client IP [hostname] - orig_envelope_from > orig_

Re: Logfile condenser

2010-10-19 Thread Dom Latter
On 19/10/10 11:55, Mark Scholten wrote: From here there is interest in it. I would edit it to include the Encouraging! client/destination server and message ID, but for the rest it sounds great. Configurable as follows, e.g.: $output = array ('time', 'meat', 'from', 'to', 'hits', 'size');

Logfile condenser

2010-10-19 Thread Dom Latter
Helo, as one might say. Wading through logfiles to find a particular email has been taking up too much of my time recently [1]. I have written a logfile condenser that takes a postfix log and generates a single line per email, with (for example) timestamp, ham /spam, sender, recipient, spam scor