We need a structured log to avoid parsing. I talk with Wietse in the year 2011 at FISL conference (Porto Alegre/Brasil).
The second problem is load this data to a database. Rsyslog put the data in a single column, and use full text search is inevitable. While don't have a better solution, I wrote a daemon to parse and insert the data on a database. I will search this code and put on github on next week. []'s Reinaldo Gil Lima de Carvalho Em 15/03/2013, às 03:59, Ram <r...@netcore.co.in> escreveu: > I have a postfix server sending out mails and we are creating reports by > parsing the maillogs using a couple of perl cron scripts > (linux machine with mysql ) > > Now the requirement is of realtime reporting. > I tried using rsyslog with a mysql table. But the performance is far too bad. > Rsyslog seems to have some memory leak and it brings down the machine. > > I guess realtime logging should be a very common requirement. What is the > best way for this > > > Thanks > Ram > > > > >