Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Raditha Dissanayake
I'm not actually looking for stats in this case. We had a very strange occurrence yesterday wherein we had a few reports of porn links appearing on one of our websites. So basically I'm going to be looking for all log entries relating to that one specific section of our site (which won't be a hu

RE: [PHP] Parsing large log files with PHP

2004-02-24 Thread Pablo Gosse
IMHO bad idea to use a web script to process log files of these size (please ignore this comment if you are using the command line version). Yes, this will be a script run from the command line. There are several good open source tools for parsing the apache log files (analog, webalizer, aws

Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Adam Bregenzer
On Tue, 2004-02-24 at 12:39, Pablo Gosse wrote: > I've got a log file that's about 1.2 gig that I need to parse. > > Can PHP handle this or am I better of breaking this down into 12 100mb > chunks and processing it? PHP has a very rich set of functions to read in files, it all depends on what you

Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Raditha Dissanayake
Hi, IMHO bad idea to use a web script to process log files of these size (please ignore this comment if you are using the command line version). There are several good open source tools for parsing the apache log files (analog, webalizer, awstats to name a few). These are very fast and designe

RE: [PHP] Parsing large log files with PHP

2004-02-24 Thread Pablo Gosse
What kind of a log file are we talking here? regardless what processing you need to do generally working on a 1.2GB file with out RAID and/or lots of memory is going to be slow. Pablo Gosse wrote: >Hi folks. Has anyone encountered any problems parsing large log files >with PHP? > >I've got a

RE: [PHP] Parsing large log files with PHP

2004-02-24 Thread Sam Masiello
Are you getting an error when trying to read/parse your log file? If so, what is that error? --Sam Pablo Gosse wrote: > Hi folks. Has anyone encountered any problems parsing large log > files with PHP? > > I've got a log file that's about 1.2 gig that I need to parse. > > Can PHP handle th

Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Raditha Dissanayake
Hi, What kind of a log file are we talking here? regardless what processing you need to do generally working on a 1.2GB file with out RAID and/or lots of memory is going to be slow. Pablo Gosse wrote: Hi folks. Has anyone encountered any problems parsing large log files with PHP? I've got a