RE: Help parsing a large file

2002-08-22 Thread Bob Showalter
> -Original Message- > From: Max Clark [mailto:[EMAIL PROTECTED]] > Sent: Thursday, August 22, 2002 12:41 AM > To: [EMAIL PROTECTED] > Subject: Help parsing a large file > > > Hi, > > I am trying to parse a large text file (10 MB, 400K lines) with the >

Re: Help parsing a large file

2002-08-21 Thread Dharmendra Rai
Max, use the following algo for ur work: create 2 hash-tables for good and bad addresses. the keys are the domain part of the e-mail addresses. the value part is the reference to an array of id part of the e-mail address. instead of reading data into ur GOOD and BAD fd's , read t

Help parsing a large file

2002-08-21 Thread Max Clark
Hi, I am trying to parse a large text file (10 MB, 400K lines) with the following code. This is running FreeBSD-Stable (dual proc, 1GB ram), however I keep receiving messages that I am out of memory, or that the "query timed out". I need to parse a file with email addresses to sort out garbage.