Greetings !
I can't say if I got the problem write.
Looking at the probem I feel that their are too many multiple entries in the
File B. I think it would not difficult if we simple remove the duplicate
lines from the File B first. If this reduces the file size to something
around 1 to 20 MB, then any common alogrithm would do the work.
with regards
Rajeev Rumale
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Rajeev Rumale
MyAngel.Net Pte Ltd., Phone :
(65)8831530 (office)
#04-01, 180 B, The Bencoolen, Email :
[EMAIL PROTECTED]
Bencoolen Street, Singapore - 189648 ICQ : 121001541
Website : www.myangel.net
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
----- Original Message -----
From: "Paul" <[EMAIL PROTECTED]>
To: "Bill Pierson" <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>
Sent: Tuesday, June 26, 2001 2:54 AM
Subject: Re: Large File Sort
>
> --- Bill Pierson <[EMAIL PROTECTED]> wrote:
> > Greetings all. I'm new to the list, and this is my first post, please
> > excuse my ignorance if I ask a question that has already been
> > addressed.
> >
> > I need some help finding a program or script that will merge/sort a
> > 250+MB file as quickly as possible.
>
> What operating system -- *NIX helps.
> How much memory do you have?
>
> > For example - I have 2 files. File A, and File B. I need to take File
> > A and compare it against File B, and the result will be File C which
> > is File A with all the entries in File B removed, sorted
> > alphabetically. Please note that File B is over 250MB in size, and
> > file A can range from 1MB to 100MB in size.
> > I also need to take the contents of File A and File B, merge them
> > together, and remove the duplicates.
>
> If you have enough memory, you could do something simple like throw all
> records from B into a hash, then read A and print to C unless the
> record is in the hash.
>
>
>
> __________________________________________________
> Do You Yahoo!?
> Get personalized email addresses from Yahoo! Mail
> http://personal.mail.yahoo.com/
>
