[EMAIL PROTECTED] wrote: > > i have a friend who has a access database that needs some work done on it. > one thin in particular is that it needs to have all duplicate entries > removed. i had him export the database into a comma deliniated file. the > list has 50,000+ entries. now what i need to do is find a script or tool > that will search the text file for duplicate (or sometimes multiple) > entries and remove all but one of those entries. > > i've searched freshmeat all day and google as well. i'm not finding > anything. another friend said it could be done in perl or php but i know > neither of them. > > does anyone know of a tool that could do this? the text file must remain > in it's current state so it can be imported back into the database. > > thanks for any and all help!
How about piping the file through sort and uniq? Cheers, -- Javier Gostling Ingeniero de Sistemas Virtualia S.A. [EMAIL PROTECTED] Fono: +56 (2) 202-6264 x 130 Fax: +56 (2) 342-8763 Av. Kennedy 5757, of 1502 Las Condes Santiago Chile _______________________________________________ Redhat-list mailing list [EMAIL PROTECTED] https://listman.redhat.com/mailman/listinfo/redhat-list
