Hello, > > uniq is not working for the unicode text. > > We are collecting tamil words to build a tamil spellchecker using hunspell. > We need to remove duplicate words from the collection. > > The uniq is not working. > > Is there any other way to find duplicate words from unicode file? >
Why not do it in Libreoffice Calc ( http://milospjanic.blogspot.com/2011/10/how-to-remove-duplicates-in-libreoffice.html ). -- Regards, Arun Prakash _______________________________________________ ILUGC Mailing List: http://www.ae.iitm.ac.in/mailman/listinfo/ilugc ILUGC Mailing List Guidelines: http://ilugc.in/mailinglist-guidelines