Hello,

>
> uniq is not working for the unicode text.
>
> We are collecting tamil words to build a tamil spellchecker using hunspell.
> We need to remove duplicate words from the collection.
>
> The uniq is not working.
>
> Is there any other way to find duplicate words from unicode file?
>

Why not do it in Libreoffice Calc (
http://milospjanic.blogspot.com/2011/10/how-to-remove-duplicates-in-libreoffice.html
).

-- 
Regards,
Arun Prakash
_______________________________________________
ILUGC Mailing List:
http://www.ae.iitm.ac.in/mailman/listinfo/ilugc
ILUGC Mailing List Guidelines:
http://ilugc.in/mailinglist-guidelines

Reply via email to