Hi, Another approach is to convert the data as Pandas dataframe and use some vector operations. A sample code is attached.
Regards, Vignesh On Thu, Jun 24, 2021 at 2:23 PM Saravanan Muthuramalingam < saravana4...@gmail.com> wrote: > Hi Abirami, > Please find the attached sample to use yield , when you call yield > with next keyword, it will iterate and send you next batch of lines , so > that your memory will be cleaned and the execution can be fast, try > tweaking this to meet your requirement, thanks > > Sara > > On Thu, Jun 24, 2021 at 12:12 PM Abirami Moorthy <mabirami8...@gmail.com> > wrote: > >> >> >> On Thu, 24 Jun 2021 at 09:41, Thirunarayanan Srinivasan < >> tstnara...@gmail.com> wrote: >> >>> On Thu, 24 Jun 2021 at 6:22 AM Saravanan Muthuramalingam < >>> saravana4...@gmail.com> wrote: >>> >>>> >>>> Hello, >>>> >>>> >>> Here 25 lakhs tamil words collected link in below >> >> https://github.com/KaniyamFoundation/all_tamil_words. >> >> i have done a simple program using above the text file >>>>> >>>> >> >>> https://github.com/KaniyamFoundation/all_tamil_words >>>>> it takes 4 min to execute the program. >>>>> >>>> >> thankyou for your all kind replies, i'll keep trying what you >> said. >> >> >> >>> Regards, >>>>> M.Abirami >>>>> >>>>> _______________________________________________ >> Chennaipy mailing list >> Chennaipy@python.org >> https://mail.python.org/mailman/listinfo/chennaipy >> > _______________________________________________ > Chennaipy mailing list > Chennaipy@python.org > https://mail.python.org/mailman/listinfo/chennaipy >
tamil_words.ipynb
Description: application/ipynb
_______________________________________________ Chennaipy mailing list Chennaipy@python.org https://mail.python.org/mailman/listinfo/chennaipy
