On Tuesday, February 4, 2014 6:23:19 PM UTC+5:30, Asaf Las wrote: > On Tuesday, February 4, 2014 2:43:21 PM UTC+2, Ayushi Dalmia wrote: > > > > > > As I said, I need to merge large files and I cannot afford more I/O > > > operations. So in order to minimise the I/O operation I am writing in > > > chunks. Also, I need to use the merged files as indexes later which > > > should be loaded in the memory for fast access. Hence the concern. > > > Can you please elaborate on the point of taking lines into consideration? > > > > have you tried os.sendfile()? > > > > http://docs.python.org/dev/library/os.html#os.sendfile
os.sendfile will not serve my purpose. I not only need to merge files, but do it in a sorted way. Thus some postprocessing is needed. -- https://mail.python.org/mailman/listinfo/python-list
