On Fri, May 27, 2011 at 5:56 AM, Ramprasad Prasad <ramprasad...@gmail.com>wrote:

> I have a requirement of generating  large number (> 100 thousand ) files
> ....
>

rather suspect that the limiting factor is going to be I/O.

Even with massive assistance from the Operating System, writing to a disk
will take a long time, measured in milliseconds.  If you are not doing much
processing other than string-replacement, your process-time will be
relatively short, probably a few microseconds per file.

You may get better throughput by running multiple processes.  Batch up your
input files and run several instances of your code, one per batch.  If you
can't use divide-and-conquer, you might look at fork() and try running
multiple child-processes under the covers.

>
>
>
>
>
> --
> Thanks
> Ram
>  <http://www.netcore.co.in/>
>
>
>
>
> n <http://pragatee.com>
>



-- 

Bob Goolsby
bob.gool...@gmail.com

Reply via email to