Jeff wrote: > Why don't you start around 50 threads at a time to do the file > writes? Threads are effective for IO. You open the source file, > start a queue, and start sending data sets to be written to the > queue. Your source file processing can go on while the writes are > done in other threads.
I'm sorry, but you are totally wrong. Threads are a very bad idea for IO bound operation. Asynchronous event IO is the best answer for any IO bound problem. That is select, poll, epoll, kqueue or IOCP. Christian -- http://mail.python.org/mailman/listinfo/python-list
