Re: multicpu bzip2 using os.system or queue using python script

2010-07-27 Thread harijay
Thanks a tonne..That code works perfectly and also shows me how to think of using queue and threads in my python programs Hari On Jul 27, 1:26 pm, MRAB wrote: > harijay wrote: > > I want to quickly bzip2 compress several hundred gigabytes of data > > using my 8 core , 16 GB ram workstation. > >

Re: multicpu bzip2 using os.system or queue using python script

2010-07-27 Thread MRAB
harijay wrote: I want to quickly bzip2 compress several hundred gigabytes of data using my 8 core , 16 GB ram workstation. Currently I am using a simple python script to compress a whole directory tree using bzip2 and a system call coupled to an os.walk call. I see that the bzip2 only uses a sin