On Tue, Jun 19, 2012 at 08:20:02PM -0500, Domsch, Matt wrote:
> One fundamental question I have though is, how far back is "old"
> python support needed, and how critical is maintaining functionality
> on Windows?  One patch series, which parallelizes uploads to multiple
> destinations, uses os.fork() and os.wait(), which aren't available on
> Windows.  One _could_ rewrite the code to use the multiprocessing
> module, but that's not available until python 2.6.  Or I suppose it
> could be written to use threading (though the GIL could be
> problematic).  For my use case, in Fedora, I don't care about Windows
> support at present, but as the patch is written now, it always uses
> os.fork() to do the upload half of local->remote, so it
> would break on Windows.

I figured out how to conditionalize based on presence of os.fork(),
and either use a parent/child model, or a single process model, as
available.  I've committed that patch to my parallel-destinations [1]
branch now.

[1] https://github.com/mdomsch/s3cmd/tree/parallel-destinations

Thanks,
Matt

-- 
Matt Domsch
Technology Strategist
Dell | Office of the CTO

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general

Reply via email to