Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread James Collins
This seems to work for us: s3cmd-1.1.0-beta3/s3cmd -H put --multipart-chunk-size-mb=100 /path/to/upload/* s3://your-bucket-name/destination-name/ James On 14 July 2012 11:08, Something Something wrote: > Is there a way to increase the size of the part files from 15M to a larger > number? Th

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread Something Something
Is there a way to increase the size of the part files from 15M to a larger number? That would probably cut down the time for transferring files. Thanks in advance for not saying.. RTFM :) On Fri, Jul 13, 2012 at 9:03 AM, Something Something < mailinglist...@gmail.com> wrote: > Thank you all. Y

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread Something Something
Thank you all. Yes, it appears to be working with 1.10-beta3. It's taking about 20 secs to transmit 15M, so it will take about 8 hours to transfer a 20G file (approximately). Any suggestions for speeding up this process? On Fri, Jul 13, 2012 at 7:44 AM, Matt Domsch wrote: > On Fri, Jul 13, 20

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread Matt Domsch
On Fri, Jul 13, 2012 at 09:22:56AM -0500, Matt Rogers wrote: > Maybe there’s a trigger for the Multi-part upload facilitiy. Files >15MB (default) are automatically sent via multipart. -- Matt Domsch Technology Strategist Dell | Office of the CTO

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread Matt Domsch
On Fri, Jul 13, 2012 at 09:39:08AM -0500, Matt Domsch wrote: > On Fri, Jul 13, 2012 at 09:22:56AM -0500, Matt Rogers wrote: > > Maybe there’s a trigger for the Multi-part upload facilitiy. > > > Files >15MB (default) are automatically sent via multipart. Ah, that was introduced around 1.1.0-beta

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread Matt Rogers
<mailto:m...@aroxo.com> Skype: mattrogers1975 From: Something Something [mailto:mailinglist...@gmail.com] Sent: 13 July 2012 07:46 To: s3tools-general@lists.sourceforge.net Subject: Re: [S3tools-general] Transferring files over 5G to AWS It's not working for me for large files :( Whe

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread Something Something
xo.com > > Skype: mattrogers1975 > > ** ** > > *From:* Something Something [mailto:mailinglist...@gmail.com] > *Sent:* 13 July 2012 07:46 > *To:* s3tools-general@lists.sourceforge.net > *Subject:* Re: [S3tools-general] Transferring files over 5G to AWS > > ** **

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-13 Thread Matt Rogers
g Something [mailto:mailinglist...@gmail.com] Sent: 13 July 2012 07:46 To: s3tools-general@lists.sourceforge.net Subject: Re: [S3tools-general] Transferring files over 5G to AWS It's not working for me for large files :( When I try with a small file it works, but when I try with a file ove

Re: [S3tools-general] Transferring files over 5G to AWS

2012-07-12 Thread Something Something
It's not working for me for large files :( When I try with a small file it works, but when I try with a file over 5G, I get this: --- WARNING: Waiting 15 sec... ./myfileBig.txt ->