Just use a split command to split the file before upload.
Matt Rogers
Location: UK
UK Cell/SMS: +447958002382
Indian Cell/SMS: +919884690539
Email: m...@aroxo.com <mailto:m...@aroxo.com>
Skype: mattrogers1975
From: Ryan Golhar [mailto:ngsbioinformat...@gmail.com]
Sent: 08 October 2012 16:08
To: s3tools-general@lists.sourceforge.net
Subject: [S3tools-general] multipart upload files with beta 1.1.0-3
Hi all - I have a file that is in excess of 400G. Its actually a
compressed directory of files. When I try to upload it with s3tools
sync, I get the error:
somefile.tar.gz -> s3://data/somefile.tar.gz [part 10001 of 24481,
15MB]
15728640 of 15728640 100% in 1s 14.93 MB/s done
ERROR: Upload of 'somefile.tar.gz' part 10001 failed. Aborting multipart
upload.
ERROR: S3 error: 400 (InvalidArgument): Part number must be an integer
between 1 and 10000, inclusive
It looks like the # of parts has to be less then 10,000. Why is this?
------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
