Thanks everyone,
Uploading directly to S3 sounds the avenue to pursue. It removes a whole
load of complications!
Cheers
Hansel
On Tue, Apr 11, 2017 at 12:18 PM, Roger Gammans wrote:
> Indeed.
>
> Both the rsync and bittorrent protocols split files into chunks. There are
> a lot of similaritie
Indeed.
Both the rsync and bittorrent protocols split files into chunks. There
are a lot of similarities bwtween these protocols.
Also it might be worth looking at are de-duping backup tools like
duplicity.
On Tue, 2017-04-11 at 11:33 +0100, Javier Llopis wrote:
> I haven't done anything similar
I haven't done anything similar, but this upload in chunks then reassemble
idea bears some similarity to peer to peer file sharing software. I would
look there for ideas in case I got stuck with some problem.
J
From: "Hansel Dunlop"
Sent: 11 A
Hi Hansel,
Here's the documentation for browser-based POSTing using S3:
http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingHTTPPOST.html
If you want to implement chunking the file and stitching together yourself,
here's quite a nice JavaScript library to help with some of the heavy
lifting on th
> On 11 Apr 2017, at 11:21, Hansel Dunlop wrote:
>
> Hello all
>
> I'm working on an application that has to accept large uploads. Think ~ 2GB+
> size files getting uploaded over slowish connections. These files are
> eventually going to end up in S3.
>
> Uploading smallish files is not a pr
