One limitation you should be conscious of when doing this kind of work with GAE is that any single GAE request or response cannot exceed 32MB in size. This won't be a problem if you are pushing files through GCS, but could become one if you plan to process them in GAE itself. There is no streaming in GAE-land.
We recently had to break the PDF generator out of our app and move that component into Heroku because of this limit. It was painful :( Jeff On Sun, Aug 18, 2013 at 10:38 PM, Vinny P <[email protected]> wrote: > On Sun, Aug 18, 2013 at 1:05 PM, Kaan Soral <[email protected]> wrote: > >> This issue has been on my mind, let's say a user uploads an 2gb .mov >> file, and let's say one decides to use a service like zencoder >> The upload to external service and the download from external service >> both sound challenging >> > > > For Zencoder specifically, you don't need to worry about uploading and > downloading from that service. Zencoder starts by downloading the file you > specify ( https://app.zencoder.com/docs/api/jobs/create ), so you can > specify a url from Cloud Storage, the Blobstore, or a custom URL handler > (i.e. to a servlet, script, etc). > > Zencoder will then upload the completed processed file to a cloud service > you specify ( > https://app.zencoder.com/docs/api/encoding/general-output-settings/url notice > that GCS is a supported service in the list). > > > On Sun, Aug 18, 2013 at 1:05 PM, Kaan Soral <[email protected]> wrote: > >> Generally it's easy to upload a file to AppEngine, and download a file >> from AppEngine, thanks to Blobstore upload/download handlers, however as >> far as I know, there aren't any helpers that will do the reverse, upload >> file from AppEngine, and download file to AppEngine from an URL >> >> > > If you want to discuss upload/download in general (not using Zencoder), > then you have a few options. For downloading specifically, there is a > "Range" HTTP header you can provide. Basically you can download a single > file in multiple separate HTTP requests, and in each request declare a > separate byte range to download (for a quick primer, see > http://benramsey.com/blog/2008/05/206-partial-content-and-range-requests/ > ). > > For uploading, you can upload a file in chunks to most HTTP-compliant > services (Apache, nginx, and most other popular servers have built-in > support for this). > > As a side note, this question is better handled on a case-by-case, > service-dependent issue. There are several different ways to solve this > problem, I'm only enumerating one option as an example. > > > > ----------------- > -Vinny P > Technology & Media Advisor > Chicago, IL > > App Engine Code Samples: http://www.learntogoogleit.com > > > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/google-appengine. > For more options, visit https://groups.google.com/groups/opt_out. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
