The Entropy Wave capture agent zips and uploads in one operation, so there's no need to store a temporary zip file. This could be done on the server side, too. We also use zip -0, since the media files can't be further compressed anyway, so it takes (nearly) zero cpu time. This is important, as the CPU is busy encoding the next lecture.
One advantage of the zip upload is that it's an atomic operation, thus there are fewer error conditions to unwind. This is hugely advantageous on an autonomous capture agent. One disadvantage of the zip upload is that there's no way to add metadata as part of the ZIP file. Note that the proxy issues exist as well for the media file uploads. David On Mon, Jan 28, 2013 at 01:57:41PM -0600, Greg Logan wrote: > Someone brought this to me off list, and I figured I should put it up on > the main list too just in case someone else has the same question: > > > I'm doing some research on the Matterhorn capture agent and I was using > > your Capture Agent wiki page as a reference > > http://opencast.jira.com/wiki/display/MH/Capture+Agent+Communication+Protocols > > > > One of the things you mentioned is that the HTTP ingest method is the > > better method and is encouraged to be used over the zip method, but the > > reference capture agent still uses the zip upload. (Unless it was > > changed in 1.4) > > > > My question then is that statement still valid? Would you still use the > > HTTP ingest method over the zip ingest method. > > Yes, for sure. The reason we have not removed the zip-based ingest > method is because some thirdparty CAs depend on it, and because no one > has had time to remove it yet from the reference CA. > > The issue with the zip-based ingest is that the CA has to spend a bunch > of time packaging potentially 10s of GBs of data, and then (more > importantly) the core has to unpackage it! This takes a while, and has > been known to reduce some storage configurations to smoking ruin. It > also has a bad habit of taking longer than many (proxy) systems are > comfortable with, which leads to problems like > http://opencast.jira.com/browse/MH-8884. > > G > > > _______________________________________________ > Matterhorn mailing list > Matterhorn@opencastproject.org > http://lists.opencastproject.org/mailman/listinfo/matterhorn > > > To unsubscribe please email > matterhorn-unsubscr...@opencastproject.org > _______________________________________________ _______________________________________________ Matterhorn mailing list Matterhorn@opencastproject.org http://lists.opencastproject.org/mailman/listinfo/matterhorn To unsubscribe please email matterhorn-unsubscr...@opencastproject.org _______________________________________________
