For those who are not aware of 6-year old history :-), Sameer, Owen and I
made a trip to Wisconsin, Madison to meet with Miron Livny, who built
Condor, exploring how matchmaking could be used with MapReduce
(pre-hadoop) in October 2005. (We believed it could be used for
locality-aware scheduling.)
On Sep 13, 2011, at 7:20 AM, Steve Loughran wrote:
>
> I missed a talk at the local university by a Platform sales rep last month,
> though I did get to offend one of the authors of condor team instead [1]. by
> pointing out that all grid schedulers contain a major assumption: that
> storage
As an aside, if you ask for the white paper you get a PDF that
over-exaggerates the limits of Hadoop.
http://info.platform.com/rs/platform/images/Whitepaper_Top5ChallengesforHadoopMapReduceintheEnterprise.pdf
Mostly focusing on a critique of the scheduler -which MR-279 will fix in
Hadoop 0.2
On 12/09/11 19:04, Chi Chan wrote:
Are any Hadoop implementations planning to add "enterprise features"
in Platform MapReduce?
http://www.youtube.com/watch?v=QV4wJifsqbQ
http://www.youtube.com/watch?v=cDfZTx-BOyY
http://www.youtube.com/watch?v=MEKXo-1hnkQ
Platform said that its MapReduce implem
See mapr.com
We have added many enterprise features onto Hadoop including snapshots,
mirroring, NFS access,
high availability and higher performance.
Since this mailing list is primarily for Apache Hadoop, you should contact
me off-line if you would like more information.
On Mon, Sep 12, 2011 at
Chi,
Most of these features are things that Hadoop is working on. There is an HA
branch in progress that should go into trunk relatively soon.
As far as the batch system integration is concerned if what you care about is
scheduling of jobs, which jobs run when and on which machines, you can wr
Are any Hadoop implementations planning to add "enterprise features"
in Platform MapReduce?
http://www.youtube.com/watch?v=QV4wJifsqbQ
http://www.youtube.com/watch?v=cDfZTx-BOyY
http://www.youtube.com/watch?v=MEKXo-1hnkQ
Platform said that its MapReduce implementation totally replaces the
JobTrac
