+1 (non-binding) On Tue, Nov 6, 2012 at 11:08 AM, Franklin, Matthew B. <mfrank...@mitre.org> wrote: > +1 (binding) > > On 11/6/12 10:57 AM, "Adam Berry" <ambe...@yahoo-inc.com> wrote: > >>Hello, >> >>This proposal has been open for discussion for a a few weeks, so now >>submitting for a vote for this project to be accepted into the incubator. >> >>Cheers, >>Adam Berry >> >>= HDT (Hadoop Development Tools) = >> >>== Abstract == >>Tools to support developing applications that use Apache Hadoop from >>within Eclipse. >> >>== Proposal == >>Hadoop Development Tools are a set of extensions to Eclipse providing >>support for creating, launching and debugging distributed applications, >>as well as interacting with HDFS filesystems. This work will build on the >>existing Map Reduce Tools present in the Apache Hadoop project. >> >>== Background == >>Map Reduce Tools have existed as part of contrib for Apache Hadoop. >>Unfortunately they are source tied to a single version of Hadoop, and >>development has stalled, with little movement past the Hadoop 0.20 line. >> >>== Rationale == >>Support for newer versions of Hadoop from within Eclipse is regularly >>raised on the Hadoop mailing lists, so there is a clear need to drive >>these tools forward. Development tools generally are worked on separate >>from the target tools/platform, separating the tools out will allow for >>supporting multiple versions, so a developer could work with a >>heterogeneous environment. >> >>== Initial Goals == >> * Give the tools project a home of its own. >> * Port current MapReduce tools feature set to all current release lines >>of Hadoop in a single Eclipse install. >> * Documentation and tutorials for all features. >> * Publish Eclipse update site, and join Eclipse marketplace listing. >> * Establish release cycle that combines support for Hadoop and Eclipse >>release cycles. >> * Look to build support for YARN, MRUnit and possibly other >>Hadoop-related projects. >> >>== Current Status == >>The source for the current MapReduceTools lives in the contrib section of >>the Hadoop source. In its current implementation it is tied to the >>version of Hadoop against which it is compiled. The layout and API that >>it was developed with means that it can only be used with the 0.20 or 1.0 >>Hadoop releases, the new layout and YARN api introduced with the 0.23 and >>2.0 lines are not supported. >> >> >>=== Meritocracy === >>Several people and companies have already expressed an interest in >>contributing to this project, and we hope to attract additional interest >>during the proposal discussion. We plan to invest and support a >>meritocracy that attracts, invites, and supports newcomers to build a >>vibrant and diverse community. >> >>=== Community === >>The target community is developers who are working developing Map/Reduce >>applications against Hadoop. Given the success of Hadoop the target group >>is likely to be quite large. Separation from the Hadoop community would >>make it easier to support multiple versions of hadoop, as well as merging >>the release cycles of Hadoop and Eclipse to provide predictable iteration >>and improvement in the toolset. >> >>=== Core Developers === >>The initial list of developers includes people experienced with Hadoop >>and developing against the Eclipse platform. >> * Adam Berry (amberry at yahoo-inc dot com) >> * Jeffrey Zemerick (jeffrrey at mtnfog dot com) >> * Evert Lammerts (Evert dot Lammerts at sara dot nl) >> * Simone Gianni (simoneg at apache dot org) >> >>=== Alignment === >>Hadoop Development Tools aligns with both Hadoop and Eclipse. Hadoop as >>the platform for the development target, and Eclipse as the IDE platform >>used as the base for the tools. >> >>== Known Risks == >> >>=== Orphaned Products === >> >>=== Inexperience with Open Source === >>The committers have experience with Apache and Eclipse open source >>development. >> >>=== Reliance on Salaried Developers === >>Hadoop Development Tools will be developed with a mix of salaried and >>volunteer time. >> >>=== Relationships with Other Apache Projects === >>Hadoop Development Tools is closely related to Apache Hadoop. >> >>=== An Excessive Fascination with the Apache Brand === >>Given the success of Hadoop and associated projects, Apache is the >>natural place for the Hadoop Development Tools. Chris Mattman suggested >>the Apache Incubator as appropriate on the Hadoop general mailing list >>following the success that MRUnit had taking the path from Hadoop contrib >>to an Apache top level project. >> >>== Documentation == >>Documentation for the current tools can be found at >>http://wiki.apache.org/hadoop/EclipsePlugIn >> >>== Initial Source == >>http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce-proje >>ct/src/contrib/eclipse-plugin/ >> >>== Source and Intellectual Property Submission Plan == >>The source, and any suggested initial patches, are already hosted either >>in Apache¹s Subversion or JIRA. >> >>== External Dependencies == >>Eclipse Platform >>Eclipse Java Development Tools >> >>== Cryptography == >>Hadoop Development Tools likely does not fall into this area. >> >>== Required Resources == >>=== Mailing lists === >> * hdt-dev >> * hdt-commits >> * hdt-user >> >>=== Git Repository === >> * git://git.apache.org/incubator-hdt.git >> >>=== Issue Tracking === >> * JIRA Hadoop Development Tools (HDT) >> >>=== Other Resources === >> * Jenkins/Hudson for builds and test running. >> >>== Initial Committers == >> * Adam Berry (amberry at yahoo-inc dot com) >> * Jeffrey Zemerick (jeffrrey at mtnfog dot com) >> * Evert Lammerts (Evert dot Lammerts at sara dot nl) >> * Simone Gianni (simoneg at apache dot org) >> >>== Affiliations == >> * Adam Berry - Yahoo! >> * Jeffrey Zemerick - Mountain Fog >> * Evert Lammerts - SARA >> * Simone Gianni - n/a >> >>== Sponsors == >>=== Champion === >> * Roman Shaposhnik >> >>=== Nominated Mentors === >> * Chris Douglas >> * Chris Mattman >> * Roman Shaposhnik >> >>=== Sponsoring Entity === >>Incubator PMC >> >> >>--------------------------------------------------------------------- >>To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >>For additional commands, e-mail: general-h...@incubator.apache.org >> > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org >
-- Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/ --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
