+1 (non-binding)
Paul
On Jun 17, 2011, at 10:15 AM, "Tom White" wrote:
> As there are no active discussions on the proposal thread, I would
> like to initiate a vote to accept Bigtop as an Apache Incubator
> project.
>
> The proposal is available at
>
> http://wiki.apache.org/incubator/BigtopProposal?action=recall&rev=13
>
> I've also put a copy of the proposal at the end of this email.
>
> The discussion thread is available at
>
> http://mail-archives.apache.org/mod_mbox/incubator-general/201106.mbox/%3cbanlktimriyvs5g5maklqvinauz9h6s5...@mail.gmail.com%3E
>
> Please cast your votes:
>
> [ ] +1 Accept Bigtop for incubation
> [ ] +0 Indifferent to Bigtop incubation
> [ ] -1 Reject Bigtop for incubation
>
> This vote will close 72 hours from now.
>
> Thanks,
> Tom
>
> = Bigtop - Apache Hadoop Ecosystem Packaging and Test =
>
> == Abstract ==
>
> Bigtop - a project for the development of packaging and tests of the
> Hadoop ecosystem.
>
> == Proposal ==
>
> The primary goal of Bigtop is to build a community around the
> packaging and interoperability testing of Hadoop-related projects.
> This includes testing at various levels (packaging, platform, runtime,
> upgrade, etc...) developed by a community with a focus on the system
> as a whole, rather than individual projects.
>
> Build, packaging and integration test code that depends upon official
> releases of the Apache Hadoop-related projects (HDFS, MapReduce,
> HBase, Hive, Pig, ZooKeeper, etc...) will be developed and released by
> this project. As bugs and other issues are found we expect these to be
> fixed upstream.
>
> == Background ==
>
> The initial packaging and test code for Bigtop was developed by
> Cloudera to package projects from the Apache Hadoop ecosystem and
> provide a consistent, inter-operable framework.
>
> == Rationale ==
>
> Hadoop defines itself as:
>
> {{{
> The Apache Hadoop project develops open-source software for reliable,
> scalable, distributed computing. Hadoop includes these subprojects:
>
> * Hadoop Common: The common utilities that support the other Hadoop
> subprojects.
> * HDFS: A distributed file system that provides high throughput access
> to application data.
> * MapReduce: A software framework for distributed processing of large
> data sets on compute clusters.
> }}}
>
> There are also several other Hadoop-related projects at Apache. Some
> TLP examples include HBase, Hive, Mahout, ZooKeeper, and Pig. There
> are also several new projects in the Incubator such as HCatalog, Hama
> and Sqoop.
>
> From a packaging and deployment perspective, the current
> loosely-coupled nature of the project has limitations:
> 1. Insufficient building against trunk versions of dependent projects
> (in the style of Apache Gump).
> 1. Insufficient testing against the trunk versions of dependent projects.
> 1. No consistent packaging for the Linux servers which provide the
> main Hadoop datacenter platform.
> 1. No functional testing against multi-machine clusters as part of
> the regular automated build process. This is due to a lack of a
> physical or virtual Hadoop cluster for testing, and not enough test
> suites designed to run against a live cluster with known datasets.
>
> The intent of this project is to build a community where the projects
> are brought together, packaged, and tested for interoperability.
>
> Projects such as Apache Whirr (incubating), which deploy and use a
> collection of Hadoop-related projects, would benefit from the
> interoperability testing done by Bigtop, rather than picking and
> testing project combinations themselves.
>
> == Initial Goals ==
>
> Much of the code for Bigtop has been released by Cloudera under the
> Apache 2.0 license for over two years.
>
> Some current goals include:
> * create a set of packages for the Hadoop ecosystem, over a wide
> range of platforms
> * interoperability test these projects
> * document project sets that are known to work well together
>
> Bigtop’s release artifact would consist of a single tarball of
> packaging and test code that, when built, would produce source and
> binary Linux packages for the upstream projects.
>
> = Current Status =
>
> == Meritocracy ==
>
> Bigtop was originally developed and released as an open source
> packaging infrastructure, CDH, by Cloudera.
>
> == Community ==
>
> The community is primarily the original developers at Cloudera,
> however a number of contributions to the packaging specifications have
> been accepted from outside contributors. Growing a diverse community
> is the main reason to bring Bigtop to the Apache Incubator.
>
> == Core Developers ==
>
> The core developers for Bigtop project are:
> * Andrew Bayer has extensive expertise with build tools, specifically
> Jenkins continuous integration and Maven.
> * Peter Linnell has contributed to the RPM packaging.
> * Bruno Mahé has overseen much of the development of the RPM and
> Debian packaging system.
> * Roman Shaposhnik and