All,
Please find the draft board report which includes all podlings that
have submitted reports thus far below.
John
= Incubator PMC report for June 2014 =
=== Timeline ===
||Wed June 04 ||Podling reports due by end of day ||
||Sun June 08 ||Shepherd reviews due by end of day ||
||Sun June 08 ||Summary due by end of day ||
||Tue June 10 ||Mentor signoff due by end of day ||
||Wed June 11 ||Report submitted to Board ||
||Wed June 18 ||Board meeting ||
=== Shepherd Assignments ===
||Alan D. Cabrera ||Brooklyn ||
||Andrei Savu ||Slider ||
||Andrei Savu ||Streams ||
||Dave Fisher ||S4 ||
||John Ament ||Storm ||
||Justin Mclean ||Kalumet ||
||Matthew Franklin ||Falcon ||
||Konstantin Boudnik ||Flink ||
||Matthew Franklin ||MRQL ||
||Raphael Bircher ||Wave ||
||Konstantin Boudnik ||Drill ||
||Ross Gardler ||DeviceMap ||
||Suresh Marru ||Sentry ||
||Suresh Marru ||log4cxx2 ||
=== Report content ===
{{{
Incubator PMC report for June 2014
The Apache Incubator is the entry path into the ASF for projects and codebases
wishing to become part of the Foundation's efforts.
< narrative >
* Community
New IPMC members:
People who left the IPMC:
* New Podlings
* Graduations
The board has motions for the following:
* Releases
The following releases were made since the last Incubator report:
* IP Clearance
* Legal / Trademarks
* Infrastructure
* Miscellaneous
-------------------- Summary of podling reports --------------------
* Still getting started at the Incubator
* Not yet ready to graduate
No release:
Community growth:
* Ready to graduate
The Board has motions for the following:
* Did not report, expected next month
----------------------------------------------------------------------
Table of Contents
Brooklyn
DeviceMap
Drill
Falcon
Flink (formerly Stratosphere)
Kalumet
log4cxx2
MRQL
Parquet
S4
Sentry
Slider
Storm
Streams
Wave
----------------------------------------------------------------------
--------------------
Brooklyn
Brooklyn is a framework for modeling, monitoring, and managing applications
through autonomic blueprints.
Brooklyn has been incubating since 2014-05-01.
No report submitted this month by Brooklyn.
--------------------
DeviceMap
Apache DeviceMap is a data repository containing device information, images
and other relevant information for all sorts of mobile devices, e.g.
smartphones and tablets. While the focus is initially on that data, APIs will
also be created to use and manage it.
DeviceMap has been incubating since 2012-01-03.
No report submitted this month.
--------------------
Drill
Description:
Apache Drill is a distributed system for interactive analysis of large-scale
datasets that is based on Google's Dremel. Its goal is to efficiently
process nested data, scale to 10,000 servers or more and to be able to
process petabyes of data and trillions of records in seconds.
Drill has been incubating since 2012-08-11.
Three Issues to Address in Move to Graduation:
Complete the 1.0 feature set (team targets next release and graduation
in the month of July)
Continue to attract new developers/contributors with a variety of
skills and viewpoints
Continue the outreach activities to build the early user community for
the technology
Issues to Call to Attention of PMC or ASF Board:
None
How community has developed since last report:
Community awareness and outreach were strengthened in multiple forums as below
First Apache Drill Hackathon was organized on 4/24. Over 40
participants including members from Visa, Linkedin, Cisco, Hortonworks
worked to harden/enhance Drill project. Several new features have been
added to Drill product Array reference functions, enhanced Optiq
support, Kafka storage plugin, robust testing framework etc
Hive big data think tank meet up on 5/14- Talk by MC Srivas, with ~200
member participation
Open Source Cloud meet up on 4/23 - Talk by Keys Botzum
Apache Conference session on 4/8 - Talk by Neeraja Rentachintala, with
~100 members participation
Apache Drill is also showcased at the Hadoop Summit 6/3-6/5
Mailing list discussions:
Activity summary for the user mailing list:
http://mail-archives.apache.org/mod_mbox/incubator-drill-user/
June to date 6/10: 28
May 2014, 82
March 2013, 15
Activity summary for the dev mailing list:
http://mail-archives.apache.org/mod_mbox/incubator-drill-dev/
June to date 6/10: 87 (jira focussed discussions were removed from
this thread recently)
May 2014, 1183(jira, focused discussions)
April 2014, 772 (jira; focused discussions)
For details of code commits, see
https://github.com/apache/incubator-drill/graphs/commit-activity (
about 300 commits in the past 3 months)
26 contributors have participated in GitHUB code activity; there have been
142 forks.
Community Interactions
Weekly Drill hangout continues, conducted remotely through Google hangouts
Tuesday mornings 10am Pacific Time to keep core developers in contact in
realtime despite geographical separation.
Community stays in touch through @ApacheDrill Twitter ID, and by postings
on various blogs including Apache Drill User http://drill-user.org/ which
has had several updates and through international presentations at
conferences.
Articles
Examples of articles or reports on Apache Drill since last report include:
Drill Hackathon summary blog post by Jacques Nadeau
Drill milestone roadmap blog post by Neeraja Rentachintala
Drill code samples by Nitin Bandugula
Social Networking
@ApacheDrill Twitter entity is active and has grown substantially by 19%,
to 887 followers.
How project has developed since last report
Significant progress is being made on the performance and distributed
optimization
C++ client API and ODBC driver leveraging the C++ API was built for
Drill by a group led by George Chow in Vancouver. The initial drops
for the driver are available
New functionality has been added to the product namely distributed
optimization, join order optimization, Table/view creation, repeated
map support, HBase support, expanded SQL support, Text readers, new
data types and functions, Session options for query tuning and lot
more
Nearly ~500 bugs files and ~400 bugs resolved
Significant progress on running ANSI standard queries such as TPC-H
Significant code drops have been checked in from a number of
contributors and committers
New docs have been published on Drill wiki (Apache Drill in 10 mins,
Working with various data sources and Installing and Running Apache
Drill on a cluster)
Work toward a Beta milestone is progressing substantially.
Signed-off-by:
[x](drill) Ted Dunning
[ ](drill) Grant Ingersoll
[ ](drill) Isabel Drost-Fromm
[x](drill) Sebastian Schelter
Shepherd/Mentor notes:
Project's dev@ list is very active both with the JIRA traffic and otherwise.
June report to the board hasn't been sent on time.
--------------------
Falcon
Falcon is a data processing and management solution for Hadoop designed for
data motion, coordination of data pipelines, lifecycle management, and data
discovery. Falcon enables end consumers to quickly onboard their data and
its associated processing and management tasks on Hadoop clusters.
Falcon has been incubating since 2013-03-27.
Three most important issues to address in the move towards graduation:
1. Continue to build a broader community
2. Add more committers to the project
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
* No
How has the community developed since the last report?
* More users & contributors have joined the falcon project and the
community continues to grow rapidly
* We have had 2 Birds of Feather for Falcon at Hadoop Summit,
Europe and USA. There were quite a few registered users
How has the project developed since the last report?
* 0.5-incubating release candidate is available for vote
* Project now has diverse user & contributor base
* It appears to be time for the community to start thinking about graduation
Date of last release:
* 2014-02-03 (0.4-incubating)
When were the last committers or PMC members elected?
* Two new committers have joined the project on 2014-03-07
Signed-off-by:
[X](falcon) Alan Gates
[X](falcon) Chris Douglas
[ ](falcon) Devaraj Das
[ ](falcon) Owen O'Malley
--------------------
Flink
Flink is an open source system for expressive, declarative, fast, and
efficient data analysis. Flink combines the scalability and programming
flexibility of distributed MapReduce-like platforms with the efficiency, out-
of-core execution, and query optimization capabilities found in parallel
databases.
Flink has been incubating since 2014-04-14.
Three most important issues to address in the move towards graduation:
1. Infrastructure setup (git, JIRA, mailing list renaming)
2. Release
3. Build an ASF community
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None.
How has the community developed since the last report?
The community still "lives" outside the ASF since the infrastructure
is not ready.
Two new contributors opened pull requests since the last report.
How has the project developed since the last report?
The community has voted for a new name, so the project is moving
away from its old name
"Stratosphere" to the new one: "Flink".
We are still waiting for Infra to rename the mailing list, to create
a JIRA (blocked by the mailing list)
and create a Git repository (blocked by the SGA (which we already provided) ).
We released a new major release (0.5) outside the ASF.
Date of last release:
2014-05-31 (no incubator release yet)
When were the last committers or PMC members elected?
Only initial committers.
Signed-off-by:
[ ](flink) Sean Owen
[X](flink) Ted Dunning
[ ](flink) Owen O'Malley
[X](flink) Henry Saputra
[ ](flink) Ashutosh Chauhan
[X](flink) Alan Gates
Shepherd/Mentor notes:
Project dev@ list has healthy traffic.
Some of the mentors are active on the list and helping community. No
visible issues.
--------------------
Kalumet
Kalumet a complete environment manager and deployer including J2EE
environments (application servers, applications, etc), softwares, and
resources.
Kalumet has been incubating since 2011-09-20.
No report submitted this month.
--------------------
log4cxx2
Logging for C++
log4cxx2 has been incubating since 2013-12-09.
Three most important issues to address in the move towards graduation:
1. We probably need to decide what's an acceptable platform/compiler
list, sort out any
remaining hiccups, and then move towards a release.
2. We need to release 0.11.0 as maintenance release.
3. We need to make a broader use of the ASF infrastructure
(notably the CI, as well as improved management of the Jira
site - notably with triaging), and establish a roadmap for
the next releases.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
N/A
How has the community developed since the last report?
No changes in team.
How has the project developed since the last report?
We are actively supporting the project. Mails suggest that there's work going
on in the background by some committers especially regarding the
build process,
but there hasn't been any notable commit in the last weeks. The current trunk
now fixes most of the important outstanding bugs.
Date of last release:
2008-04-03 was the official, pre-incubation 0.10.0
Many post-0.10.0 commits exist on trunk which we intend to get out as 0.11.x.
When were the last committers or PMC members elected?
N/A
Signed-off-by:
[X](log4cxx2) Christian Grobmeier
[ ](log4cxx2) Scott Deboy
--------------------
MRQL
MRQL is a query processing and optimization system for large-scale,
distributed data analysis, built on top of Apache Hadoop, Hama, and Spark.
MRQL has been incubating since 2013-03-13.
Three most important issues to address in the move towards graduation:
1. increase adoption, expand user community, and increase user list activity
2. have at least one more incubator release
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
none
How has the community developed since the last report?
A new PMC member was elected, Moon Soo Lee. The company DataSayer and
the project Zeppelin (zeppelin-project.org) are now using MRQL.
How has the project developed since the last report?
We have switched to Junit for query testing, instead of evaluating
queries from files using plain Java code. New tests were introduced
and some bugs were corrected based on these tests.
Date of last release:
2013-10-31
When were the last committers or PMC members elected?
2014-04-17
Signed-off-by:
[X](mrql) Alan Cabrera
[ ](mrql) Anthony Elder
[ ](mrql) Alex Karasulu
[ ](mrql) Mohammad Nour El-Din
--------------------
Parquet
Parquet is a columnar storage format for Hadoop.
Parquet has been incubating since 2014-05-20 .
Three most important issues
- Finish bootstrapping project, IP clearance, initial website
- Expanding the community and adding new committers
- 1st release
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
- None at this time
How has the community developed since the last report?
- All initial committers have submitted ICLAs and the accounts have been
created. The mailing lists have been setup and we are starting to use
them for communication.
How has the project developed since the last report?
- We have setup the incubator status page and are waiting on the final
SGA to be sent in to start the code import (INFRA-7782)
Date of last release
- No releases as of yet. Working through initial IP clearance.
When were the last committers or PMC members elected?
- N/A, still bootstrapping the project.
Signed-off-by:
[ ](parquet) Todd Lipcon
[X](parquet) Jake Farrell
[ ](parquet) Chris Mattmann
[X](parquet) Roman Shaposhnik
[X](parquet) Tom White
--------------------
S4
S4 (Simple Scalable Streaming System) is a general-purpose, distributed,
scalable, partially fault-tolerant, pluggable platform that allows programmers
to easily develop applications for processing continuous, unbounded streams of
data.
S4 has been incubating since 2011-09-26.
No report submitted this month.
--------------------
Sentry
Sentry is a highly modular system for providing fine grained role
based authorization to both data and metadata stored on an Apache
Hadoop cluster.
Sentry has been incubating since 2013-08-08.
Three most important issues to address in the move towards graduation:
1. Grow the Sentry community
2. Add new committers that diversify the project
3. Continue to release at regular intervals
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of?
None
How has the community developed since the last report?
The community is growing. A number of new members have started
actively contributing to the project.
How has the project developed since the last report?
The project did its 2nd release from incubation. Thanks to lot of
hard work from the release manage Karthik Ramchandran and other
community members, version 1.3 was released earlier this month. The db
backed policy store feature branch is merged into master. The
community is working towards improving that functionality and
stabilization.
Date of last release:
2014-05-15
When were the last committers or PMC members elected?
Vamsee Yarlagadda has been added as a committer as announced on Feb
28, 2014. No new PPMC members have been added since the project has
entered the incubator.
Signed-off-by:
[X](sentry) Arvind Prabhakar
[X](sentry) Joe Brockmeier
[ ](sentry) David Nalley
[ ](sentry) Olivier Lamy
[ ](sentry) Patrick Hunt
[ ](sentry) Thomas White
--------------------
Slider
Slider is a collection of tools and technologies to package, deploy, and
manage long running applications on Apache Hadoop YARN clusters.
Slider has been incubating since 2014-04-29.
Three most important issues to address in the move towards graduation:
1. Podling name search
2. Growing user community
3. Growing and increasing diversity of developer community
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None.
How has the community developed since the last report?
We're only getting started, and do not have any diversity yet. Our first
goal will be to get users, bug reporters and developers. The dev list
is up and running -and we do not have any separate user list, so we hope
to pull users into coding.
The initial release will help to gain awareness, and should bring in users.
How has the project developed since the last report?
Our main activity has been setting up the incubator-hosted project, JIRA,
site, mailing list. etc. The Infra team have been very helpful here.
-Making and publishing our site has educated us on site publishing
-The initial release has taught us of the release process for incubating
projects, and where we need to improve it.
We're still trying to get Jenkins building, but that's a matter of
handling protobuf-versions on the build machines, rather than infra
involvement.
We have made our first ASF-hosted release on June 2. This was a source
only release; some of the reviewers have made suggestions which will need
to be incorporated into the next. We plan to do another release in a few
weeks time, and so evolve the project rapidly.
Date of last release:
2014-06-02
When were the last committers or PMC members elected?
We have only just set up and so the committer and PMC membership is
as covered in the incubator proposal.
Signed-off-by:
[ ](slider) Arun C Murthy
[ ](slider) Devaraj Das
[ ](slider) Jean-Baptiste Onofré
[X](slider) Mahadev Konar
--------------------
Storm
Storm is a distributed, fault-tolerant, and high-performance realtime
computation system that provides strong guarantees on the processing of data.
Storm has been incubating since 2013-09-18.
Three most important issues to address in the move towards graduation:
1. Community growth
2. Next release
3. Documentation improvements
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None.
How has the community developed since the last report?
We have added on additional committer and community activity in the mailing
lists continues to grow.
How has the project developed since the last report?
We have held a logo contest and completed the first of two rounds of voting.
Final logo selection will take place shortly. We have also established a
feature branch for incorporating all the security work done by the engineering
team at Yahoo!. Having the option for secure Storm deployments will play a big
role in increasing enterprise adoption.
We plan on initiating our next release next week in addition to completing the
logo contest. Once these two tasks are complete we would like to consider
beginning the graduation process.
Date of last release:
2014-02-22
When were the last committers or PMC members elected?
2014-03-26 (Michael G. Noll)
Signed-off-by:
[x](storm) Ted Dunning
[X](storm) Arvind Prabhakar
[ ](storm) Devaraj Das
[ ](storm) Matt Franklin
[ ](storm) Benjamin Hindman
Shepherd/Mentor notes:
Storm is showing a lot of progress and growth. They have a lot of
activity on JIRA and mailing lists, and are generally in good shape.
--------------------
Streams
Apache Streams is a lightweight server for ActivityStreams.
Streams has been incubating since 2012-11-20.
Three most important issues to address in the move towards graduation:
1. Growing the community
2. Consolidate codebase and produce a release
3. Continue to implement the Apache way and community decision making
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None
How has the community developed since the last report?
There are contributions from new individuals and an increase in new
faces on the dev list.
How has the project developed since the last report?
There has been a significant increase in development and communication
on the dev list; but, the community still needs to grow in size and
adoption of the Apache Way.
Date of last release:
2013-01-09
When were the last committers or PMC members elected?
2014-01-14 (Carol Hansen)
Signed-off-by:
[ ](streams) Matt Franklin
[x](streams) Ate Douma
[ ](streams) Craig McClanahan
--------------------
Wave
A wave is a hosted, live, concurrent data structure for rich communication. It
can be used like email, chat, or a document.
Wave has been incubating since 2010-12-04.
Three most important issues to address in the move towards graduation:
1. Make a release
2. Expand the community
3. Decide on a future path (whether we are continuing?)
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None.
How has the community developed since the last report?
There has been no major development. A new user reported a
regression on master compared to the last release candidate, but
overall the project has been very quiet this last quarter.
How has the project developed since the last report?
Some maintenance work has been committed from new developers, this
replaced Socket.IO with Atmosphere. A few other minor fixes for
different aspects (gadgets, build system) have been committed.
Date of last release:
N/A
When were the last committers or PMC members elected?
30th June 2013.
Signed-off-by:
[X](wave) Christian Grobmeier
[ ](wave) Upayavira
}}}
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
