+1(non-binding) Pulsar is a powerful mq， I like it.
On Wed, May 17, 2017 at 2:44 PM, Julian Hyde <jh...@apache.org> wrote: > +1 (binding) > > > On May 17, 2017, at 1:58 PM, Jia Zhai <zhaiji...@gmail.com> wrote: > > > > +1 (non-binding) > > > > On Thu, May 18, 2017 at 1:11 AM, P. Taylor Goetz <ptgo...@gmail.com> > wrote: > > > >> +1 (binding) > >> > >> -Taylor > >> > >>> On May 16, 2017, at 10:39 PM, Bryan Call <bc...@apache.org> wrote: > >>> > >>> Hi All, > >>> > >>> As the champion for Pulsar, I would like to start a VOTE to bring the > >>> project in as Apache incubator podling. > >>> > >>> The ASF voting rules are described: > >>> > >>> https://www.apache.org/foundation/voting.html > >>> > >>> A vote for accepting a new Apache Incubator podling is a majority vote > >> for which > >>> only Incubator PMC member votes are binding. > >>> > >>> This vote will run for at least 72 hours. Please VOTE as follows > >>> [] +1 Accept Pulsar into the Apache Incubator > >>> [] +0 Abstain. > >>> [] -1 Do not accept Pulsar into the Apache Incubator because ... > >>> > >>> The proposal is listed below, but you can also access it on the wiki: > >>> > >>> https://wiki.apache.org/incubator/PulsarProposal > >>> > >>> -Bryan > >>> > >>> > >>> = Pulsar Proposal = > >>> > >>> == Abstract == > >>> > >>> Pulsar is a highly scalable, low latency messaging platform running on > >>> commodity hardware. It provides simple pub-sub semantics over topics, > >>> guaranteed at-least-once delivery of messages, automatic cursor > >> management for > >>> subscribers, and cross-datacenter replication. > >>> > >>> == Proposal == > >>> > >>> Pub-sub messaging is a very common design pattern that is increasingly > >> found > >>> in distributed systems powering Internet applications. These > applications > >>> provide real-time services, and need publish-latencies of 5ms on > average > >> and > >>> no more than 15ms at the 99th percentile. At Internet scale, these > >>> applications require a messaging system with ordering, strong > >> durability, and > >>> delivery guarantees. In order to handle the “five 9’s” durability > >> requirements > >>> of a production environment, the messages have to be committed on > >> multiple > >>> disks or nodes. > >>> > >>> Pulsar has been developed at Yahoo to address these specific > >> requirements by > >>> providing a hosted service supporting millions of topics for multiple > >> tenants. > >>> The current incarnation of Pulsar has been open-sourced under Apache > >> license > >>> in September 2016 and it is the direct evolution of systems that were > >>> developed at Yahoo since 2011. > >>> > >>> We believe there is currently no other system that provides a > >> multi-tenant > >>> hosted messaging platform capable of supporting a huge number of topics > >> while > >>> maintaining strict guarantees for durability, ordering and low latency. > >>> Current solutions would require to run multiple individual clusters > with > >>> additional operational work and capacity overhead. > >>> > >>> Since the open sourcing of Pulsar, the development has been done > >> exclusively > >>> on the public Github repository and two major releases were shipped > >> (1.15 and > >>> 1.16), along with multiple minor ones. Several other companies have > >> expressed > >>> interest in the project and its future direction. > >>> > >>> == Rationale == > >>> > >>> Pulsar is a platform that is built on top of several other Apache > >> projects. In > >>> particular, Apache BookKeeper is used to store the data and Apache > >> ZooKeeper > >>> is used for coordination and metadata storage. Pulsar is also > >> interoperable > >>> out of the box with Apache Storm, to provide an easy to use stream > >> processing > >>> solution. > >>> > >>> We want to establish a community outside the scope of initial core > >> developers > >>> at Yahoo and we believe that the Apache Foundation is a great fit and > >> long- > >>> term home for Pulsar, as it provides an established process for > >> community- > >>> driven development and decision making by consensus. This is exactly > the > >> model > >>> we want to adopt for future Pulsar development. > >>> > >>> == Initial Goals == > >>> > >>> The initial goals will be to move the existing codebase to Apache and > >>> integrate with the Apache development process. Furthermore, we plan for > >>> incremental development, and releases along with the Apache guidelines. > >>> > >>> == Current Status == > >>> > >>> Pulsar has been in service at large scale for more than 2 years at > >> Yahoo. In > >>> this time around 60 different applications were integrated with Pulsar. > >> Other > >>> companies are evaluating it as well and have been contributing code to > >> the > >>> project. > >>> > >>> === Meritocracy === > >>> > >>> We value meritocracy and we understand that it is the basis to form an > >> open > >>> community that encourages multiple companies and individuals to > >> contribute and > >>> get invested in the project future. We will encourage and monitor > >>> participation and make sure to extend privileges and responsibilities > to > >> all > >>> contributors. > >>> > >>> === Community === > >>> > >>> We have validated, through the interest demonstrated by Pulsar users at > >> Yahoo, > >>> that a reliable hosted pub-sub messaging platform represent a very > >> important > >>> building block for web-scale distributed applications. We believe that > >> many > >>> companies can benefit by applying the same model and that bringing > >> Pulsar to > >>> Apache will get the community to grow stronger. > >>> > >>> === Core Developers === > >>> > >>> Pulsar has been initially developed at Yahoo and received significant > >>> contributions from Yahoo Japan. After having open-sourced the project > >> there > >>> have been contribution from developers from several external companies. > >>> > >>> === Alignment === > >>> > >>> Pulsar builds upon other Apache projects such as ZooKeeper and > >> BookKeeper, > >>> along with a number of other Apache libraries. We have already > >> integrated with > >>> Storm and we envision to integrate with multiple other systems in the > >>> streaming and big data space. > >>> > >>> == Known Risks == > >>> > >>> === Orphaned Products === > >>> > >>> Yahoo has been doing most of the development and, given that many > >> internal > >>> platforms depends on Pulsar, it is heavily invested in the long term > >> success > >>> of the the project. Yahoo has a long history participating in > open-source > >>> projects, and has been also a long time contributor to the Apache > >> community. > >>> > >>> === Inexperience with Open Source === > >>> > >>> Many Pulsar contributors are already familiar with the open source > >> process and > >>> several of them are committers on other Apache projects. We will be > >> actively > >>> working with experienced Apache community members to improve our > project. > >>> > >>> === Homogenous Developers === > >>> > >>> The initial committers are employed by large companies including Yahoo, > >> Yahoo! > >>> Japan, Salesforce and MercadoLibre. We hope to grow the community and > to > >>> include additional committers based on their contributions to the > >> project. > >>> > >>> === Reliance on Salaried Developers === > >>> > >>> It is expected that Pulsar development will occur on both salaried time > >> and on > >>> volunteer time, after hours. The majority of initial committers are > paid > >> by > >>> their employer to contribute to this project. However, they are all > >> passionate > >>> about the project, and we are confident that the project will continue > >> even if > >>> no salaried developers contribute to the project. > >>> > >>> === Relationships with Other Apache Products === > >>> > >>> As mentioned in the Rationale section, Pulsar is closely dependent and > >>> integrated with BookKeeper and ZooKeeper and Storm. There are ongoing > to > >>> integrate with other projects such Apache Spark. We look forward to > >>> collaborating with those communities, as well as other Apache > >> communities. > >>> > >>> === An Excessive Fascination with the Apache Brand === > >>> > >>> We are applying to the Incubator process because we think it is the > next > >>> logical step for the Pulsar project after open-sourcing the code in > >> 2016. This > >>> proposal is not for the purpose of generating publicity. Rather, we > want > >> to > >>> make sure to create a very inclusive and meritocratic community, > outside > >> the > >>> umbrella of a single company. Yahoo has a long standing history of > >>> contributing to Apache projects and the Pulsar developers and > >> contributors > >>> understand the implication of making it an Apache project. > >>> > >>> == Documentation == > >>> * Pulsar code base: https://github.com/yahoo/pulsar > >>> * Pulsar documentation: https://github.com/yahoo/pulsar/blob > >>> /master/docs/Documentation.md > >>> * Blog post: [[https://yahooeng.tumblr.com/post/150078336821/ > >>> open-sourcing-pulsar-pub-sub-messaging-at-scale|Open-sourcing > Pulsar, > >>> Pub-sub Messaging at Scale]] > >>> > >>> == Initial Source == > >>> > >>> The Pulsar codebase is currently hosted on Github: > >>> https://github.com/yahoo/pulsar. This is the exact codebase that we > >> would > >>> migrate to the Apache Software Foundation. > >>> > >>> == Source and Intellectual Property Submission Plan == > >>> > >>> The Pulsar source code in Github is currently licensed under Apache > >> License > >>> v2.0 and the copyright is assigned to Yahoo. All the contributions from > >>> external parties have been received under Apache style CLA. If Pulsar > >> fulfills > >>> and passes the conditions for being an Incubator project in the ASF, > >> Yahoo > >>> will transition the source code ownership to the Apache Software > >> Foundation > >>> via the Software Grant Agreement. > >>> > >>> == External Dependencies == > >>> > >>> To the best of our knowledge, all of Pulsar dependencies are > distributed > >> under > >>> Apache compatible licenses. > >>> > >>> === External dependencies licensed under Apache License 2.0: === > >>> > >>> Athenz, JCommander, HPPC - High Performance Primitive Collections for > >> Java, > >>> FasterXML Jackson, Caffeine Async Cache, GSon, Guava, Netty, > >> DataSketches, > >>> Joda-time, Jna Java Native Access, Lz4-java, AsyncHttpClient, Jetty, > >> SnakeYAML > >>> > >>> === ASF Projects: === > >>> > >>> BookKeeper, ZooKeeper, Storm, Log4J, Commons (BeanUtils, CLI, Codec, > >>> Collections, Configuration, Digester, IO, Lang, Lang3, Logging) > >>> > >>> === Others: === > >>> * Protobuf (3-clause BSD) > >>> * JLine (BSD License) > >>> * Jersey (CDDL - Version 1.1) > >>> * HdrHistogram (BSD License) > >>> * RocksDB-JNI (3-clause BSD) > >>> * SLF4J API (MIT) > >>> > >>> == Required Resources == > >>> > >>> === Mailing lists === > >>> * us...@pulsar.incubator.apache.org > >>> * d...@pulsar.incubator.apache.org > >>> * comm...@pulsar.incubator.apache.org > >>> * priv...@pulsar.incubator.apache.org (with moderated subscriptions) > >>> > >>> === Git Repository === > >>> * https://git-wip-us.apache.org/repos/asf/incubator-pulsar > >>> > >>> === Issue Tracking === > >>> * JIRA Pulsar (PULSAR) > >>> > >>> == Initial Committers == > >>> * Matteo Merli - <mme...@apache.org> > >>> * Joe Francis - <j...@yahoo-inc.com> > >>> * Rajan Dhabalia - <rdhaba...@yahoo-inc.com> > >>> * Sahaya Andrews Albert - <sandr...@yahoo-inc.com> > >>> * Maurice Barnum - <m...@yahoo-inc.com> > >>> * Ludwig Pummer - <lud...@yahoo-inc.com> > >>> * Jai Asher - <j...@yahoo-inc.com> > >>> * Siddharth Boobna - <sboo...@apache.org> > >>> * Nozomi Kurihara - <nkuri...@yahoo-corp.jp> > >>> * Yuki Shiga - <yush...@yahoo-corp.jp> > >>> * Masakazu Kitajo - <mas...@apache.org> > >>> * Sebastián Schepens - <sebastian.schep...@mercadolibre.com> > >>> * Brad McMillen - <bra...@yahoo-inc.com> > >>> * Bobbey Reese - <bre...@yahoo-inc.com> > >>> * Masahiro Sakamoto <massa...@yahoo-corp.jp> > >>> * Hiroyuki Sakai <hsa...@yahoo-corp.jp> > >>> > >>> == Affiliations == > >>> * Matteo Merli - Streamlio > >>> * Joe Francis - Yahoo > >>> * Rajan Dhabalia - Yahoo > >>> * Sahaya Andrews Albert - Yahoo > >>> * Maurice Barnum - Yahoo > >>> * Ludwig Pummer - Yahoo > >>> * Jai Asher - Yahoo > >>> * Siddharth Boobna - Salesforce > >>> * Nozomi Kurihara - Yahoo! Japan > >>> * Yuki Shiga - Yahoo! Japan > >>> * Masakazu Kitajo - Apple > >>> * Sebastián Schepens - Mercado Libre > >>> * Brad McMillen - Yahoo > >>> * Bobbey Reese - Yahoo > >>> > >>> == Sponsors == > >>> > >>> === Champion === > >>> * Bryan Call > >>> > >>> === Nominated Mentors === > >>> * Dave Fisher > >>> * Jim Jagielski > >>> * P. Taylor Goetz > >>> * Francis Liu > >>> > >>> === Sponsoring Entity === > >>> * The Apache Incubator PMC > >>> > >>> > >>> > >>> --------------------------------------------------------------------- > >>> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > >>> For additional commands, e-mail: general-h...@incubator.apache.org > >>> > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > >> For additional commands, e-mail: general-h...@incubator.apache.org > >> > >> > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
