+1 (binding) On Tue, Apr 25, 2017 at 4:52 PM, Jitendra Pandey <jiten...@hortonworks.com> wrote: > +1 (binding) > > On 4/25/17, 1:27 PM, "Julian Hyde" <jh...@apache.org> wrote: > > +1 binding > > > On Apr 25, 2017, at 12:48 PM, moon soo Lee <m...@apache.org> wrote: > > > > +1 (non-binding) > > > > On Tue, Apr 25, 2017 at 11:49 AM Ashutosh Chauhan <hashut...@apache.org> > > wrote: > > > >> +1 (binding) > >> > >> Thanks, > >> Ashutosh > >> > >> On Mon, Apr 24, 2017 at 5:45 AM, Luke Han <luke...@gmail.com> wrote: > >> > >>> +1 binding > >>> > >>> Love to see Superset to be new incubator project. > >>> > >>> > >>> Best Regards! > >>> --------------------- > >>> > >>> Luke Han > >>> > >>> On Sun, Apr 23, 2017 at 10:53 PM, Jeff Feng <jeff.f...@gmail.com> > wrote: > >>> > >>>> Dear Apache Incubator Community, > >>>> > >>>> We have updated the Superset proposal > >>>> <https://wiki.apache.org/incubator/SupersetProposal> (copied below) > for > >>>> > >>>> Apache Incubation with an additional mentor (Luke Han - > >>>> luke....@apache.org), > >>>> and would like to start a vote thread for acceptance into the > incubator. > >>>> > >>>> Our team is excited to share Superset with the Apache community and > we > >>>> hope > >>>> for the your continued support! > >>>> > >>>> Cheers, > >>>> Jeff & the Superset Team > >>>> > >>>> > >>>> > >>>> > >>>> = Superset = > >>>> > >>>> == Abstract == > >>>> Superset is an enterprise-ready web application for data exploration, > >> data > >>>> visualization and dashboarding. > >>>> > >>>> == Proposal == > >>>> Superset is business intelligence (BI) software that helps modern > >>>> organizations visualize and interact with their data. Superset > enables > >>>> users explore data from a variety of databases, assemble beautiful > >>>> dashboards and share their findings. Superset works neatly with all > >>>> modern > >>>> SQL-speaking databases, and integrates with Druid.io to provide > >> real-time, > >>>> interactive, blazing fast data access to large datasets. > >>>> > >>>> == Background == > >>>> Data is mission critical. To succeed in this era, organizations need > to > >>>> provide low-friction, intuitive and interactive access to data. It is > >>>> paramount for knowledge workers to be capable of answering their own > >>>> questions by querying, exploring and visualizing data. > >>>> > >>>> The entire business intelligence industry has pivoted from a model of > >>>> centralized top-down platforms driven by IT organizations to > >> self-service > >>>> analytics and agile workflows by any user. This shift unblocks > >>>> centralized > >>>> service bottlenecks for creating data visualizations while also > creating > >>>> an > >>>> environment that is iterative and fast-moving. This means that > business > >>>> intelligence software must also be easy and delightful to use. > >>>> Self-service analytics doesn’t mean that admin and governance > features > >> are > >>>> not needed. > >>>> Modern BI tools provide fine-grain access controls and auditing > >>>> capabilities to understand how data is being used. Superset is a > >> solution > >>>> that delivers on all of these vectors. > >>>> > >>>> The technology stack is also constantly morphing - vendors are > >> struggling > >>>> to provide cheap, quick and easy solutions to access data. Business > >>>> intelligence users are finding existing solutions lacking as these > >>>> software > >>>> products either disregard or react slowly to recent game-changing > >>>> technologies like Druid.io, PrestoDB, Apache Drill, Apache Kylin, > d3.js, > >>>> React.js and iPython’s Jupyter for instance. > >>>> > >>>> == Rationale == > >>>> Business intelligence is more relevant today than at any other point > in > >>>> history. Organizations are currently very limited in options for > open > >>>> source data visualization solutions, especially solutions that are > both > >>>> self-service and enterprise-ready. Every company informing their > >>>> decisions > >>>> with data needs a BI tool. > >>>> > >>>> We believe that Superset will be a strong compliment to existing > Apache > >>>> Software Foundation technologies by offering scalable user > interactions > >> to > >>>> distributed storage and computation solutions. Users will often find > >> that > >>>> Superset can act as a catalyst for tooling that can visualize the > >>>> byproduct > >>>> of data and computation infrastructure. > >>>> > >>>> Superset has many key design elements that help fill a gap in current > >>>> solutions for organizations: > >>>> * Easy, low friction access to data through a simple, web-based data > >>>> exploration interface. Composing charts and dashboards are > intuitive. > >>>> Eliminating the need to write code or SQL empowers anyone to use it. > >>>> * Access to a wide array of rich, interactive data visualization > types. > >>>> * Enterprise-ready: Integration with different authentication > >> mechanisms > >>>> and granular permissions centered around actions and data access. > >>>> * Realtime & fast: Superset provides realtime analytics at the speed > of > >>>> thought on very large datasets when integrated with Druid.io. > >>>> * Broad data access: Consume data out of any SQL-speaking relational > >>>> database. > >>>> * Extensible: Can be extended to talk to many noSQL databases like > >> Apache > >>>> Drill, Elastic Search, and other popular database engines. > >>>> * Fast loading dashboards with configurable web-scale caching. > >>>> * Plug-in framework that enables organizations to build custom > >> analytical > >>>> applications with new UI/UX interfaces. > >>>> * SQL Lab, a state-of-the-art SQL IDE that empowers SQL-speaking > users > >>>> with more flexibility. SQL Lab integrates with the visualization > engine > >>>> seamlessly. > >>>> > >>>> == Initial Goals == > >>>> The initial goals of the Superset project are several-fold: > >>>> * Move the existing codebase to Apache and integrate with the Apache > >>>> development process. > >>>> * Redesign the user interface and interaction model for creating > >>>> visualizations/dashboards and connecting to data sources > >>>> * Build robust support for security and governance of the tool > >> including > >>>> popular authorization modules (including Apache Ranger and Apache > >> Sentry) > >>>> and a more sophisticated permissions system > >>>> * Grow the extensibility of the project both in terms of enhanced > >>>> connectivity to NoSQL-based data sources and creating a plug-in > >> framework > >>>> that enables organizations to build custom analytical applications > which > >>>> require a new UI/UX > >>>> > >>>> == Current Status == > >>>> By many standards, Superset is already a successful open source > project. > >>>> As > >>>> of March 2017, Superset is officially used in production at about a > >> dozen > >>>> companies, has received contributions from over one hundred > contributors > >>>> on > >>>> Github, 1500+ forks, and 12k+ stars. > >>>> > >>>> Sizeable companies like Airbnb, Yahoo! and Hortonworks have made > >>>> significant contributions, and expressed their commitment to the > >> project. > >>>> The product is feature complete and has been viable for months. It > >> already > >>>> serves as the main interface for consuming data at many companies of > >>>> different sizes. > >>>> > >>>> While the product is usable, there’s room for improvement across the > >>>> board, > >>>> starting with providing a smoother user experience around content > >>>> creation, > >>>> making sure all features work out-of-the-box on more platforms and > >>>> databases, providing better user training guides and videos, having a > >>>> predictable release process, and increasing the overall quality of > the > >>>> Superset releases. > >>>> > >>>> === Meritocracy === > >>>> We plan to invest in supporting a meritocracy. We will discuss the > >>>> requirements in an open forum. Several companies have expressed > interest > >>>> in > >>>> this project, and we intend to invite additional developers to > >>>> participate. > >>>> We will encourage and monitor community participation so that > privileges > >>>> can be extended to those that contribute. > >>>> > >>>> === Community === > >>>> The need for an enterprise-ready data visualization and exploration > >>>> platform in the open source community is tremendous. While Superset > is > >>>> fairly well known, recognized and used within the Druid.io community, > >>>> adoption is currently limited outside of that niche. There is a huge > >>>> opportunity to grow the community to hundreds if not thousands of > >>>> organizations, and we are hoping that embracing “the Apache way” will > >>>> accelerate the growth of our community. > >>>> > >>>> We have already been active at seeking and inviting contributions, > and > >> are > >>>> planning to scale the project by investing time and growing the > support > >>>> structure to grow the community. > >>>> > >>>> === Core Developers === > >>>> The initial committers for Superset include experienced full stack, > >>>> front-end and data engineers: > >>>> * Maxime Beauchemin (Airbnb) > >>>> * Alanna Scott (Airbnb) > >>>> * Bogdan Kyryliuk (Airbnb) > >>>> * Vera Liu (Airbnb) > >>>> * Jeff Feng (Airbnb) > >>>> * Ashutosh Chauhan (Hortonworks) > >>>> * Nishant Bangarwa (Hortonworks) > >>>> * Slim Bouguerra (Hortonworks) > >>>> * Priyank Shah (Hortonworks) > >>>> * Sriharsha Chintalapani (Hortonworks) > >>>> * Daniel Dai (Hortonworks) > >>>> > >>>> We realize that additional employer diversity is needed, and we will > >> work > >>>> aggressively to recruit developers from additional companies. > >>>> > >>>> === Alignment === > >>>> The initial committers strongly believe that a system for interactive > >>>> visualization of data will gain broader adoption as an open source, > >>>> community driven project, where the community can contribute not > only to > >>>> the core components, but also to a growing collection of connectors, > >>>> visualizations and improving integration a all potential data > sources. > >>>> Superset already integrates closely with Apache Hive, the Hive > >> metastore, > >>>> as well as most SQL-speaking databases found in modern data > ecosystems. > >>>> > >>>> == Known Risks == > >>>> > >>>> === Orphaned Products === > >>>> Superset is a vital component for both visualizing, accessing and > >>>> democratizing data at Airbnb. Also at Hortonworks, Superset is a > core > >>>> component of the DataFlow product offering. Thus, the risk of the > >> project > >>>> being orphaned is relatively low. The project could be at risk if > >> Airbnb > >>>> changes their approach for democratizing data or if Hortonworks > changes > >>>> their strategy in the market. In such an event, the committers plan > to > >>>> continue working on the project on their own time, thought the > progress > >>>> will likely be slower. We plan to mitigate this risk by recruiting > >>>> additional committers. > >>>> > >>>> === Inexperience with Open Source === > >>>> The initial committers include veteran Apache members (committers and > >> PPMC > >>>> members) and other developers who have varying degrees of experience > >> with > >>>> open source projects. All have been involved with source code that > has > >>>> been > >>>> released under an open source license, and several also have > experience > >>>> developing code with an open source development process. > >>>> > >>>> === Homogenous Developers === > >>>> The initial committers are employed by Airbnb Inc. and Hortonworks. > We > >> are > >>>> committed to recruiting additional committers from other companies. > >>>> > >>>> === Reliance on Salaried Developers === > >>>> It is expected that Superset development will occur on both salaried > >> time > >>>> and on volunteer time, after hours. The majority of initial > committers > >> are > >>>> paid by their employer to contribute to this project. However, they > are > >>>> all > >>>> passionate about the project, and we are confident that the project > will > >>>> continue even if no salaried developers contribute to the project. We > >> are > >>>> committed to recruiting additional committers including non-salaried > >>>> developers. > >>>> > >>>> === Relationships with Other Apache Products === > >>>> To the knowledge of the Initial Committers, there are no direct > >>>> competitors > >>>> to Superset within the Apache Software Foundation. That said, Apache > >>>> Zeppelin is an indirect competitor, but it solves a different use > case. > >>>> > >>>> Apache Zeppelin is a web-based notebook that enables interactive data > >>>> analytics. It enables the creation of beautiful data-driven, > interactive > >>>> and collaborative documents with SQL, Scala and more. Although a > user > >> can > >>>> create data visualizations using this project, it leverages a > notebook > >>>> style user interfaces and it is geared towards the Spark community > where > >>>> Scala and SQL co-exist > >>>> > >>>> We look forward to collaborating with those communities, as well as > >> other > >>>> Apache communities. > >>>> > >>>> === An Excessive Fascination with the Apache Brand === > >>>> Superset is solving two huge challenges: > >>>> The challenge of enabling every knowledge worker to make data > informed > >>>> decisions, particularly those who are not deeply skilled at writing > SQL. > >>>> The challenge of visualizing huge amounts of data interactively and > in > >>>> real-time > >>>> > >>>> Superset was first developed as a data visualization solution for > >> Druid.io > >>>> as a way to visualize billions of rows of data. Since then, usage of > >>>> Superset has expanded to address data visualization use cases across > SQL > >>>> speaking data sources as well. > >>>> > >>>> Our rationale for developing Superset as an Apache project is > detailed > >> in > >>>> the Rationale Section. We believe that the Apache brand and > community > >>>> process will help us attract more contributors to this project, and > help > >>>> grow the footprint of the project through usage at other > organizations > >> and > >>>> within other applications. Establishing consensus among users and > >>>> developers will result in a more valuable tool for everyone. > >>>> > >>>> == Documentation == > >>>> References to further reading material: > >>>> * [[http://airbnb.io/superset/|Superset Documentation]] > >>>> * [[ > >>>> https://medium.com/airbnb-engineering/caravel-airbnb-s-data- > >>>> exploration-platform-15a72aa610e5#.npqmmbu25|Blog > >>>> Post: Superset: Airbnb’s Data Exploration Platform]] > >>>> * [[ > >>>> https://medium.com/airbnb-engineering/superset-scaling-data- > >>>> access-and-visual-insights-at-airbnb-3ce3e9b88a7f#.a505zvb1t|Blog > >>>> Post: Superset: Scaling Data Access & Visual Insights at Airbnb]] > >>>> > >>>> == Initial Source == > >>>> The origin of the proposed code base can be found at > >>>> https://github.com/airbnb/superset. The code base is primarily in > >>>> Python. > >>>> > >>>> == Source and Intellectual Property Submission Plan == > >>>> We do not expect any complications for the submission of the Superset > >> code > >>>> base. Our code is already in Github and there is only a single code > >> base. > >>>> > >>>> == External Dependencies == > >>>> List of Python packages, from the Python Package Index (Pypi): > >>>> > >>>> * boto3 > >>>> * celery > >>>> * cryptography > >>>> * flask-appbuilder > >>>> * flask-cache > >>>> * flask-migrate > >>>> * flask-script > >>>> * flask-sqlalchemy > >>>> * flask-testing > >>>> * humanize > >>>> * gunicorn > >>>> * markdown > >>>> * pandas > >>>> * parsedatetime > >>>> * pydruid > >>>> * PyHive > >>>> * python-dateutil > >>>> * requests > >>>> * simplejson > >>>> * six > >>>> * sqlalchemy > >>>> * sqlalchemy-utils > >>>> * sqlparse > >>>> * thrift > >>>> * thrift-sasl > >>>> * werkzeug > >>>> > >>>> List of Javascript packages, from NPM: > >>>> * autobind-decorator > >>>> * bootstrap > >>>> * bootstrap-datepicker > >>>> * brace > >>>> * brfs > >>>> * cal-heatmap > >>>> * classnames > >>>> * d3 > >>>> * d3-cloud > >>>> * d3-sankey > >>>> * d3-scale > >>>> * d3-tip > >>>> * datamaps > >>>> * datatables-bootstrap3-plugin > >>>> * datatables.net-bs > >>>> * font-awesome > >>>> * gridster > >>>> * immutability-helper > >>>> * immutable > >>>> * jquery > >>>> * lodash.throttle > >>>> * mapbox-gl > >>>> * moment > >>>> * moments > >>>> * mustache > >>>> * nvd3 > >>>> * react > >>>> * react-ace > >>>> * react-bootstrap > >>>> * react-bootstrap-table > >>>> * react-dom > >>>> * react-draggable > >>>> * react-gravatar > >>>> * react-grid-layout > >>>> * react-map-gl > >>>> * react-redux > >>>> * react-resizable > >>>> * react-select > >>>> * react-syntax-highlighter > >>>> * reactable > >>>> * redux > >>>> * redux-localstorage > >>>> * redux-thunk > >>>> * shortid > >>>> * style-loader > >>>> * supercluster > >>>> * topojson > >>>> * victory > >>>> * viewport-mercator-project > >>>> > >>>> == Cryptography == > >>>> The proposal does not include cryptographic code. > >>>> > >>>> == Required Resources == > >>>> > >>>> === Mailing List === > >>>> There is a current mailing list as a Google Group “airbnb_superset” > that > >>>> we > >>>> are planning on deprecating as the Apache.org become ready to serve > our > >>>> community. > >>>> > >>>> * superset-private > >>>> * superset-dev > >>>> * superset-user > >>>> > >>>> === Subversion Directory === > >>>> Git is the preferred source control system. > >>>> http://svn.apache.org/repos/asf/incubator/superset > >>>> > >>>> == Git Repository == > >>>> Git is the preferred source control system, we’re assuming > >>>> https://github.com/apache/incubator-superset based on the naming > scheme > >>>> > >>>> == Issue Tracking == > >>>> JIRA Superset (SUPERSET). If possible, we’d like to use Github > issues & > >>>> PRs > >>>> to manage our project as much as possible. It’s been said that there > are > >>>> ways to keep Github’s issues in sync with Jira, allowing us to get > best > >> of > >>>> both worlds. If that is not possible, we will comply to using Jira. > >>>> > >>>> == Other Resources == > >>>> We currently use a set of Github integrated services that are free to > >> the > >>>> open source community, like Travis-ci, Code Climate, Coveralls, > >>>> Landscape.io, Requires.io, david-dm and Gitter. We would like to keep > >>>> using > >>>> these services as they allow us to scale contributions and optimize > our > >>>> development flows. These services require some elevated rights on the > >>>> Github repository in order to set up or tune and we would like for > the > >>>> committers to have the required rights. > >>>> > >>>> > >>>> == Initial Committers == > >>>> > >>>> * Maxime Beauchemin <maxime.beauche...@airbnb.com> - PPMC & Committer > >>>> * Alanna Scott <alanna.sc...@airbnb.com> - PPMC & Committer > >>>> * Bogdan Kyryliuk <b.kyryl...@gmail.com> - PPMC & Committer > >>>> * Vera Liu <vera....@airbnb.com> - Committer > >>>> * Jeff Feng <jeff.f...@airbnb.com> - PPMC & Committer > >>>> * Ashutosh Chauhan <hashut...@apache.org> - Mentor & Committer > >>>> * Nishant Bangarwa <nbanga...@hortonworks.com> - PPMC & Committer > >>>> * Slim Bouguerra <sbougue...@hortonworks.com> - Committer > >>>> * Priyank Shah <ps...@hortonworks.com> - Committer > >>>> * Harsha Chintalapani <schintalap...@hortonworks.com> - Committer > >>>> * Daniel Dai <da...@apache.org> - Champion & Committer > >>>> * Luke Han <luke....@apache.org> - Mentor > >>>> > >>>> == Affiliations == > >>>> The initial committers are employees of Airbnb Inc. and Hortonworks. > >>>> > >>>> == Sponsors == > >>>> > >>>> === Champion === > >>>> Daniel Dai <da...@apache.org> > >>>> > >>>> === Nominated Mentors === > >>>> * Ashutosh Chauhan <hashut...@apache.org> > >>>> * Luke Han <luke....@apache.org> > >>>> > >>>> === Sponsoring Entity === > >>>> Incubator PMC > >>>> > >>> > >>> > >> > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > > > >
--------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
