Done. The writeup looks great! On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rmetz...@apache.org> wrote:
> Nice, really good news on the INFRA front! > I think the hardware specs sound reasonable. And a periodic backup of the > website's database to Infra's backup solution sounds reasonable too. > > Can you accept and review my proposal for the website? > > > On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <becket....@gmail.com> wrote: > >> > >> > I have a very capable and motivated frontend developer who would be >> > willing to implement what I've mocked in my proposal. >> >> >> That is awesome! >> >> I created a Jira ticket[1] to Apache Infra and got the reply. It looks >> that >> Apache infra team could provide a decent VM. The last piece is how to >> ensure the data is persisted so we won't lose the project info / user >> feedbacks when the VM is down. If Apache infra does not provide a >> persistent storage for DB backup, we can always ask for multiple VMs and >> do >> the fault tolerance by ourselves. It seems we can almost say the hardware >> side is also ready. >> >> Thanks, >> >> Jiangjie (Becket) Qin >> >> [1] https://issues.apache.org/jira/browse/INFRA-18010 >> >> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rmetz...@apache.org> >> wrote: >> >> > Thank you for reaching out to Infra and the ember client. >> > When I first saw the Ember repository, I thought it is the whole thing >> > (frontend and backend), but while testing it, I realized it is "only" >> the >> > frontend. I'm not sure if it makes sense to adjust the Ember observer >> > client, or just write a simple UI from scratch. >> > I have a very capable and motivated frontend developer who would be >> > willing to implement what I've mocked in my proposal. >> > In addition, I found somebody (Congxian Qiu) who seems to be eager to >> help >> > with this project for the backend: >> > https://github.com/rmetzger/flink-community-tools/issues/4 >> > >> > For Infra: I made the same experience when asking for more GitHub >> > permissions for "flinkbot": They didn't respond on their mailing list, >> only >> > on Jira. >> > >> > >> > >> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <becket....@gmail.com> >> wrote: >> > >> >> Thanks for writing up the specifications. >> >> >> >> Regarding the website source code, Austin found a website[1] whose >> >> frontend code[2] is available publicly. It lacks some support (e.g >> login), >> >> but it is still a good starting point. One thing is that I did not >> find a >> >> License statement for that source code. I'll reach out to the author >> to see >> >> if they have any concern over our usage. >> >> >> >> Apache Infra has not replied to my email regarding some details about >> the >> >> VM. I'll open an infra Jira ticket tomorrow if there is still no >> response. >> >> >> >> Thanks, >> >> >> >> Jiangjie (Becket) Qin >> >> >> >> [1] https://emberobserver.com/ >> >> [2] https://github.com/emberobserver/client >> >> >> >> >> >> >> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rmetz...@apache.org> >> >> wrote: >> >> >> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company >> >>> website. I guess the likelihood that they give out code from their >> company >> >>> website is fairly low. >> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll >> >>> reactivate as part of this PR: >> >>> https://github.com/apache/flink-web/pull/187 >> >>> >> >>> Spark-packages.org did not respond to my request. >> >>> I will propose a short specification in Becket's initial document. >> >>> >> >>> >> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <ni...@basjes.nl> >> wrote: >> >>> >> >>>> Hi, >> >>>> >> >>>> The Beam project has something in this area that is simply a page >> >>>> within their documentation website: >> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/ >> >>>> >> >>>> Niels Basjes >> >>>> >> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bowenl...@gmail.com> >> wrote: >> >>>> > >> >>>> > Confluent hub for Kafka is another good example of this kind. I >> >>>> personally like it over the spark site. May worth checking it out >> with >> >>>> Kafka folks >> >>>> > >> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <becket....@gmail.com> >> >>>> wrote: >> >>>> >> >> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the >> >>>> >> ecosystem page and the navigation. >> >>>> >> >> >>>> >> Thanks, >> >>>> >> >> >>>> >> Jiangjie (Becket) Qin >> >>>> >> >> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger < >> rmetz...@apache.org> >> >>>> wrote: >> >>>> >> >> >>>> >> > Okay. I will reach out to spark-packages.org and see if they >> are >> >>>> willing >> >>>> >> > to share. >> >>>> >> > >> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe >> sync >> >>>> with >> >>>> >> > the "Software Projects" listed here: >> >>>> >> > >> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) >> >>>> and >> >>>> >> > link it in the navigation? >> >>>> >> > >> >>>> >> > Best, >> >>>> >> > Robert >> >>>> >> > >> >>>> >> > >> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin < >> becket....@gmail.com> >> >>>> wrote: >> >>>> >> > >> >>>> >> >> Hi Robert, >> >>>> >> >> >> >>>> >> >> I think it at least worths checking if spark-packages.org >> owners >> >>>> are >> >>>> >> >> willing to share. Thanks for volunteering to write the >> requirement >> >>>> >> >> descriptions! In any case, that will be very helpful. >> >>>> >> >> >> >>>> >> >> Since a static page has almost no cost, and we will need it to >> >>>> redirect >> >>>> >> >> to the dynamic site anyways, how about we first do that while >> >>>> working on >> >>>> >> >> the dynamic website? >> >>>> >> >> >> >>>> >> >> Thanks, >> >>>> >> >> >> >>>> >> >> Jiangjie (Becket) Qin >> >>>> >> >> >> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <u...@apache.org> >> >>>> wrote: >> >>>> >> >> >> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We >> >>>> could then >> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we >> >>>> have the >> >>>> >> >>> resources in the community to quickly start with a dynamic >> site, >> >>>> I'm >> >>>> >> >>> not apposed. >> >>>> >> >>> >> >>>> >> >>> – Ufuk >> >>>> >> >>> >> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger < >> >>>> rmetz...@apache.org> >> >>>> >> >>> wrote: >> >>>> >> >>> > >> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs >> >>>> hosted by >> >>>> >> >>> Infra >> >>>> >> >>> > look suitable. >> >>>> >> >>> > >> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It used >> to >> >>>> be >> >>>> >> >>> linked, >> >>>> >> >>> > but has been removed from the navigation bar for some >> reason. >> >>>> This is >> >>>> >> >>> the >> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html >> >>>> >> >>> > We could update the page and add it back to the navigation >> bar >> >>>> for the >> >>>> >> >>> > coming weeks. What do you think? >> >>>> >> >>> > >> >>>> >> >>> > I would actually like to push for a dynamic page right away. >> >>>> >> >>> > >> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about >> >>>> sending the >> >>>> >> >>> > owners of spark-packages.org a short note, if they are >> >>>> interested in >> >>>> >> >>> > sharing the source? We could maintain the code together in a >> >>>> public >> >>>> >> >>> repo. >> >>>> >> >>> > If they are not interested in sharing, or we decide not to >> ask >> >>>> in the >> >>>> >> >>> first >> >>>> >> >>> > place, I'm happy to write down a short description of the >> >>>> requirements, >> >>>> >> >>> > maybe some mockups. We could then see if we find somebody >> here >> >>>> in the >> >>>> >> >>> > community who's willing to implement it. >> >>>> >> >>> > Given the number of people who are eager to contribute, I >> >>>> believe we >> >>>> >> >>> will >> >>>> >> >>> > be able to find somebody pretty soon. >> >>>> >> >>> > >> >>>> >> >>> > >> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin < >> >>>> becket....@gmail.com> >> >>>> >> >>> wrote: >> >>>> >> >>> > >> >>>> >> >>> > > Forgot to provide the link... >> >>>> >> >>> > > >> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs >> (Apache >> >>>> infra >> >>>> >> >>> services) >> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD >> Jail >> >>>> provided >> >>>> >> >>> by >> >>>> >> >>> > > Apache Infra) >> >>>> >> >>> > > >> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin < >> >>>> becket....@gmail.com> >> >>>> >> >>> wrote: >> >>>> >> >>> > > >> >>>> >> >>> > >> Hi Robert, >> >>>> >> >>> > >> >> >>>> >> >>> > >> Thanks for the feedback. These are good points. We should >> >>>> absolutely >> >>>> >> >>> > >> shoot for a dynamic website to support more interactions >> in >> >>>> the >> >>>> >> >>> community. >> >>>> >> >>> > >> There might be a few things to solve: >> >>>> >> >>> > >> 1. The website code itself. An open source solution would >> >>>> be great. >> >>>> >> >>> TBH, >> >>>> >> >>> > >> I do not have much experience on building a website. >> It'll >> >>>> be great >> >>>> >> >>> if >> >>>> >> >>> > >> someone could help comment on the solution here. >> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra >> provides >> >>>> a few >> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did not >> see >> >>>> >> >>> database >> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in >> FreeBSD >> >>>> jail[2]. >> >>>> >> >>> > >> >> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback! >> >>>> >> >>> > >> >> >>>> >> >>> > >> @Shaoxuan Wang <wshaox...@gmail.com> >> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. >> We >> >>>> >> >>> probably need >> >>>> >> >>> > >> a page in the Flink official site anyways, even just >> >>>> provide links >> >>>> >> >>> it to >> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that >> >>>> static >> >>>> >> >>> page seems >> >>>> >> >>> > >> something we could start with while we are working on the >> >>>> dynamic >> >>>> >> >>> pages. >> >>>> >> >>> > >> >> >>>> >> >>> > >> Thanks, >> >>>> >> >>> > >> >> >>>> >> >>> > >> Jiangjie (Becket) Qin >> >>>> >> >>> > >> >> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang < >> >>>> wshaox...@gmail.com> >> >>>> >> >>> > >> wrote: >> >>>> >> >>> > >> >> >>>> >> >>> > >>> Hi Becket and Robert, >> >>>> >> >>> > >>> >> >>>> >> >>> > >>> I like this idea! Let us roll this out with Flink >> >>>> connectors at >> >>>> >> >>> the >> >>>> >> >>> > >>> first beginning. We can start with a static page, and >> >>>> upgrade it >> >>>> >> >>> when we >> >>>> >> >>> > >>> find a better solution for dynamic one with rich >> functions. >> >>>> >> >>> > >>> >> >>>> >> >>> > >>> Regards, >> >>>> >> >>> > >>> Shaoxuan >> >>>> >> >>> > >>> >> >>>> >> >>> > >>> >> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger < >> >>>> rmetz...@apache.org >> >>>> >> >>> > >> >>>> >> >>> > >>> wrote: >> >>>> >> >>> > >>> >> >>>> >> >>> > >>>> Hey Becket, >> >>>> >> >>> > >>>> >> >>>> >> >>> > >>>> This is a great idea! >> >>>> >> >>> > >>>> For this to be successful, we need to make sure the >> page >> >>>> is placed >> >>>> >> >>> > >>>> prominently so that the people submitting something >> will >> >>>> get >> >>>> >> >>> attention for >> >>>> >> >>> > >>>> their contributions. >> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we >> >>>> want >> >>>> >> >>> features >> >>>> >> >>> > >>>> such as up and downvoting or comments. >> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, >> and >> >>>> endorsed >> >>>> >> >>> by >> >>>> >> >>> > >>>> the community. >> >>>> >> >>> > >>>> >> >>>> >> >>> > >>>> Does anybody here know any existing software that we >> >>>> could use? >> >>>> >> >>> > >>>> The only think I was able to find is AUR: >> >>>> >> >>> https://aur.archlinux.org/ >> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The >> >>>> source >> >>>> >> >>> code of this >> >>>> >> >>> > >>>> portal is open source, but the layout and structure is >> >>>> not an >> >>>> >> >>> ideal fit for >> >>>> >> >>> > >>>> our requirements) >> >>>> >> >>> > >>>> >> >>>> >> >>> > >>>> Best, >> >>>> >> >>> > >>>> Robert >> >>>> >> >>> > >>>> >> >>>> >> >>> > >>>> >> >>>> >> >>> > >>>> >> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin < >> >>>> becket....@gmail.com> >> >>>> >> >>> > >>>> wrote: >> >>>> >> >>> > >>>> >> >>>> >> >>> > >>>>> Hi folks, >> >>>> >> >>> > >>>>> >> >>>> >> >>> > >>>>> I would like to start a discussion thread about >> creating >> >>>> a Flink >> >>>> >> >>> > >>>>> ecosystem website. The website aims to help >> contributors >> >>>> who >> >>>> >> >>> have developed >> >>>> >> >>> > >>>>> projects around Flink share their work with the >> >>>> community. >> >>>> >> >>> > >>>>> >> >>>> >> >>> > >>>>> Please see the following doc for more details. >> >>>> >> >>> > >>>>> >> >>>> >> >>> > >>>>> >> >>>> >> >>> >> >>>> >> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit# >> >>>> >> >>> > >>>>> >> >>>> >> >>> > >>>>> Thanks, >> >>>> >> >>> > >>>>> >> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin >> >>>> >> >>> > >>>>> >> >>>> >> >>> > >>>> >> >>>> >> >>> >> >>>> >> >> >> >>>> >> >>>> >> >>>> >> >>>> -- >> >>>> Best regards / Met vriendelijke groeten, >> >>>> >> >>>> Niels Basjes >> >>>> >> >>> >> >
