Thanks. Do we actually want this page to be multi-language?
I propose to make the website english-only, but maybe consider allowing comments in different languages. If we would make it multi-language, then we might have problems with people submitting packages in non-english languages. On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <becket....@gmail.com> wrote: > Done. The writeup looks great! > > On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rmetz...@apache.org> > wrote: > >> Nice, really good news on the INFRA front! >> I think the hardware specs sound reasonable. And a periodic backup of the >> website's database to Infra's backup solution sounds reasonable too. >> >> Can you accept and review my proposal for the website? >> >> >> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <becket....@gmail.com> wrote: >> >>> > >>> > I have a very capable and motivated frontend developer who would be >>> > willing to implement what I've mocked in my proposal. >>> >>> >>> That is awesome! >>> >>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks >>> that >>> Apache infra team could provide a decent VM. The last piece is how to >>> ensure the data is persisted so we won't lose the project info / user >>> feedbacks when the VM is down. If Apache infra does not provide a >>> persistent storage for DB backup, we can always ask for multiple VMs and >>> do >>> the fault tolerance by ourselves. It seems we can almost say the hardware >>> side is also ready. >>> >>> Thanks, >>> >>> Jiangjie (Becket) Qin >>> >>> [1] https://issues.apache.org/jira/browse/INFRA-18010 >>> >>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rmetz...@apache.org> >>> wrote: >>> >>> > Thank you for reaching out to Infra and the ember client. >>> > When I first saw the Ember repository, I thought it is the whole thing >>> > (frontend and backend), but while testing it, I realized it is "only" >>> the >>> > frontend. I'm not sure if it makes sense to adjust the Ember observer >>> > client, or just write a simple UI from scratch. >>> > I have a very capable and motivated frontend developer who would be >>> > willing to implement what I've mocked in my proposal. >>> > In addition, I found somebody (Congxian Qiu) who seems to be eager to >>> help >>> > with this project for the backend: >>> > https://github.com/rmetzger/flink-community-tools/issues/4 >>> > >>> > For Infra: I made the same experience when asking for more GitHub >>> > permissions for "flinkbot": They didn't respond on their mailing list, >>> only >>> > on Jira. >>> > >>> > >>> > >>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <becket....@gmail.com> >>> wrote: >>> > >>> >> Thanks for writing up the specifications. >>> >> >>> >> Regarding the website source code, Austin found a website[1] whose >>> >> frontend code[2] is available publicly. It lacks some support (e.g >>> login), >>> >> but it is still a good starting point. One thing is that I did not >>> find a >>> >> License statement for that source code. I'll reach out to the author >>> to see >>> >> if they have any concern over our usage. >>> >> >>> >> Apache Infra has not replied to my email regarding some details about >>> the >>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no >>> response. >>> >> >>> >> Thanks, >>> >> >>> >> Jiangjie (Becket) Qin >>> >> >>> >> [1] https://emberobserver.com/ >>> >> [2] https://github.com/emberobserver/client >>> >> >>> >> >>> >> >>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rmetz...@apache.org> >>> >> wrote: >>> >> >>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their >>> company >>> >>> website. I guess the likelihood that they give out code from their >>> company >>> >>> website is fairly low. >>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll >>> >>> reactivate as part of this PR: >>> >>> https://github.com/apache/flink-web/pull/187 >>> >>> >>> >>> Spark-packages.org did not respond to my request. >>> >>> I will propose a short specification in Becket's initial document. >>> >>> >>> >>> >>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <ni...@basjes.nl> >>> wrote: >>> >>> >>> >>>> Hi, >>> >>>> >>> >>>> The Beam project has something in this area that is simply a page >>> >>>> within their documentation website: >>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/ >>> >>>> >>> >>>> Niels Basjes >>> >>>> >>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bowenl...@gmail.com> >>> wrote: >>> >>>> > >>> >>>> > Confluent hub for Kafka is another good example of this kind. I >>> >>>> personally like it over the spark site. May worth checking it out >>> with >>> >>>> Kafka folks >>> >>>> > >>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <becket....@gmail.com> >>> >>>> wrote: >>> >>>> >> >>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update >>> the >>> >>>> >> ecosystem page and the navigation. >>> >>>> >> >>> >>>> >> Thanks, >>> >>>> >> >>> >>>> >> Jiangjie (Becket) Qin >>> >>>> >> >>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger < >>> rmetz...@apache.org> >>> >>>> wrote: >>> >>>> >> >>> >>>> >> > Okay. I will reach out to spark-packages.org and see if they >>> are >>> >>>> willing >>> >>>> >> > to share. >>> >>>> >> > >>> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe >>> sync >>> >>>> with >>> >>>> >> > the "Software Projects" listed here: >>> >>>> >> > >>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) >>> >>>> and >>> >>>> >> > link it in the navigation? >>> >>>> >> > >>> >>>> >> > Best, >>> >>>> >> > Robert >>> >>>> >> > >>> >>>> >> > >>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin < >>> becket....@gmail.com> >>> >>>> wrote: >>> >>>> >> > >>> >>>> >> >> Hi Robert, >>> >>>> >> >> >>> >>>> >> >> I think it at least worths checking if spark-packages.org >>> owners >>> >>>> are >>> >>>> >> >> willing to share. Thanks for volunteering to write the >>> requirement >>> >>>> >> >> descriptions! In any case, that will be very helpful. >>> >>>> >> >> >>> >>>> >> >> Since a static page has almost no cost, and we will need it to >>> >>>> redirect >>> >>>> >> >> to the dynamic site anyways, how about we first do that while >>> >>>> working on >>> >>>> >> >> the dynamic website? >>> >>>> >> >> >>> >>>> >> >> Thanks, >>> >>>> >> >> >>> >>>> >> >> Jiangjie (Becket) Qin >>> >>>> >> >> >>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <u...@apache.org> >>> >>>> wrote: >>> >>>> >> >> >>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We >>> >>>> could then >>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we >>> >>>> have the >>> >>>> >> >>> resources in the community to quickly start with a dynamic >>> site, >>> >>>> I'm >>> >>>> >> >>> not apposed. >>> >>>> >> >>> >>> >>>> >> >>> – Ufuk >>> >>>> >> >>> >>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger < >>> >>>> rmetz...@apache.org> >>> >>>> >> >>> wrote: >>> >>>> >> >>> > >>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs >>> >>>> hosted by >>> >>>> >> >>> Infra >>> >>>> >> >>> > look suitable. >>> >>>> >> >>> > >>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It >>> used to >>> >>>> be >>> >>>> >> >>> linked, >>> >>>> >> >>> > but has been removed from the navigation bar for some >>> reason. >>> >>>> This is >>> >>>> >> >>> the >>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html >>> >>>> >> >>> > We could update the page and add it back to the navigation >>> bar >>> >>>> for the >>> >>>> >> >>> > coming weeks. What do you think? >>> >>>> >> >>> > >>> >>>> >> >>> > I would actually like to push for a dynamic page right >>> away. >>> >>>> >> >>> > >>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about >>> >>>> sending the >>> >>>> >> >>> > owners of spark-packages.org a short note, if they are >>> >>>> interested in >>> >>>> >> >>> > sharing the source? We could maintain the code together in >>> a >>> >>>> public >>> >>>> >> >>> repo. >>> >>>> >> >>> > If they are not interested in sharing, or we decide not to >>> ask >>> >>>> in the >>> >>>> >> >>> first >>> >>>> >> >>> > place, I'm happy to write down a short description of the >>> >>>> requirements, >>> >>>> >> >>> > maybe some mockups. We could then see if we find somebody >>> here >>> >>>> in the >>> >>>> >> >>> > community who's willing to implement it. >>> >>>> >> >>> > Given the number of people who are eager to contribute, I >>> >>>> believe we >>> >>>> >> >>> will >>> >>>> >> >>> > be able to find somebody pretty soon. >>> >>>> >> >>> > >>> >>>> >> >>> > >>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin < >>> >>>> becket....@gmail.com> >>> >>>> >> >>> wrote: >>> >>>> >> >>> > >>> >>>> >> >>> > > Forgot to provide the link... >>> >>>> >> >>> > > >>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs >>> (Apache >>> >>>> infra >>> >>>> >> >>> services) >>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD >>> Jail >>> >>>> provided >>> >>>> >> >>> by >>> >>>> >> >>> > > Apache Infra) >>> >>>> >> >>> > > >>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin < >>> >>>> becket....@gmail.com> >>> >>>> >> >>> wrote: >>> >>>> >> >>> > > >>> >>>> >> >>> > >> Hi Robert, >>> >>>> >> >>> > >> >>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We >>> should >>> >>>> absolutely >>> >>>> >> >>> > >> shoot for a dynamic website to support more >>> interactions in >>> >>>> the >>> >>>> >> >>> community. >>> >>>> >> >>> > >> There might be a few things to solve: >>> >>>> >> >>> > >> 1. The website code itself. An open source solution >>> would >>> >>>> be great. >>> >>>> >> >>> TBH, >>> >>>> >> >>> > >> I do not have much experience on building a website. >>> It'll >>> >>>> be great >>> >>>> >> >>> if >>> >>>> >> >>> > >> someone could help comment on the solution here. >>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra >>> provides >>> >>>> a few >>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did >>> not see >>> >>>> >> >>> database >>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in >>> FreeBSD >>> >>>> jail[2]. >>> >>>> >> >>> > >> >>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback! >>> >>>> >> >>> > >> >>> >>>> >> >>> > >> @Shaoxuan Wang <wshaox...@gmail.com> >>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to >>> me. We >>> >>>> >> >>> probably need >>> >>>> >> >>> > >> a page in the Flink official site anyways, even just >>> >>>> provide links >>> >>>> >> >>> it to >>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that >>> >>>> static >>> >>>> >> >>> page seems >>> >>>> >> >>> > >> something we could start with while we are working on >>> the >>> >>>> dynamic >>> >>>> >> >>> pages. >>> >>>> >> >>> > >> >>> >>>> >> >>> > >> Thanks, >>> >>>> >> >>> > >> >>> >>>> >> >>> > >> Jiangjie (Becket) Qin >>> >>>> >> >>> > >> >>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang < >>> >>>> wshaox...@gmail.com> >>> >>>> >> >>> > >> wrote: >>> >>>> >> >>> > >> >>> >>>> >> >>> > >>> Hi Becket and Robert, >>> >>>> >> >>> > >>> >>> >>>> >> >>> > >>> I like this idea! Let us roll this out with Flink >>> >>>> connectors at >>> >>>> >> >>> the >>> >>>> >> >>> > >>> first beginning. We can start with a static page, and >>> >>>> upgrade it >>> >>>> >> >>> when we >>> >>>> >> >>> > >>> find a better solution for dynamic one with rich >>> functions. >>> >>>> >> >>> > >>> >>> >>>> >> >>> > >>> Regards, >>> >>>> >> >>> > >>> Shaoxuan >>> >>>> >> >>> > >>> >>> >>>> >> >>> > >>> >>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger < >>> >>>> rmetz...@apache.org >>> >>>> >> >>> > >>> >>>> >> >>> > >>> wrote: >>> >>>> >> >>> > >>> >>> >>>> >> >>> > >>>> Hey Becket, >>> >>>> >> >>> > >>>> >>> >>>> >> >>> > >>>> This is a great idea! >>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the >>> page >>> >>>> is placed >>> >>>> >> >>> > >>>> prominently so that the people submitting something >>> will >>> >>>> get >>> >>>> >> >>> attention for >>> >>>> >> >>> > >>>> their contributions. >>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we >>> >>>> want >>> >>>> >> >>> features >>> >>>> >> >>> > >>>> such as up and downvoting or comments. >>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, >>> and >>> >>>> endorsed >>> >>>> >> >>> by >>> >>>> >> >>> > >>>> the community. >>> >>>> >> >>> > >>>> >>> >>>> >> >>> > >>>> Does anybody here know any existing software that we >>> >>>> could use? >>> >>>> >> >>> > >>>> The only think I was able to find is AUR: >>> >>>> >> >>> https://aur.archlinux.org/ >>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux. >>> The >>> >>>> source >>> >>>> >> >>> code of this >>> >>>> >> >>> > >>>> portal is open source, but the layout and structure is >>> >>>> not an >>> >>>> >> >>> ideal fit for >>> >>>> >> >>> > >>>> our requirements) >>> >>>> >> >>> > >>>> >>> >>>> >> >>> > >>>> Best, >>> >>>> >> >>> > >>>> Robert >>> >>>> >> >>> > >>>> >>> >>>> >> >>> > >>>> >>> >>>> >> >>> > >>>> >>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin < >>> >>>> becket....@gmail.com> >>> >>>> >> >>> > >>>> wrote: >>> >>>> >> >>> > >>>> >>> >>>> >> >>> > >>>>> Hi folks, >>> >>>> >> >>> > >>>>> >>> >>>> >> >>> > >>>>> I would like to start a discussion thread about >>> creating >>> >>>> a Flink >>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help >>> contributors >>> >>>> who >>> >>>> >> >>> have developed >>> >>>> >> >>> > >>>>> projects around Flink share their work with the >>> >>>> community. >>> >>>> >> >>> > >>>>> >>> >>>> >> >>> > >>>>> Please see the following doc for more details. >>> >>>> >> >>> > >>>>> >>> >>>> >> >>> > >>>>> >>> >>>> >> >>> >>> >>>> >>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit# >>> >>>> >> >>> > >>>>> >>> >>>> >> >>> > >>>>> Thanks, >>> >>>> >> >>> > >>>>> >>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin >>> >>>> >> >>> > >>>>> >>> >>>> >> >>> > >>>> >>> >>>> >> >>> >>> >>>> >> >> >>> >>>> >>> >>>> >>> >>>> >>> >>>> -- >>> >>>> Best regards / Met vriendelijke groeten, >>> >>>> >>> >>>> Niels Basjes >>> >>>> >>> >>> >>> >>
