Hi Alexey, Please let me know if I can share more info on the release process. I have updated the issue confluence page on discussed approach for Ignite Extensions. Do you think the open PRs can be merged in Ignite Extensions repo?
Independent Integrations: https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations Discussion Links: https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-DiscussionLinks Tickets: https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-Tickets Regards, Saikat On Sun, Jan 26, 2020 at 3:11 PM Saikat Maitra <saikat.mai...@gmail.com> wrote: > Hi Alexey, > > As discussed I have updated the wiki with agreed solution. > > Independent Integrations: > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations > > Discussion Links: > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-DiscussionLinks > > Tickets: > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-Tickets > > Please let me know if I can share more information. > > Regards, > Saikat > > > On Fri, Jan 17, 2020 at 9:16 PM Saikat Maitra <saikat.mai...@gmail.com> > wrote: > >> Hello Alexey, >> >> Thank you for your email. >> >> 1. Yes, we discussed in dev list and agreed on creating a new repository >> for hosting our Ignite integrations. Please find the discussion thread >> below. I will update the wiki page as well and share updates. >> >> >> http://apache-ignite-developers.2346864.n4.nabble.com/DISCUSS-Proposal-for-Ignite-Extensions-as-a-separate-Bahir-module-or-Incubator-project-td44064.html >> >> 2. I was hoping to complete migration of the following modules before we >> go ahead with release. I am tracking the jira story here >> https://issues.apache.org/jira/browse/IGNITE-12355 >> >> - Flink >> - Twitter >> - Storm >> - ZeroMQ >> - RocketMQ >> - Flume >> - MQTT >> - Camel >> - JMS >> >> 3. The dependencies for modules are pointing to latest snapshot of >> ignite project and if there are changes in ignite master branch then >> related affected Ignite extensions module also need to be modified. We will >> verify all the extensions for upcoming release but release only the one >> that are impacted. We will plan to avoid publishing any extension unless >> there are changes. Here is the discussion thread on release process: >> >> >> http://apache-ignite-developers.2346864.n4.nabble.com/DISCUSS-dependencies-and-release-process-for-Ignite-Extensions-td44478.html >> >> 4. Sounds good, we can maintain a compatibility matrix to ensure we can >> share Ignite Core and related Ignite Extensions. I have seen something >> similar in Apache Beam and we can also create a similar wiki page to >> maintain Ignite Core and Ignite Extensions dependencies >> >> https://beam.apache.org/documentation/runners/capability-matrix/ >> >> Regards, >> Saikat >> >> >> >> On Fri, Jan 17, 2020 at 6:27 AM Alexey Goncharuk < >> alexey.goncha...@gmail.com> wrote: >> >>> Saikat, >>> >>> Code-wise the PR looks ok because it basically moves the module to >>> another >>> repo. I have some infrastructure/process questions though before we merge >>> the PRs >>> * I see that there are some objections from Alexey Zinoviev [1] on >>> whether >>> the streaming modules should be placed in extensions or in a separate >>> streaming project. Sorry if I missed the corresponding discussion on the >>> dev-list. If there is one, we need to edit the IEP page, if not, I think >>> we >>> should come to a consensus before making this change >>> * When are we planning to release the extensions? Are we going to >>> release >>> them one-by-one incrementally or do we want to release them in one batch? >>> * Now that the release lifecycle of Ignite and extensions is split, we >>> need to understand how this is going to be tested. Will we run a >>> candidate >>> Ignite build against already released extensions? What if we make changes >>> to both Ignite and an extension? Is it even allowed, or do we need to >>> wait >>> for an Ignite release before making any changes in an extension? >>> * I think there should be some sort of compatibility matrix now that >>> releases of Ignite and extensions are separated >>> >>> I would not delete the extension from Ignite codebase until we agree on >>> the >>> points above. >>> >>> Would you mind taking care of the discussion about it and formalizing it >>> on >>> the wiki? >>> >>> чт, 16 янв. 2020 г. в 06:27, Saikat Maitra <saikat.mai...@gmail.com>: >>> >>> > Hi Denis, Alexey >>> > >>> > Thank you so much for your email. I really appreciate it. >>> > >>> > Regards, >>> > Saikat >>> > >>> > On Wed, Jan 15, 2020 at 4:11 AM Alexey Goncharuk < >>> > alexey.goncha...@gmail.com> >>> > wrote: >>> > >>> > > Saikat, >>> > > >>> > > Thanks for working on this! I'll do my best to take a look at it this >>> > week. >>> > > >>> > > --AG >>> > > >>> > > пн, 13 янв. 2020 г. в 21:37, Denis Magda <dma...@apache.org>: >>> > > >>> > > > Alex Goncharuk, Nikolay Izhikov, >>> > > > >>> > > > Could you possibly check the changes or suggest any other >>> > > > committer/contributor for that? >>> > > > >>> > > > - >>> > > > Denis >>> > > > >>> > > > >>> > > > On Sun, Jan 12, 2020 at 9:31 AM Saikat Maitra < >>> saikat.mai...@gmail.com >>> > > >>> > > > wrote: >>> > > > >>> > > >> Hello, >>> > > >> >>> > > >> These PRs are part of Modularization effort >>> > > >> >>> > > >> >>> > > >>> > >>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations >>> > > >> >>> > > >> If the changes looks good, I can go ahead and merge the changes. >>> > > >> >>> > > >> Regards, >>> > > >> Saikat >>> > > >> >>> > > >> On Sun, Jan 5, 2020 at 1:08 PM Saikat Maitra < >>> saikat.mai...@gmail.com >>> > > >>> > > >> wrote: >>> > > >> >>> > > >> > Hi, >>> > > >> > >>> > > >> > I have raised PR for Ignite Flume migration to Ignite Extensions >>> > repo. >>> > > >> > >>> > > >> > Jira https://issues.apache.org/jira/browse/IGNITE-12361 >>> > > >> > >>> > > >> > PR https://github.com/apache/ignite-extensions/pull/4 >>> > > >> > https://github.com/apache/ignite/pull/7227 >>> > > >> > >>> > > >> > Please review and share feedback. >>> > > >> > >>> > > >> > This is part of our Modularization effort for Streamer modules >>> > > >> > >>> > > >> > https://issues.apache.org/jira/browse/IGNITE-12355 >>> > > >> > >>> > > >> > Regards, >>> > > >> > Saikat >>> > > >> > >>> > > >> >>> > > > >>> > > >>> > >>> >>
