Hi Emmanouil, I have added you as contributor in Ignite Extensions project. Can you please check and confirm if you are able to see the project and execute build on your pull request.
Regards, Saikat On Tue, Nov 26, 2019 at 12:49 PM Emmanouil Gkatziouras <gkatzio...@gmail.com> wrote: > Hi all! > > If someone could give me read access to the Job of Ignite Extensions on > Team City will greatly help me (username gkatzioura). > I suppose the builds get triggered automatically on a pull request. > > Kind regards, > Emmanouil > > *Emmanouil Gkatziouras* > https://egkatzioura.com/ | > https://www.linkedin.com/in/gkatziourasemmanouil/ > https://github.com/gkatzioura > > > On Sun, 24 Nov 2019 at 21:11, Emmanouil Gkatziouras <gkatzio...@gmail.com> > wrote: > > > Hi Saikat! > > > > I just rebased with the flink branch. Unfortunately I do not have read > > access to the team city link you provided and thus evaluate the tests for > > my pull request. > > I guess it has to do with ignite extensions being new. > > My username is gkatzioura and email the one I am using on this email > > > > Thank you for your time. > > > > > > *Emmanouil Gkatziouras* > > https://egkatzioura.com/ | > > https://www.linkedin.com/in/gkatziourasemmanouil/ > > https://github.com/gkatzioura > > > > > > On Sun, 24 Nov 2019 at 18:03, Saikat Maitra <saikat.mai...@gmail.com> > > wrote: > > > >> Hi Emmanouil, > >> > >> The latest build on teamcity has passed on Flink pull request. > >> > >> > >> > https://ci.ignite.apache.org/viewLog.html?buildId=4788928&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead > >> > >> you should be able to take the changes I made in my PR and run build on > >> your pull request. > >> > >> Please let me know if you have any questions. > >> > >> Regards, > >> Saikat > >> > >> On Sun, Nov 24, 2019 at 10:44 AM Saikat Maitra <saikat.mai...@gmail.com > > > >> wrote: > >> > >> > Hi Emmanouil, > >> > > >> > I have fixed the Flink module testsuites and have setup new project in > >> > teamcity. > >> > > >> > > >> > > >> > https://ci.ignite.apache.org/project.html?projectId=IgniteExtensions&tab=projectOverview > >> > > >> > I am looking into setting up the build. > >> > > >> > Regards, > >> > Saikat > >> > > >> > On Sat, Nov 23, 2019 at 9:52 AM Saikat Maitra < > saikat.mai...@gmail.com> > >> > wrote: > >> > > >> >> Hi Emmanouil, > >> >> > >> >> Thank you for your email. Yes, the plan is once the Flink PR is > merged > >> it > >> >> will provide the Licence, parent POMs etc and you can rebase from > >> master > >> >> branch and apply the changes on top of it. > >> >> > >> >> I am getting some issues with test failures in local with > >> >> GridTestProperties as the test.properties is not present in this new > >> >> project but should be available from dependencies. > >> >> > >> >> Once I address this issue, I will go ahead and merge the changes and > >> then > >> >> we can take it from there. > >> >> > >> >> Regards, > >> >> Saikat > >> >> > >> >> On Fri, Nov 22, 2019 at 5:23 PM Emmanouil Gkatziouras < > >> >> gkatzio...@gmail.com> wrote: > >> >> > >> >>> Hi all, > >> >>> > >> >>> I made my first pull request [1]. Since this project is brand new > (no > >> >>> parent poms, licensing), I reckoned it was best to use Saikat's > >> branch on > >> >>> Flink. > >> >>> I suppose the Flink branch will be merged first. If not please give > me > >> >>> guidelines on how I should proceed next. > >> >>> > >> >>> Kind regards > >> >>> Emmanouil > >> >>> > >> >>> [1] https://github.com/apache/ignite-extensions/pull/2 > >> >>> > >> >>> *Emmanouil Gkatziouras* > >> >>> https://egkatzioura.com/ | > >> >>> https://www.linkedin.com/in/gkatziourasemmanouil/ > >> >>> https://github.com/gkatzioura > >> >>> > >> >>> > >> >>> On Fri, 22 Nov 2019 at 20:55, Denis Magda <dma...@apache.org> > wrote: > >> >>> > >> >>> > Awesome, ping us whenever you're ready! > >> >>> > > >> >>> > - > >> >>> > Denis > >> >>> > > >> >>> > > >> >>> > On Fri, Nov 22, 2019 at 12:52 PM Emmanouil Gkatziouras < > >> >>> > gkatzio...@gmail.com> > >> >>> > wrote: > >> >>> > > >> >>> > > Hi all! > >> >>> > > > >> >>> > > I am sorry for being late on that. I was trying to refactor the > >> test > >> >>> in > >> >>> > > order not to be in need of any external tools or spinning up a > >> >>> server. > >> >>> > > I did forked the new repo and indeed my changes there, so a pull > >> >>> request > >> >>> > is > >> >>> > > a matter of time! > >> >>> > > > >> >>> > > Kind regards > >> >>> > > > >> >>> > > *Emmanouil Gkatziouras* > >> >>> > > https://egkatzioura.com/ | > >> >>> > > https://www.linkedin.com/in/gkatziourasemmanouil/ > >> >>> > > https://github.com/gkatzioura > >> >>> > > > >> >>> > > > >> >>> > > On Fri, 22 Nov 2019 at 20:45, Denis Magda <dma...@apache.org> > >> wrote: > >> >>> > > > >> >>> > > > Hi Emmanouil, > >> >>> > > > > >> >>> > > > Do you have any questions or need any support from the > >> community? > >> >>> > > > > >> >>> > > > - > >> >>> > > > Denis > >> >>> > > > > >> >>> > > > > >> >>> > > > On Sun, Nov 10, 2019 at 3:07 PM Saikat Maitra < > >> >>> saikat.mai...@gmail.com > >> >>> > > > >> >>> > > > wrote: > >> >>> > > > > >> >>> > > >> Hi Emmanouil, > >> >>> > > >> > >> >>> > > >> Can you please take a looks at dev utils, if this is > something > >> >>> you are > >> >>> > > >> looking for > >> >>> > > >> > https://github.com/apache/ignite/tree/master/modules/dev-utils > >> ? > >> >>> > > >> > >> >>> > > >> IMO, if you can release Pub/Sub server in maven and then use > >> it as > >> >>> > > >> dependency, that would be great. > >> >>> > > >> > >> >>> > > >> Regards, > >> >>> > > >> Saikat > >> >>> > > >> > >> >>> > > >> On Sun, Nov 10, 2019 at 5:00 PM Saikat Maitra < > >> >>> > saikat.mai...@gmail.com> > >> >>> > > >> wrote: > >> >>> > > >> > >> >>> > > >> > Hi Emmanouil, > >> >>> > > >> > > >> >>> > > >> > The master branch has been initialized. I have raised a PR > to > >> >>> > migrate > >> >>> > > >> > Flink module to ignite-extensions. > >> >>> > > >> > > >> >>> > > >> > PR https://github.com/apache/ignite-extensions/pull/1 > >> >>> > > >> > Jira : https://issues.apache.org/jira/browse/IGNITE-12356 > >> >>> > > >> > > >> >>> > > >> > Regards, > >> >>> > > >> > Saikat > >> >>> > > >> > > >> >>> > > >> > > >> >>> > > >> > On Sun, Nov 10, 2019 at 3:39 PM Emmanouil Gkatziouras < > >> >>> > > >> > gkatzio...@gmail.com> wrote: > >> >>> > > >> > > >> >>> > > >> >> Hi all! > >> >>> > > >> >> > >> >>> > > >> >> This is an update. The integration is tested with mocks > >> based > >> >>> on > >> >>> > the > >> >>> > > >> >> original Ignite repo [1]. > >> >>> > > >> >> I am currently waiting for the first commits on the new > >> >>> integration > >> >>> > > >> >> project > >> >>> > > >> >> to take place in order to create my pull request > accordingly > >> >>> to the > >> >>> > > >> >> initial > >> >>> > > >> >> commits. > >> >>> > > >> >> In order to simulate the Pub/Sub server in a test I used a > >> test > >> >>> > > server > >> >>> > > >> >> implementation [2]. Unfortunately they don't have this > util > >> >>> > uploaded > >> >>> > > >> in a > >> >>> > > >> >> maven repo, thus it needs to be hosted on a maven repo > >> (Apache > >> >>> > > License > >> >>> > > >> >> 2.0). Is there a repo for utilities that Ignite uses for > the > >> >>> > > >> test/build? > >> >>> > > >> >> I have also created a ticket [3] > >> >>> > > >> >> > >> >>> > > >> >> Kind regards > >> >>> > > >> >> > >> >>> > > >> >> [1] > >> >>> > https://github.com/gkatzioura/ignite/tree/pubsub/modules/pubsub > >> >>> > > >> >> [2] > >> >>> https://github.com/GoogleCloudPlatform/kafka-pubsub-emulator > >> >>> > > >> >> [3] https://issues.apache.org/jira/browse/IGNITE-12262 > >> >>> > > >> >> > >> >>> > > >> >> *Emmanouil Gkatziouras* > >> >>> > > >> >> https://egkatzioura.com/ | > >> >>> > > >> >> https://www.linkedin.com/in/gkatziourasemmanouil/ > >> >>> > > >> >> https://github.com/gkatzioura > >> >>> > > >> >> > >> >>> > > >> >> > >> >>> > > >> >> On Fri, 25 Oct 2019 at 03:35, Saikat Maitra < > >> >>> > saikat.mai...@gmail.com > >> >>> > > > > >> >>> > > >> >> wrote: > >> >>> > > >> >> > >> >>> > > >> >> > Hello Ilya, > >> >>> > > >> >> > > >> >>> > > >> >> > Thank you for your email. Yes, before we remove any > >> >>> integration > >> >>> > we > >> >>> > > >> will > >> >>> > > >> >> > move them to another repository and release. > >> >>> > > >> >> > > >> >>> > > >> >> > We are thinking we will start with Pub/Sub Streamer > >> >>> > implementation > >> >>> > > >> and > >> >>> > > >> >> > continue to move other integration as mentioned in the > >> >>> following > >> >>> > > doc. > >> >>> > > >> >> > > >> >>> > > >> >> > > >> >>> > > >> >> > > >> >>> > > >> >> > >> >>> > > >> > >> >>> > > > >> >>> > > >> >>> > >> > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations > >> >>> > > >> >> > > >> >>> > > >> >> > Regards, > >> >>> > > >> >> > Saikat > >> >>> > > >> >> > > >> >>> > > >> >> > > >> >>> > > >> >> > On Thu, Oct 24, 2019 at 11:00 AM Ilya Kasnacheev < > >> >>> > > >> >> > ilya.kasnach...@gmail.com> > >> >>> > > >> >> > wrote: > >> >>> > > >> >> > > >> >>> > > >> >> > > Hello! > >> >>> > > >> >> > > > >> >>> > > >> >> > > My take on this: we want to offload some of > >> integrations, > >> >>> but > >> >>> > > >> please > >> >>> > > >> >> > commit > >> >>> > > >> >> > > and release them to another project first, and only > >> then we > >> >>> > will > >> >>> > > >> >> decide > >> >>> > > >> >> > to > >> >>> > > >> >> > > remove them from our repository. > >> >>> > > >> >> > > > >> >>> > > >> >> > > Please also make sure they are available with same > >> artifact > >> >>> > name > >> >>> > > >> and > >> >>> > > >> >> API. > >> >>> > > >> >> > > If this has to be changed, let's wait for AI 3.0 > >> >>> > > >> >> > > > >> >>> > > >> >> > > Regards, > >> >>> > > >> >> > > -- > >> >>> > > >> >> > > Ilya Kasnacheev > >> >>> > > >> >> > > > >> >>> > > >> >> > > > >> >>> > > >> >> > > ср, 23 окт. 2019 г. в 03:23, Saikat Maitra < > >> >>> > > >> saikat.mai...@gmail.com>: > >> >>> > > >> >> > > > >> >>> > > >> >> > > > Hello Emmanouil, > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > As discussed earlier, I discussed with Apache Bahir > >> >>> community > >> >>> > > and > >> >>> > > >> >> they > >> >>> > > >> >> > > are > >> >>> > > >> >> > > > interested to have Apache Ignite extensions as part > of > >> >>> Apache > >> >>> > > >> Bahir > >> >>> > > >> >> > > > project. > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > Can you please share Pub/Sub streamer implementation > >> >>> details > >> >>> > > with > >> >>> > > >> >> > Apache > >> >>> > > >> >> > > > Bahir community and request for feedback. > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > https://bahir.apache.org/ > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > I have also requested for contributor access in Jira > >> for > >> >>> > Apache > >> >>> > > >> >> Bahir > >> >>> > > >> >> > > > project so that I can create issues and assign to > >> myself. > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > I can help with code reviews as well. > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > Here is the email thread for reference > >> >>> > > >> >> > > > > >> >>> > > https://www.mail-archive.com/dev@bahir.apache.org/msg02703.html > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > Regards, > >> >>> > > >> >> > > > Saikat > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > On Mon, Oct 21, 2019 at 7:54 PM Saikat Maitra < > >> >>> > > >> >> saikat.mai...@gmail.com > >> >>> > > >> >> > > > >> >>> > > >> >> > > > wrote: > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > Hello, > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > As discussed I have created following discussion > >> >>> threads on > >> >>> > > our > >> >>> > > >> >> > > migration > >> >>> > > >> >> > > > > proposals for Apache Ignite extensions: > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > >> >>> > > >> >> > > >> >>> > > >> >> > >> >>> > > >> > >> >>> > > > >> >>> > > >> >>> > >> > http://apache-ignite-users.70518.x6.nabble.com/DISCUSS-Proposal-for-Ignite-Extensions-as-a-separate-Bahir-module-or-Incubator-project-td29829.html > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> > >> https://www.mail-archive.com/dev@bahir.apache.org/msg02703.html > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > I will share update as I hear more information. > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > Regards, > >> >>> > > >> >> > > > > Saikat > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > On Fri, Oct 18, 2019 at 9:03 PM Saikat Maitra < > >> >>> > > >> >> > saikat.mai...@gmail.com > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > > wrote: > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > >> Hello Denis, > >> >>> > > >> >> > > > >> > >> >>> > > >> >> > > > >> Sure, sounds good. I will create a separate > >> discussion > >> >>> > > thread > >> >>> > > >> to > >> >>> > > >> >> get > >> >>> > > >> >> > > > >> community feedback on whether we > >> >>> > > >> >> > > > >> should join the Bahir or kick-off "Ignite > >> Extensions" > >> >>> > > project. > >> >>> > > >> >> > > > >> > >> >>> > > >> >> > > > >> Regards, > >> >>> > > >> >> > > > >> Saikat > >> >>> > > >> >> > > > >> > >> >>> > > >> >> > > > >> On Thu, Oct 17, 2019 at 2:21 PM Denis Magda < > >> >>> > > >> dma...@apache.org> > >> >>> > > >> >> > > wrote: > >> >>> > > >> >> > > > >> > >> >>> > > >> >> > > > >>> Folks, > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >>> The concept of Apache Bahir is precisely what we > >> >>> need! > >> >>> > > >> Saikat, > >> >>> > > >> >> > thanks > >> >>> > > >> >> > > > for > >> >>> > > >> >> > > > >>> doing the research. Why I believe the * idea* > >> fits us > >> >>> > well: > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >>> - All integrations can be stored in separate > >> >>> Github > >> >>> > > >> >> repositories > >> >>> > > >> >> > > and > >> >>> > > >> >> > > > >>> have their dev lifecycles. We've not obliged > to > >> >>> couple > >> >>> > > all > >> >>> > > >> >> the > >> >>> > > >> >> > > > >>> integrations > >> >>> > > >> >> > > > >>> in a single repo. For instance, Spark can be > >> >>> located > >> >>> > in > >> >>> > > a > >> >>> > > >> >> > > dedicated > >> >>> > > >> >> > > > >>> repo > >> >>> > > >> >> > > > >>> while streaming integrations might be in a > >> single > >> >>> one. > >> >>> > > >> It's > >> >>> > > >> >> up > >> >>> > > >> >> > to > >> >>> > > >> >> > > > us. > >> >>> > > >> >> > > > >>> - All the repositories and integrations > belong > >> to > >> >>> ASF. > >> >>> > > >> We're > >> >>> > > >> >> not > >> >>> > > >> >> > > > >>> dumping > >> >>> > > >> >> > > > >>> them on Github but rather keep supporting and > >> >>> > developing > >> >>> > > >> in > >> >>> > > >> >> > > > >>> accordance with > >> >>> > > >> >> > > > >>> ASF vision and practices. > >> >>> > > >> >> > > > >>> - There is a way to reward contributors via > >> >>> > > committership > >> >>> > > >> and > >> >>> > > >> >> > PMC > >> >>> > > >> >> > > > >>> membership. You won't get this if a project > is > >> >>> just > >> >>> > one > >> >>> > > of > >> >>> > > >> >> the > >> >>> > > >> >> > > > >>> millions of > >> >>> > > >> >> > > > >>> Github projects. > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >>> Saikat, as Ignite PMC member, could you please > >> >>> kick-off a > >> >>> > > >> >> separate > >> >>> > > >> >> > > > >>> dev-list > >> >>> > > >> >> > > > >>> discussion to involve more community members and > >> >>> > referring > >> >>> > > to > >> >>> > > >> >> this > >> >>> > > >> >> > > > >>> thread? > >> >>> > > >> >> > > > >>> I think the primary question the community needs > >> to > >> >>> > answer > >> >>> > > >> >> whether > >> >>> > > >> >> > we > >> >>> > > >> >> > > > >>> should join the Bahir or kick-off "Ignite > >> Extensions" > >> >>> > > >> project? > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >>> - > >> >>> > > >> >> > > > >>> Denis > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >>> On Thu, Oct 17, 2019 at 2:54 AM Alexey Zinoviev > < > >> >>> > > >> >> > > > zaleslaw....@gmail.com> > >> >>> > > >> >> > > > >>> wrote: > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >>> > Maybe we could move all our Streaming > >> Integrations > >> >>> > there, > >> >>> > > >> but > >> >>> > > >> >> > what > >> >>> > > >> >> > > is > >> >>> > > >> >> > > > >>> about > >> >>> > > >> >> > > > >>> > maintaining and committer permissions to the > new > >> >>> > > >> repositories? > >> >>> > > >> >> > > > >>> > I see the list of the committers and PMC > members > >> >>> there > >> >>> > > >> >> > > > >>> > https://bahir.apache.org/community-members/ > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > Could somebody from Ignite community be added > to > >> >>> this > >> >>> > > list > >> >>> > > >> as > >> >>> > > >> >> a > >> >>> > > >> >> > > > >>> > PMC/committer to maintain Ignite integrations? > >> >>> > > >> >> > > > >>> > If yes, I'd happy to join this project and > >> >>> collaborate > >> >>> > > with > >> >>> > > >> >> these > >> >>> > > >> >> > > > guys > >> >>> > > >> >> > > > >>> > together > >> >>> > > >> >> > > > >>> > If no, and we should start from the zero level > >> with > >> >>> > > >> external > >> >>> > > >> >> PRs > >> >>> > > >> >> > - > >> >>> > > >> >> > > > >>> hmmm, > >> >>> > > >> >> > > > >>> > it's better to have our own external > repository > >> >>> with > >> >>> > > >> >> ApacheBahirr > >> >>> > > >> >> > > > >>> ideology. > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > Also, I agree, that all connectors could be > >> moved > >> >>> there > >> >>> > > (in > >> >>> > > >> >> > > > >>> ApacheBahirr > >> >>> > > >> >> > > > >>> > like repository), but not all modules from the > >> page > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > >> >>> > > >> >> > > >> >>> > > >> >> > >> >>> > > >> > >> >>> > > > >> >>> > > >> >>> > >> > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations > >> >>> > > >> >> > > > >>> > because > >> >>> > > >> >> > > > >>> > they use different parts of core modules and > >> could > >> >>> be > >> >>> > > >> >> developed > >> >>> > > >> >> > > with > >> >>> > > >> >> > > > >>> > different velocity. > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > In reality, before creation of new > repositories > >> we > >> >>> need > >> >>> > > >> wide > >> >>> > > >> >> > > > discussion > >> >>> > > >> >> > > > >>> > based on the document mentioned above. > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > P.S. Of course, we could experiment in the > next > >> >>> release > >> >>> > > 2.8 > >> >>> > > >> >> with > >> >>> > > >> >> > > one > >> >>> > > >> >> > > > >>> or two > >> >>> > > >> >> > > > >>> > integrations like twitter or ZeroMQ > >> >>> > > >> >> > > > >>> > Also, I'd like Denis Magda idea for the > separate > >> >>> > > >> repositories > >> >>> > > >> >> in > >> >>> > > >> >> > > > Apache > >> >>> > > >> >> > > > >>> > Github to maintain them by anybody. > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > чт, 17 окт. 2019 г. в 05:02, Saikat Maitra < > >> >>> > > >> >> > > saikat.mai...@gmail.com > >> >>> > > >> >> > > > >: > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > > Hi Denis, Emmanouil > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > Thank you for your email. I think creating a > >> >>> separate > >> >>> > > >> >> > integration > >> >>> > > >> >> > > > >>> project > >> >>> > > >> >> > > > >>> > > in github and also proposing it as an apache > >> >>> > incubator > >> >>> > > >> >> project > >> >>> > > >> >> > > will > >> >>> > > >> >> > > > >>> be a > >> >>> > > >> >> > > > >>> > > good move. The other separate integration > >> modules > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > >> >>> > > >> >> > > >> >>> > > >> >> > >> >>> > > >> > >> >>> > > > >> >>> > > >> >>> > >> > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations > >> >>> > > >> >> > > > >>> > > can > >> >>> > > >> >> > > > >>> > > be moved to this new apache incubator > project. > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > There are similar integration available for > >> >>> Flink and > >> >>> > > >> Spark > >> >>> > > >> >> in > >> >>> > > >> >> > > > Apache > >> >>> > > >> >> > > > >>> > Bahir > >> >>> > > >> >> > > > >>> > > https://bahir.apache.org/ > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > Do you think we should reach out to Apache > >> Bahir > >> >>> > > >> community > >> >>> > > >> >> > with a > >> >>> > > >> >> > > > >>> > proposal > >> >>> > > >> >> > > > >>> > > or we should plan to create a separate > Apache > >> >>> > Incubator > >> >>> > > >> >> > project? > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > Regards, > >> >>> > > >> >> > > > >>> > > Saikat > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > On Wed, Oct 16, 2019 at 6:21 AM Emmanouil > >> >>> > Gkatziouras < > >> >>> > > >> >> > > > >>> > > gkatzio...@gmail.com> > >> >>> > > >> >> > > > >>> > > wrote: > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > > Hi all! > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > Based on the discussions most probably > this > >> is > >> >>> > going > >> >>> > > to > >> >>> > > >> >> be on > >> >>> > > >> >> > > > >>> another > >> >>> > > >> >> > > > >>> > > > GitHub repo. Therefore I will prepare a > >> >>> standalone > >> >>> > > >> project > >> >>> > > >> >> > with > >> >>> > > >> >> > > > the > >> >>> > > >> >> > > > >>> > > Pub/Sub > >> >>> > > >> >> > > > >>> > > > module and once the repository is created > a > >> >>> pull > >> >>> > > >> request > >> >>> > > >> >> > shall > >> >>> > > >> >> > > be > >> >>> > > >> >> > > > >>> > issued. > >> >>> > > >> >> > > > >>> > > > If there is anything else I can do in > order > >> to > >> >>> > > >> facilitate > >> >>> > > >> >> > this > >> >>> > > >> >> > > > >>> please > >> >>> > > >> >> > > > >>> > let > >> >>> > > >> >> > > > >>> > > > me know. > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > If a ticket is created for this issue, I > >> shall > >> >>> be > >> >>> > > able > >> >>> > > >> to > >> >>> > > >> >> > > create > >> >>> > > >> >> > > > a > >> >>> > > >> >> > > > >>> pull > >> >>> > > >> >> > > > >>> > > > request and thus a build will take place > on > >> >>> > ignite's > >> >>> > > >> CI. > >> >>> > > >> >> > > > >>> > > > If everyone is aligned with adding a > Pub/Sub > >> >>> > > >> >> implementation > >> >>> > > >> >> > > may I > >> >>> > > >> >> > > > >>> > create > >> >>> > > >> >> > > > >>> > > a > >> >>> > > >> >> > > > >>> > > > ticket on JIRA? > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > My next question has to do on how Ignite > >> >>> configures > >> >>> > > the > >> >>> > > >> >> build > >> >>> > > >> >> > > > jobs > >> >>> > > >> >> > > > >>> in > >> >>> > > >> >> > > > >>> > > Team > >> >>> > > >> >> > > > >>> > > > City. The unit tests for my implementation > >> >>> need a > >> >>> > > local > >> >>> > > >> >> > Pub/Sub > >> >>> > > >> >> > > > >>> server > >> >>> > > >> >> > > > >>> > up > >> >>> > > >> >> > > > >>> > > > and running (they provide one for testing > >> >>> > purposes). > >> >>> > > >> Will > >> >>> > > >> >> > this > >> >>> > > >> >> > > > take > >> >>> > > >> >> > > > >>> > > effect > >> >>> > > >> >> > > > >>> > > > in a form of a build script inside my > >> >>> > implementation > >> >>> > > or > >> >>> > > >> >> is it > >> >>> > > >> >> > > > >>> something > >> >>> > > >> >> > > > >>> > > > that should be configured on Team City? > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > Kind regards, > >> >>> > > >> >> > > > >>> > > > Emmanouil > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > *Emmanouil Gkatziouras* > >> >>> > > >> >> > > > >>> > > > https://egkatzioura.com/ | > >> >>> > > >> >> > > > >>> > > > > >> >>> https://www.linkedin.com/in/gkatziourasemmanouil/ > >> >>> > > >> >> > > > >>> > > > https://github.com/gkatzioura > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > On Tue, 15 Oct 2019 at 23:27, Denis Magda > < > >> >>> > > >> >> dma...@apache.org > >> >>> > > >> >> > > > >> >>> > > >> >> > > > >>> wrote: > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > > Emmanouil, Saikat, > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > After contemplating on this, let me > >> propose > >> >>> > another > >> >>> > > >> way > >> >>> > > >> >> > with > >> >>> > > >> >> > > > this > >> >>> > > >> >> > > > >>> > > > > particular integration that is aligned > >> with > >> >>> our > >> >>> > > >> >> > > modularization > >> >>> > > >> >> > > > >>> > > endeavor. > >> >>> > > >> >> > > > >>> > > > > The modularization [1] defines the > Ignite > >> >>> core, > >> >>> > > >> Ignite > >> >>> > > >> >> > > modules, > >> >>> > > >> >> > > > >>> and > >> >>> > > >> >> > > > >>> > > > > independent integrations. The first two > >> are > >> >>> to be > >> >>> > > >> >> located > >> >>> > > >> >> > in > >> >>> > > >> >> > > > >>> Ignite > >> >>> > > >> >> > > > >>> > > > > repositories and to be tested/updated by > >> the > >> >>> > > >> community > >> >>> > > >> >> for > >> >>> > > >> >> > > > every > >> >>> > > >> >> > > > >>> > > release. > >> >>> > > >> >> > > > >>> > > > > The modules are a subset of existing > >> >>> integrations > >> >>> > > >> that > >> >>> > > >> >> are > >> >>> > > >> >> > > > >>> adopted > >> >>> > > >> >> > > > >>> > > widely > >> >>> > > >> >> > > > >>> > > > > and require community attention. > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > As for the independent integrations [1], > >> >>> those > >> >>> > are > >> >>> > > >> >> supposed > >> >>> > > >> >> > > to > >> >>> > > >> >> > > > be > >> >>> > > >> >> > > > >>> > > located > >> >>> > > >> >> > > > >>> > > > > in a separate GitHub repo. I would > advise > >> us > >> >>> to > >> >>> > > start > >> >>> > > >> >> > > > >>> implementing > >> >>> > > >> >> > > > >>> > this > >> >>> > > >> >> > > > >>> > > > > concept with the Pub/Sub integration. > Even > >> >>> though > >> >>> > > it > >> >>> > > >> >> will > >> >>> > > >> >> > be > >> >>> > > >> >> > > > >>> located > >> >>> > > >> >> > > > >>> > > in a > >> >>> > > >> >> > > > >>> > > > > separate Github repo, it will be listed > >> among > >> >>> > > >> officially > >> >>> > > >> >> > > > >>> available > >> >>> > > >> >> > > > >>> > > > > integrations on the Ignite website > >> featuring > >> >>> > > >> Emmanouil > >> >>> > > >> >> as a > >> >>> > > >> >> > > > >>> > > contributor. > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > What do you think? > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > [1] > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > >> >>> > > >> >> > > >> >>> > > >> >> > >> >>> > > >> > >> >>> > > > >> >>> > > >> >>> > >> > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > - > >> >>> > > >> >> > > > >>> > > > > Denis > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > On Mon, Oct 14, 2019 at 9:47 PM Saikat > >> >>> Maitra < > >> >>> > > >> >> > > > >>> > saikat.mai...@gmail.com > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > > wrote: > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > Hi Emmanouil, > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > The changes looks good to me. I wanted > >> to > >> >>> check > >> >>> > > if > >> >>> > > >> you > >> >>> > > >> >> > are > >> >>> > > >> >> > > > also > >> >>> > > >> >> > > > >>> > able > >> >>> > > >> >> > > > >>> > > to > >> >>> > > >> >> > > > >>> > > > > > validate that the once data is added > to > >> >>> Ignite > >> >>> > > >> cluster > >> >>> > > >> >> > you > >> >>> > > >> >> > > > are > >> >>> > > >> >> > > > >>> also > >> >>> > > >> >> > > > >>> > > > able > >> >>> > > >> >> > > > >>> > > > > to > >> >>> > > >> >> > > > >>> > > > > > access it using another Ignite client > or > >> >>> using > >> >>> > > rest > >> >>> > > >> >> > > > endpoints. > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > We use Teamcity for CI process, the > >> >>> details are > >> >>> > > as > >> >>> > > >> >> > follows > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > Trigger validation of those test > suites > >> >>> that > >> >>> > have > >> >>> > > >> been > >> >>> > > >> >> > > > >>> affected by > >> >>> > > >> >> > > > >>> > > your > >> >>> > > >> >> > > > >>> > > > > > changes on TeamCity < > >> >>> > > http://ci.ignite.apache.org/>: > >> >>> > > >> < > >> >>> > > >> >> > > > >>> > > > > http://204.14.53.153/ > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > - Locate a test suite you have to > >> check, > >> >>> > press > >> >>> > > >> >> button > >> >>> > > >> >> > > > named > >> >>> > > >> >> > > > >>> > "..." > >> >>> > > >> >> > > > >>> > > > that > >> >>> > > >> >> > > > >>> > > > > > is located on the left of "Run" > >> button. > >> >>> "Run > >> >>> > > >> custom > >> >>> > > >> >> > > build" > >> >>> > > >> >> > > > >>> > dialog > >> >>> > > >> >> > > > >>> > > > will > >> >>> > > >> >> > > > >>> > > > > > appear; > >> >>> > > >> >> > > > >>> > > > > > - Go to "Changes" tab and choose > >> >>> > > >> >> > > > >>> > "pull/<pull-request-number>/head" > >> >>> > > >> >> > > > >>> > > > in > >> >>> > > >> >> > > > >>> > > > > > "Build branch" dropdown list; > >> >>> > > >> >> > > > >>> > > > > > - Press "Run build" button and > >> monitor > >> >>> tests > >> >>> > > >> >> results. > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > @Roman rsht...@yahoo.com - can you > also > >> >>> please > >> >>> > > >> take a > >> >>> > > >> >> > > look? > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > Regards, > >> >>> > > >> >> > > > >>> > > > > > Saikat > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > On Sun, Oct 13, 2019 at 6:20 PM > >> Emmanouil > >> >>> > > >> Gkatziouras > >> >>> > > >> >> < > >> >>> > > >> >> > > > >>> > > > > > gkatzio...@gmail.com> > >> >>> > > >> >> > > > >>> > > > > > wrote: > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > > Hi @Saikat Maitra > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > I have my implementation on an > Ignite > >> >>> fork on > >> >>> > > my > >> >>> > > >> >> > personal > >> >>> > > >> >> > > > >>> GitHub > >> >>> > > >> >> > > > >>> > > > > account > >> >>> > > >> >> > > > >>> > > > > > > [1] > >> >>> > > >> >> > > > >>> > > > > > > It is based on the Kafka > >> implementation > >> >>> which > >> >>> > > is > >> >>> > > >> of > >> >>> > > >> >> a > >> >>> > > >> >> > > > polling > >> >>> > > >> >> > > > >>> > > nature. > >> >>> > > >> >> > > > >>> > > > > > > GCP does not provide a service like > >> >>> Kafka. > >> >>> > > >> Instead > >> >>> > > >> >> it > >> >>> > > >> >> > > > >>> provides us > >> >>> > > >> >> > > > >>> > > > with > >> >>> > > >> >> > > > >>> > > > > > > Pub/Sub which is just like Kafka. > >> >>> > > >> >> > > > >>> > > > > > > Therefore using the Kafka streamer > as > >> a > >> >>> > > guideline > >> >>> > > >> >> made > >> >>> > > >> >> > > more > >> >>> > > >> >> > > > >>> sense > >> >>> > > >> >> > > > >>> > > to > >> >>> > > >> >> > > > >>> > > > > me. > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > Apart from the implementation I have > >> also > >> >>> > > added a > >> >>> > > >> >> unit > >> >>> > > >> >> > > > test. > >> >>> > > >> >> > > > >>> > > > > > > It definitely needs some polishing > >> and a > >> >>> > double > >> >>> > > >> >> check > >> >>> > > >> >> > on > >> >>> > > >> >> > > my > >> >>> > > >> >> > > > >>> side > >> >>> > > >> >> > > > >>> > to > >> >>> > > >> >> > > > >>> > > > > make > >> >>> > > >> >> > > > >>> > > > > > > the review smooth. > >> >>> > > >> >> > > > >>> > > > > > > For the tests a local Pub/Sub [2] > >> server > >> >>> has > >> >>> > to > >> >>> > > >> be > >> >>> > > >> >> > setup > >> >>> > > >> >> > > > >>> however > >> >>> > > >> >> > > > >>> > I > >> >>> > > >> >> > > > >>> > > am > >> >>> > > >> >> > > > >>> > > > > not > >> >>> > > >> >> > > > >>> > > > > > > sure which is the best way to do so > >> with > >> >>> > > regards > >> >>> > > >> to > >> >>> > > >> >> > your > >> >>> > > >> >> > > > >>> CI/CD. > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > [1] > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > >> >>> https://github.com/gkatzioura/ignite/tree/pubsub/modules/pubsub > >> >>> > > >> >> > > > >>> > > > > > > [2] > >> >>> > > >> >> > > > >>> > >> >>> > https://egkatzioura.com/2019/09/22/pub-sub-local-emulator/ > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > *Emmanouil Gkatziouras* > >> >>> > > >> >> > > > >>> > > > > > > https://egkatzioura.com/ | > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> https://www.linkedin.com/in/gkatziourasemmanouil/ > >> >>> > > >> >> > > > >>> > > > > > > https://github.com/gkatzioura > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > On Sat, 12 Oct 2019 at 02:11, Saikat > >> >>> Maitra < > >> >>> > > >> >> > > > >>> > > saikat.mai...@gmail.com > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > > wrote: > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > Hello Emmanouil, > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > Can you please share more info > about > >> >>> the > >> >>> > > >> >> > > implementation? > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > We have similar implementation for > >> data > >> >>> > > >> streamers > >> >>> > > >> >> > with > >> >>> > > >> >> > > > >>> Kafka > >> >>> > > >> >> > > > >>> > and > >> >>> > > >> >> > > > >>> > > > > > RocketMQ > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > https://apacheignite-mix.readme.io/docs/kafka-streamer > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > > >> >>> https://apacheignite-mix.readme.io/docs/rocketmq-streamer > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > Please review and share if you > have > >> any > >> >>> > > >> questions. > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > Regards, > >> >>> > > >> >> > > > >>> > > > > > > > Saikat > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > On Fri, Oct 11, 2019 at 4:56 PM > >> >>> Emmanouil > >> >>> > > >> >> > Gkatziouras < > >> >>> > > >> >> > > > >>> > > > > > > > gkatzio...@gmail.com> > >> >>> > > >> >> > > > >>> > > > > > > > wrote: > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > Hi all, > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > By mentioning Pub/Sub I mean > >> Google > >> >>> > Cloud's > >> >>> > > >> >> Pub/Sub > >> >>> > > >> >> > > [1] > >> >>> > > >> >> > > > >>> > > > > > > > > Yes it is indeed cloud specific. > >> It > >> >>> is > >> >>> > the > >> >>> > > >> >> > messaging > >> >>> > > >> >> > > > >>> service > >> >>> > > >> >> > > > >>> > > > > provided > >> >>> > > >> >> > > > >>> > > > > > > by > >> >>> > > >> >> > > > >>> > > > > > > > > GCP. > >> >>> > > >> >> > > > >>> > > > > > > > > I have made the integration with > >> it, > >> >>> but > >> >>> > I > >> >>> > > >> >> haven't > >> >>> > > >> >> > > > >>> published > >> >>> > > >> >> > > > >>> > it > >> >>> > > >> >> > > > >>> > > > yet > >> >>> > > >> >> > > > >>> > > > > > (I > >> >>> > > >> >> > > > >>> > > > > > > am > >> >>> > > >> >> > > > >>> > > > > > > > > waiting for the > discussion/ticket > >> and > >> >>> > > proceed > >> >>> > > >> >> with > >> >>> > > >> >> > > the > >> >>> > > >> >> > > > >>> > > > > contribution). > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > Kind regards, > >> >>> > > >> >> > > > >>> > > > > > > > > Emmanouil > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > [1] > >> >>> > > >> >> https://cloud.google.com/pubsub/docs/overview > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > *Emmanouil Gkatziouras* > >> >>> > > >> >> > > > >>> > > > > > > > > https://egkatzioura.com/ | > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> https://www.linkedin.com/in/gkatziourasemmanouil/ > >> >>> > > >> >> > > > >>> > > > > > > > > https://github.com/gkatzioura > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > On Fri, 11 Oct 2019 at 21:45, > >> Denis > >> >>> > Magda < > >> >>> > > >> >> > > > >>> dma...@apache.org > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > > > wrote: > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > Hello Emmanouil, > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > Are you referring to any > >> specific > >> >>> > > >> >> implementation > >> >>> > > >> >> > > > >>> tailored > >> >>> > > >> >> > > > >>> > > for a > >> >>> > > >> >> > > > >>> > > > > > > cloud? > >> >>> > > >> >> > > > >>> > > > > > > > If > >> >>> > > >> >> > > > >>> > > > > > > > > > I'm not mistaken you were > >> >>> mentioning > >> >>> > > >> AWS/GCE. > >> >>> > > >> >> Is > >> >>> > > >> >> > > > there > >> >>> > > >> >> > > > >>> any > >> >>> > > >> >> > > > >>> > > > Github > >> >>> > > >> >> > > > >>> > > > > > > > source > >> >>> > > >> >> > > > >>> > > > > > > > > > code? > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > Here is a list of existing > >> >>> integrations > >> >>> > > >> with > >> >>> > > >> >> > > > streaming > >> >>> > > >> >> > > > >>> and > >> >>> > > >> >> > > > >>> > > > > pub/sub > >> >>> > > >> >> > > > >>> > > > > > > > > > frameworks: > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> https://apacheignite-mix.readme.io/docs/overview > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > with the source code in Ignite > >> >>> master: > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > https://github.com/apache/ignite/tree/master/modules > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > Check out those resources to > see > >> >>> what > >> >>> > are > >> >>> > > >> the > >> >>> > > >> >> > most > >> >>> > > >> >> > > > >>> suitable > >> >>> > > >> >> > > > >>> > > > > Ignite > >> >>> > > >> >> > > > >>> > > > > > > APIs > >> >>> > > >> >> > > > >>> > > > > > > > > for > >> >>> > > >> >> > > > >>> > > > > > > > > > such integrations. > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > @Saikat Maitra < > >> >>> > saikat.mai...@gmail.com> > >> >>> > > , > >> >>> > > >> >> > @Roman > >> >>> > > >> >> > > < > >> >>> > > >> >> > > > >>> > > > > > rsht...@yahoo.com > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > , > >> >>> > > >> >> > > > >>> > > > > > > > > as > >> >>> > > >> >> > > > >>> > > > > > > > > > streaming technologies > >> >>> > > >> >> contributors/maintainers, > >> >>> > > >> >> > > > could > >> >>> > > >> >> > > > >>> you > >> >>> > > >> >> > > > >>> > > > please > >> >>> > > >> >> > > > >>> > > > > > > join > >> >>> > > >> >> > > > >>> > > > > > > > > this > >> >>> > > >> >> > > > >>> > > > > > > > > > thread? > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > - > >> >>> > > >> >> > > > >>> > > > > > > > > > Denis > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > On Thu, Oct 10, 2019 at 7:58 > AM > >> >>> > Emmanouil > >> >>> > > >> >> > > > Gkatziouras < > >> >>> > > >> >> > > > >>> > > > > > > > > > gkatzio...@gmail.com> > >> >>> > > >> >> > > > >>> > > > > > > > > > wrote: > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > Hello everyone, > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > I started using Ignite > lately. > >> >>> Part > >> >>> > of > >> >>> > > my > >> >>> > > >> >> work > >> >>> > > >> >> > > > >>> involves > >> >>> > > >> >> > > > >>> > > > > Pub/Sub, > >> >>> > > >> >> > > > >>> > > > > > > > thus I > >> >>> > > >> >> > > > >>> > > > > > > > > > > created a pub/sub streamer. > >> >>> > > >> >> > > > >>> > > > > > > > > > > Pub/Sub is pretty close to > >> Kafka. > >> >>> > > >> >> > > > >>> > > > > > > > > > > Here's how the streamer > works. > >> >>> Every > >> >>> > > node > >> >>> > > >> >> > creates > >> >>> > > >> >> > > > an > >> >>> > > >> >> > > > >>> > > instance > >> >>> > > >> >> > > > >>> > > > > of > >> >>> > > >> >> > > > >>> > > > > > a > >> >>> > > >> >> > > > >>> > > > > > > > > > Pub/Sub > >> >>> > > >> >> > > > >>> > > > > > > > > > > client. > >> >>> > > >> >> > > > >>> > > > > > > > > > > The clients subscribe to the > >> same > >> >>> > topic > >> >>> > > >> >> using > >> >>> > > >> >> > the > >> >>> > > >> >> > > > >>> same > >> >>> > > >> >> > > > >>> > > > > > subscription > >> >>> > > >> >> > > > >>> > > > > > > > > name. > >> >>> > > >> >> > > > >>> > > > > > > > > > > A message is being sent and > >> one > >> >>> of > >> >>> > the > >> >>> > > >> nodes > >> >>> > > >> >> > will > >> >>> > > >> >> > > > >>> receive > >> >>> > > >> >> > > > >>> > > the > >> >>> > > >> >> > > > >>> > > > > > > > message, > >> >>> > > >> >> > > > >>> > > > > > > > > > > process it and then forward > >> it to > >> >>> > > Ignite > >> >>> > > >> >> using > >> >>> > > >> >> > > the > >> >>> > > >> >> > > > >>> > > extractor > >> >>> > > >> >> > > > >>> > > > > > > > provided. > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > Any thoughts? > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > *Emmanouil Gkatziouras* > >> >>> > > >> >> > > > >>> > > > > > > > > > > https://egkatzioura.com/ | > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > https://www.linkedin.com/in/gkatziourasemmanouil/ > >> >>> > > >> >> > > > >>> > > > > > > > > > > > https://github.com/gkatzioura > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > >> >>> > > >> >> > > > >>> > > > >> >>> > > >> >> > > > >>> > > >> >>> > > >> >> > > > >>> > >> >>> > > >> >> > > > >> > >> >>> > > >> >> > > > > >> >>> > > >> >> > > > >> >>> > > >> >> > > >> >>> > > >> >> > >> >>> > > >> > > >> >>> > > >> > >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >> > >> > > >
