Re: Real time streaming as a microservice

2018-07-15 Thread Mich Talebzadeh
t;>> > >>>>> > I have a gateway node that is connected to the host running the >>>>> container. >>>>> > From within the container I can ssh to the gateway host *as both the >>>>> > gateway host and host running the

Re: Real time streaming as a microservice

2018-07-15 Thread Deepak Sharma
~# ifconfig -a >>>> > eth0: flags=4163 mtu 1500 >>>> > *inet 172.17.0.2 netmask 255.255.0.0 broadcast 172.17.255.255* >>>> > ether 02:42:ac:11:00:02 txqueuelen 0 (Ethernet) >>>> > RX packets 173015 bytes 3263068025 (3.2 GB) >>>> > RX errors 0 dropped 0 overruns 0 frame 0 >>>

Re: Real time streaming as a microservice

2018-07-15 Thread Mich Talebzadeh
s 534805 (534.8 KB) >>> > RX errors 0 dropped 0 overruns 0 frame 0 >>> > TX packets 8450 bytes 534805 (534.8 KB) >>> > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >>> > >>> > >>> > >>> > The interesting thing is tha

Re: Real time streaming as a microservice

2018-07-15 Thread Mich Talebzadeh
es75:9092,rhes564:9092,rhes75:9093,rhes564:9093,rhes75:9094,rhes564:9094 >> > needs to be replaced by :9092! >> > >> > >> > So at this juncture I am wondering what type of network needs to be >> created >> > as the container is running within anot

Re: Real time streaming as a microservice

2018-07-10 Thread Mich Talebzadeh
under using Zookeeper as a Microservices container is > here > > > > > > > > > > > > http://planet.jboss.org/post/zookeeper_for_microservice_registration_and_discovery > > > > > > > > ZooKeeper for Micro

Re: Real time streaming as a microservice

2018-07-10 Thread Rahul Singh
y arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Sun, 8 Jul 2018 at 20:00, Martin Gainty wrote: > > >

Re: Real time streaming as a microservice

2018-07-09 Thread Mich Talebzadeh
destruction. On Sun, 8 Jul 2018 at 20:00, Martin Gainty wrote: > > > > From: Mich Talebzadeh > Sent: Sunday, July 8, 2018 1:01 PM > To: users@kafka.apache.org > Subject: Re: Real time streaming as a microservice > > Thanks Martin. >

Re: Real time streaming as a microservice

2018-07-08 Thread Martin Gainty
From: Mich Talebzadeh Sent: Sunday, July 8, 2018 1:01 PM To: users@kafka.apache.org Subject: Re: Real time streaming as a microservice Thanks Martin. >From an implementation point of view do we need to introduce docker for each microservice? In other wo

Re: Real time streaming as a microservice

2018-07-08 Thread Mich Talebzadeh
round it. > > > > let me know if i can help out > Martin > > > ____ > From: Jörn Franke > Sent: Sunday, July 8, 2018 6:18 AM > To: users@kafka.apache.org > Cc: u...@flink.apache.org > Subject: Re: Real time streaming as a microservice >

Re: Real time streaming as a microservice

2018-07-08 Thread Martin Gainty
me of the concerns around it. let me know if i can help out Martin From: Jörn Franke Sent: Sunday, July 8, 2018 6:18 AM To: users@kafka.apache.org Cc: u...@flink.apache.org Subject: Re: Real time streaming as a microservice Yes or Kafka will need it ... As soon a

Re: Real time streaming as a microservice

2018-07-08 Thread Jörn Franke
Yes or Kafka will need it ... As soon as your orchestrate different microservices this will happen. > On 8. Jul 2018, at 11:33, Mich Talebzadeh wrote: > > Thanks Jorn. > > So I gather as you correctly suggested, microservices do provide value in > terms of modularisation. However, there will

Re: Real time streaming as a microservice

2018-07-08 Thread Mich Talebzadeh
Thanks Jorn. So I gather as you correctly suggested, microservices do provide value in terms of modularisation. However, there will always "inevitably" be scenarios where the receiving artefact say Flink needs communication protocol changes? thanks Dr Mich Talebzadeh LinkedIn * https://www.l

Re: Real time streaming as a microservice

2018-07-08 Thread Jörn Franke
That they are loosely coupled does not mean they are independent. For instance, you would not be able to replace Kafka with zeromq in your scenario. Unfortunately also Kafka sometimes needs to introduce breaking changes and the dependent application needs to upgrade. You will not be able to avo

Real time streaming as a microservice

2018-07-08 Thread Mich Talebzadeh
Hi, I have created the Kafka messaging architecture as a microservice that feeds both Spark streaming and Flink. Spark streaming uses micro-batches meaning "collect and process data" and flink as an event driven architecture (a stateful application that reacts to incoming events by triggering comp