This works fine, we (Lightbend) are using this approach all over the place Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/
> On Jul 11, 2018, at 8:53 AM, Pulkit Manchanda <pulkit....@gmail.com> wrote: > > Hi All, > > I want to build a datapipeline with the following design. Can please anyone > advice me that is it feasible to do? Or there are better options. > > > HTTP Streams --> (HTTP stream consumer)(using AKKA HTTP Streaming) --> (kafka > Stream Producer)(using Kafka Streaming) --> (Kafka Stream Consumer)(using > Spark > structured streaming) > > > DPContext --> (Kafka Stream Producer)(using Spark structured > streaming) --> (Kafka > Stream Consumer)(using AKKA Streaming) -->(HTTP stream Producer)(using AKKA > HTTP Streaming) --> HTTP Streams > > Thanks > Pulkit
