Hi All, I want to build a datapipeline with the following design. Can please anyone advice me that is it feasible to do? Or there are better options.
HTTP Streams --> (HTTP stream consumer)(using AKKA HTTP Streaming) --> (kafka Stream Producer)(using Kafka Streaming) --> (Kafka Stream Consumer)(using Spark structured streaming) DPContext --> (Kafka Stream Producer)(using Spark structured streaming) --> (Kafka Stream Consumer)(using AKKA Streaming) -->(HTTP stream Producer)(using AKKA HTTP Streaming) --> HTTP Streams Thanks Pulkit
