Re: Building API to make Kafka reactive

2016-07-22 Thread Michael Noll
Shekar, you mentioned: > The API should give different status at each part of the pipeline. > At the ingestion, the API responds with "submitted" > During the progression, the API returns "in progress" > After successful completion, the API returns "Success" May I ask what your motivation is to

Re: Building API to make Kafka reactive

2016-07-13 Thread Dean Wampler
You don't have the Scala library on the app class path, which is used to implement Akka. Use the same version that's required for the Akka libraries you're using. http://mvnrepository.com/artifact/org.scala-lang/scala-library dean Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition

Re: Building API to make Kafka reactive

2016-07-13 Thread Shekar Tippur
Is there anyway I can get a small working example to start with? - Shekar On Wed, Jul 13, 2016 at 10:39 AM, Shekar Tippur wrote: > Dean, > > I am having trouble getting this to work. > > import akka.actor.ActorSystem; > import akka.kafka.scaladsl.Producer; > import akka.stream.javadsl.Source; >

Re: Building API to make Kafka reactive

2016-07-13 Thread Shekar Tippur
Dean, I am having trouble getting this to work. import akka.actor.ActorSystem; import akka.kafka.scaladsl.Producer; import akka.stream.javadsl.Source; import akka.kafka.ProducerSettings; import org.apache.kafka.clients.producer.ProducerRecord; import org.apache.kafka.clients.producer.ProducerReco

Re: Building API to make Kafka reactive

2016-07-02 Thread Shekar Tippur
Dean, Thanks a lot for the link. I am going through the documentation. - Shekar On Wed, Jun 29, 2016 at 9:50 AM, Dean Wampler wrote: > Here's another Reactive API: https://github.com/akka/reactive-kafka > > It was developed by Software Mill and it's now > being inte

Re: Building API to make Kafka reactive

2016-06-29 Thread Dean Wampler
Here's another Reactive API: https://github.com/akka/reactive-kafka It was developed by Software Mill and it's now being integrated with Akka . dean Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition

Re: Building API to make Kafka reactive

2016-06-29 Thread Shekar Tippur
Thanks for the suggestion Lohith. Will try that and provide a feedback. - Shekar On Tue, Jun 28, 2016 at 11:45 PM, Lohith Samaga M wrote: > Hi Shekar, > Alternatively, you could make each stage of your pipeline to write > to a Cassandra (or other DB) and your API will read from it. With

Re: Building API to make Kafka reactive

2016-06-29 Thread Shekar Tippur
Thanks Rajini, I have seen this. Looks like quite a bit of work has been done. I was trying to go through this code and understand how to get started. - Shekar On Wed, Jun 29, 2016 at 12:49 AM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Hi Shekar, > > We are working on a reactive s

Re: Building API to make Kafka reactive

2016-06-29 Thread Rajini Sivaram
Hi Shekar, We are working on a reactive streams API for Kafka. It is in its very early experimental stage, but if you want to take a look, the code is in github ( https://github.com/reactor/reactor-kafka). I think you can add a session id without making it part of the Kafka API. In the coming week

RE: Building API to make Kafka reactive

2016-06-28 Thread Lohith Samaga M
Hi Shekar, Alternatively, you could make each stage of your pipeline to write to a Cassandra (or other DB) and your API will read from it. With Cassandra TTL, the row will be deleted after TTL is passed. No manual cleanup is required. Best regards / Mit freundlichen Grüßen / Sincères sal