Thanks Rajini, I have seen this. Looks like quite a bit of work has been done. I was trying to go through this code and understand how to get started.
- Shekar On Wed, Jun 29, 2016 at 12:49 AM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Hi Shekar, > > We are working on a reactive streams API for Kafka. It is in its very early > experimental stage, but if you want to take a look, the code is in github ( > https://github.com/reactor/reactor-kafka). I think you can add a session > id > without making it part of the Kafka API. In the coming weeks, we will be > trying out some examples to improve the API. We welcome any feedback. > > Regards, > > Rajini > > On Wed, Jun 29, 2016 at 7:45 AM, Lohith Samaga M < > lohith.sam...@mphasis.com> > wrote: > > > Hi Shekar, > > Alternatively, you could make each stage of your pipeline to > write > > to a Cassandra (or other DB) and your API will read from it. With > Cassandra > > TTL, the row will be deleted after TTL is passed. No manual cleanup is > > required. > > > > Best regards / Mit freundlichen Grüßen / Sincères salutations > > M. Lohith Samaga > > > > > > > > -----Original Message----- > > From: Shekar Tippur [mailto:ctip...@gmail.com] > > Sent: Wednesday, June 29, 2016 12.10 > > To: users > > Subject: Building API to make Kafka reactive > > > > I am looking at building a reactive api on top of Kafka. > > This API produces event to Kafka topic. I want to add a unique session id > > into the payload. > > The data gets transformed as it goes through different stages of a > > pipeline. I want to specify a final topic where I want the api to know > that > > the processing was successful. > > The API should give different status at each part of the pipeline. > > At the ingestion, the API responds with "submitted" > > During the progression, the API returns "in progress" > > After successful completion, the API returns "Success" > > > > Couple of questions: > > 1. Is this feasible? > > 2. I was looking at project reactor (https://projectreactor.io) where > the > > docs talk about event bus. I wanted to see if I can implement a consumer > > that points to the "end" topic and throws an event into the event bus. > > Since I would know the session ID, I can process the request accordingly. > > > > Appreciate your inputs. > > > > - Shekar > > Information transmitted by this e-mail is proprietary to Mphasis, its > > associated companies and/ or its customers and is intended > > for use only by the individual or entity to which it is addressed, and > may > > contain information that is privileged, confidential or > > exempt from disclosure under applicable law. If you are not the intended > > recipient or it appears that this mail has been forwarded > > to you without proper authority, you are notified that any use or > > dissemination of this information in any manner is strictly > > prohibited. In such cases, please notify us immediately at > > mailmas...@mphasis.com and delete this mail from your records. > > >
