Re: Connector for REST End Point

2017-04-10 Thread Archit Mittal
Hi I wanted to know the pros and cons of both approaches and if there would be some better approaches for the same. Thanks for the info regarding the approaches. From your input as it has to be fault tolerant with checkpointing i think adding my own kafka in between would be better. Thanks Archit

Re: Connector for REST End Point

2017-04-10 Thread Chesnay Schepler
Hello, In general it should be possible for you to write a source that directly works with your REST API. The SourceFunction interface is simple enough that you can do pretty much anything, which makes me curious as to what makes you wonder whether it is possible. Have you tried implementing

Re: Connector for REST End Point

2017-04-10 Thread Archit Mittal
Hi Any suggestions regarding this. Thanks Archit On Thu, Apr 6, 2017 at 2:52 PM, Archit Mittal wrote: > Hi Chesnay > > I have a REST Api that listens to events that come through Kafka but i > dont have access to that Kafka . Can I write a connector that consumes > events through the REST end p

Re: Connector for REST End Point

2017-04-06 Thread Archit Mittal
Hi Chesnay I have a REST Api that listens to events that come through Kafka but i dont have access to that Kafka . Can I write a connector that consumes events through the REST end point and not directly through Kafka. I have a solution that i can dump the events coming to the api into another Ka

Re: Connector for REST End Point

2017-04-06 Thread Chesnay Schepler
Hello, Please give us a bit more information, I'm really not sure what you mean. :( Regards, Chesnay On 06.04.2017 09:40, Archit Mittal wrote: Hi Can we write a custom connector listening to a REST Api end point in Flink Thanks Archit

Connector for REST End Point

2017-04-06 Thread Archit Mittal
Hi Can we write a custom connector listening to a REST Api end point in Flink Thanks Archit