Re: Why use Kafka after all?

2016-11-17 Thread Dromit
you do in these cases? It should be a pretty common scenario! Regards, Matt On Wed, Nov 16, 2016 at 2:01 PM, Philipp Bussche wrote: > Hi Dromit > > I started using Flink with Kafka but am currently looking into Kinesis to > replace Kafka. > The reason behind this is that eventually

Re: Why use Kafka after all?

2016-11-15 Thread Dromit
s > results. So in your case I would directly ingest my messages into Kafka and > then let Flink read from the created topic to do the processing. > > Cheers, > Till > > On Tue, Nov 15, 2016 at 8:14 AM, Dromit wrote: > >> Hello, >> >> As far as I've se

Why use Kafka after all?

2016-11-14 Thread Dromit
Hello, As far as I've seen, there are a lot of projects using Flink and Kafka together, but I'm not seeing the point of that. Let me know what you think about this. 1. If I'm not wrong, Kafka provides basically two things: storage (records retention) and fault tolerance in case of failure, while

Kafka + Flink, Basic Questions

2016-10-30 Thread Dromit
Hello, I'm writing an application to generate reports of a real time stream of sale records (product, quantity, price, time) that I get from a websocket, and I plan to use Kafka and Flink to do so. The result of the pipeline should be, for instance, "the average price for a certain product in the