Re: Using Kafka and Flink for batch processing of a batch data source

2016-07-20 Thread Leith Mudge
e around processing, you could route data processing through Nifi before Flink. Regards Milind On Jul 19, 2016 9:37 PM, "Leith Mudge" mailto:lei...@palamir.com>> wrote: I am currently working on an architecture for a big data streaming and batch processing platform. I am pl

Using Kafka and Flink for batch processing of a batch data source

2016-07-19 Thread Leith Mudge
I am currently working on an architecture for a big data streaming and batch processing platform. I am planning on using Apache Kafka for a distributed messaging system to handle data from streaming data sources and then pass on to Apache Flink for stream processing. I would also like to use Fli