Re: Kafka integration with Hadoop

2015-05-11 Thread Gwen Shapira
Also, Flume 1.6 has Kafka source, sink and channel. Using Kafka source or channel with Dataset sink should work. Gwen On Tue, May 12, 2015 at 6:16 AM, Warren Henning wrote: > You could start by looking at Linkedin's Camus and go from there? > > On Mon, May 11, 2015 at 8:10 PM, Rajesh Datla > w

Re: Kafka integration with Hadoop

2015-05-11 Thread Warren Henning
You could start by looking at Linkedin's Camus and go from there? On Mon, May 11, 2015 at 8:10 PM, Rajesh Datla wrote: > Hi All, > > How to integrate Kafka with Hadoop ecosystem. > > How to store Kafka messages into HDFS in parquet format > > Regards > Raj >

Kafka integration with Hadoop

2015-05-11 Thread Rajesh Datla
Hi All, How to integrate Kafka with Hadoop ecosystem. How to store Kafka messages into HDFS in parquet format Regards Raj