Also, Flume 1.6 has Kafka source, sink and channel. Using Kafka source or channel with Dataset sink should work.
Gwen On Tue, May 12, 2015 at 6:16 AM, Warren Henning <warren.henn...@gmail.com> wrote: > You could start by looking at Linkedin's Camus and go from there? > > On Mon, May 11, 2015 at 8:10 PM, Rajesh Datla <rajeshdatla2...@gmail.com> > wrote: > > > Hi All, > > > > How to integrate Kafka with Hadoop ecosystem. > > > > How to store Kafka messages into HDFS in parquet format > > > > Regards > > Raj > > >
