Re: How to use kafka as flume source.

2014-09-19 Thread Gwen Shapira
Just to update (better late than never!): The Kafka source & sink for Flume were updated to latest Kafka version and improved a bit (offsets are now committed after data is written to Flume channel). If you build Flume from trunk, you'll get these. Gwen On Sun, Aug 3, 2014 at 10:31 AM, Andrew Ehr

Re: How to use kafka as flume source.

2014-08-03 Thread Andrew Ehrlich
The author may or may not have upgraded the project to be compatible with 0.8.1. You could message the author directly to ask. On Sun, Aug 3, 2014 at 6:53 AM, rafeeq s wrote: > Thanks. > But above link example uses flume-ng to > communicate with *kafka 0.7,2 <

Re: How to use kafka as flume source.

2014-08-03 Thread rafeeq s
Thanks. But above link example uses flume-ng to communicate with *kafka 0.7,2 *. I am using *kafka 0.8.1*. Please advice an example of flume-ng with kafka 0.8.1. Thanks in advance Regards, Rafeeq S *(“What you do is

Re: How to use kafka as flume source.

2014-08-03 Thread Sharninder
https://github.com/baniuyao/flume-ng-kafka-source On Sun, Aug 3, 2014 at 6:15 PM, rafeeq s wrote: > Hi, > > We are planning to use kafka as *flume source*. Please advice me, how to > use kafka as source in flume. > > please share if there is any best example of *flume- kafka source- hdfs > sin

How to use kafka as flume source.

2014-08-03 Thread rafeeq s
Hi, We are planning to use kafka as *flume source*. Please advice me, how to use kafka as source in flume. please share if there is any best example of *flume- kafka source- hdfs sink*. Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*