OK, I can't resist a bit more detail about my favorite project :)
Here's a good blog post on how to use the Flume-Kafka source, sink and channel:
http://blog.cloudera.com/blog/2014/11/flafka-apache-flume-meets-apache-kafka-for-event-processing/
One of the main differences from Baniuyao's version
I'd use the one in Flume trunk (it was far better tested) and we also
have Kafka-channel :)
And it works with 0.8.1.
https://github.com/apache/flume/tree/trunk/flume-ng-sources/flume-kafka-source
https://github.com/apache/flume/tree/trunk/flume-ng-sinks/flume-ng-kafka-sink
https://github.com/apach
Does this work for kafka 0.8.1? thank you
https://github.com/baniuyao/flume-kafka
Kafka plugins are maintained by the person who open sourced it. So if you
have any plugins related questions, you may have to direct it to the
maintainer of the plugin. Could you be more specific about what kind of
build issue you are running into?
On Mon, Jun 23, 2014 at 10:46 AM, clay teahouse
Hello,
I am not had any luck building this against kafka 0.8.1. What do I need to
make this work?
thanks,
Clay
That's great. Thanks for sharing! Added your plugin to our ecosystem page -
https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem
-Neha
On Fri, Nov 8, 2013 at 8:04 AM, Frank Yao wrote:
> Hi there, I've made a plugin for kafka in flume. Kafka is a message system
> for large data transform
Hi there, I've made a plugin for kafka in flume. Kafka is a message system
for large data transformation, it is created by LinkedIn. More and More
companies are using Kafka.
This plugin I wrote is running in our company(NYSE: VIPS) well. It enabled
users to user Kafka both as a Sink and a Source.
