Kafka native hadoop-consumer is compiled with hadoop 0.20 dependencies, so
isn't working with hadoop last releases (hadoop 2.2.0)
The code hasn't support from two years ago.
Is this a discarded option to load kafka messages to HDFS?
Do you recommend other solution like Camus?
Thanks in advance.
Hello,
I've been studying different options to consume messages from kafka to
hadoop(hdfs) and found three odds.
Linkedin Camus - https://github.com/linkedin/camus
kafka-hadoop-loader - https://github.com/michal-harish/kafka-hadoop-loader
hadoop-consumer -
https://github.com/apache/kafka/tree/0.8
Hello,
I've been studying different options to consume messages from kafka to
hadoop(hdfs) and found three odds.
Linkedin Camus - https://github.com/linkedin/camus
kafka-hadoop-loader - https://github.com/michal-harish/kafka-hadoop-loader
hadoop-consumer -
https://github.com/apache/kafka/tree/0.8
