I was wondering if anybody has already tried to mirror a kafka topic to
hdfs just copying the log files from the topic directory of the broker
(like 00000000000023244237.log).

The file format is very simple :
https://twitter.com/amiorin/status/576448691139121152/photo/1

Implementing an InputFormat should not be so difficult.

Any drawbacks?

Reply via email to