I did the same search about a month ago.
I forked this kafka-s3-consumer
<https://github.com/gnethercutt/kafka-s3-consumer/tree/kafka_0.8> from
QubitProducts/kafka-s3-consumer
<https://github.com/QubitProducts/kafka-s3-consumer> to upfit it for the
0.8 api changes.
You'll have to futz with the local repo/ivy to get your kafka jar in the
right place for maven, but it's functional and straightforward.
Planning on sending a pull request once 0.8.0 is formally released.
--glenn
On 06/26/2013 12:08 AM, Florin Trofin wrote:
Quick search for "kafka s3 consumer" brings up a bunch of Github projects.
If you don't like any, I would write a kafka consumer in java that writes
to s3. Probably less than 200 lines of code.
F.
On 6/25/13 1:50 PM, "Alan Everdeen" <everdeena...@gmail.com> wrote:
In my application, I have logs that are sent as kafka messages, and I need
a way to save these logs to an s3 bucket using a kafka sink.
I was wondering what the recommended approach would be to accomplish this
task, assuming I am using Kafka 0.8.
Thank you for your time,
Alan Everdeen