There is a sidecar jvm project called exhibitor that manages this for you.
It's from Netflix so it's a bit aws-centric but still a good source for how to
manage those log files. You may also want to look into some zk config settings
to make sure your logs are not growing too large by truncatin
Will the current kafka-s3-consumer (
https://github.com/razvan/kafka-s3-consumer) work with 0.8.0?
Ray Rodriguez
Medidata Solutions
Imagine a situation where one of your nodes running a kafka broker and
zookeeper node goes down. You now have to contend with two distributed
systems that need to do leader election and consensus in the case of a
zookeeper ensemble and partition rebalancing/repair in the case of a kafka
cluster so
; Ken
>
> On Mar 15, 2014, at 11:09 AM, Ray Rodriguez wrote:
>
> > Imagine a situation where one of your nodes running a kafka broker and
> > zookeeper node goes down. You now have to contend with two distributed
> > systems that need to do leader election and consensus
