Re: Kafka DNS Caching in AWS

2016-08-03 Thread Gian Merlino
Hey Zuber, Our AWS ZK deployment involves a subnet that is not used for other things, fixed private IP addresses, and EBS volumes for ZK data. That way, if a ZK instance fails, it can be replaced with another instance with the same IP and data volume. On Wed, Aug 3, 2016 at 7:22 AM, Zuber wrote:

Re: kafka + autoscaling groups fuckery

2016-07-05 Thread Gian Merlino
I think it'd be possible to avoid special-casing replacements, but it might be a bad idea network-traffic-wise, especially for rolling upgrades. My experience running Kafka on AWS is that rebalancing with multi-day retention periods can take a really long time, and can torch the cluster if you reb