I can't seem to find much information to help me (being green to kafka) on setting up a cluster on aws. Does anyone have any sources?
The question I have off the bat is, what methods have already been explored to generate a unique broker id? If I spin up a new server, do I just need to maintain my own broker-id list somewhere so I don't re-use an already allocated broker id? Also, I read an article about a broker going down and requiring a new broker be spun up with the same id. Is this also something I need to implement? I want to setup a kafka auto-scaling group on AWS, so I can add brokers at well or based on load. It doesn't seem too complicated, or maybe I'm too green to see it, but I don't want to re-invent everything myself. I know Loggly uses AWS/Kafka, so I'm hunting for more details on that too. Thanks for any help