Hi Damian Just clarifying - you’re saying you currently have Kafka 0.7.x running with a dedicated broker addresses (bypassing ZK) and hitting a VIP which you use for load balancing writes. Is that correct?
Are you worried about something specific in the 0.8.x way of doing things (ZK under that level of load etc) or are you just looking for experiences running 0.8.x with that many producers? B > On 25 Aug 2015, at 10:29, Damian Guy <damian....@gmail.com> wrote: > > Hi, > > We currently run 0.7.x on our clusters and are now finally getting around > to upgrading to kafka latest. One thing that has been holding us back is > that we can no longer use a VIP to front the clusters. I understand we > could use a VIP for metadata lookups, but we have 100,000 + producers to at > least one of our clusters. > So, my question is: How is Kafka 0.8.x going to handle 100,000+ producers? > Any recommendations on setup etc? > > Thanks for the help, > Damian
