Hi, I'd like a few details about consumers (high level) and producers (both sync and async), I'm using Kafka 0.7.2.
Basically, who and how is managing network disconnection / outage ? For example, I've been playing with sync producer, and I realized that it can't be created when there's a network issue (broker or zk unavailable) as it creates its connection at creation time. 1 ) If the "sync" producer has been created successfully, will it reconnect whenever it loses its connection to the broker or zk ? I could understand it's not happening as we expect the connection to be immediately available when using the sync producer. 2 ) How about the "async" producer ? Does it expect connection at creation time ? will it reconnect in case of failure ? 3 ) Finally, how about the "high level" consumer ? Afaik, it reconnects automatically In a nutshell, I'd like to know more about connection management, requirement, etc. If there's any gotcha, like the connection required at creation time for sync producer, is there any max retry which may cause my consumer to disconnect definitively if the outage is too long, etc. My goal would be to have all producers and consumers able to reconnect properly whenever there's a disconnection, outage, etc. Best regards, Nicolas Berthet