Hi, We like to operate in micro-services (dockerize and ship everything on ecs) and I was wondering which approach was preferred. We have one kafka cluster, one zookeeper cluster, etc, but when it comes to kafka connect I have some doubts.
Is it better to have one big kafka connect with multiple nodes, or many small kafka connect clusters or standalone, for each connector / etl ? The issues I’m trying to address are : - Integration with our CI/CD pipeline - Efficient resources utilisation - Easily add new jar files that connectors depend on with minimal downtime - Monitoring operations Thanks for your guidance Regards, Stephane
