Hello, We are using Kafka as data pipeline for log aggregation into ElasticSearch. We have over 500 apps that will eventually send logs to Kafka topics for aggregation into ElasticSearch.
Currently, we are using app level topic for sending log messages into Kafka. Wondering what is the best practice for creating Kafka topics? Have granular it needs to be? For example, can I have one Kafka topic for 500 apps instead? What are the pros and cons? Thanks, Ram Vittal Principal Enterprise Architect, Enterprise Architecture XPOLogistics 2055 NW Savier Street Portland, OR 97209 USA O: +1 503-450-6026 | M: +1 503-724-5702
