Kafka topics for logging from multiple apps

practice for creating Kafka topics? Have granular it needs to be? For example, can I have one Kafka topic for 500 apps instead? What are the pros and cons? Thanks, Ram Vittal Principal Enterprise Architect, Enterprise Architecture XPOLogistics 2055 NW Savier Street Portland, OR 97209 USA O

Kafka topics best practice

We are using latest Kafka and Logstash versions for ingesting several business apps(now few but eventually 100+) log data into ELK. We have a standardized logging structure for business apps to log data into Kafka topic and able to ingest into ELK via Kafka input plugin. Currently, we are using on

Kafka Topics best practice for logging data pipeline use case

one kafka topic for each app, should we have one kafka topic across all apps? What are the pros and cons? If you are not familiar with Logstash it is part of Elastic stack and it is just another consumer for Kafka. Would appreciate your input! -- Thanks, Ram Vittal

Re: Kafka Producer for Sending Log Data

logs can be searched, filtered or visualized. Thanks, Ram Vittal Sent from my iPhone > On Mar 20, 2017, at 10:44 AM, Tony S. Wu wrote: > > Hi, > > I am looking to send log file periodically to Kafka. Before I set out to > write my own producer, I was wonder what everyon