Hi, I am having a setup where I am sniffing some logs(ofcourse the big ones) through Logstash Forwarder and forwarding it to Logstash, which in turn publish these events to Kafka.
I have created the Kafka Topic ensuring the required number of Partitions and Replication Factor but not sure with Logstash Output Configuration, I am having following doubt with reference to the same. For the Logstash Publishing events to kafka 1) Do we need to explicitly define the Partition in Logstash while Publishing to Kafka 2) Will Kafka take care of the proper distribution of the data across the Partitions I am having a notion that despite of the fact of declaring the partitions in Kafka while creating Topic the data from Logstash is been pushed to single Partition or perhaps not getting uniformly distributed. Looking for the Expert Advise. Thanks!
