Hi list, Just a quick note to let you know that kafka support has now been merged in collectd, which means that system and application metrics can directly be produced on a topic from the collectd daemon.
Additionally, syslog-ng will soon ship with a kafka producing module as well, it will be part of the next release of the syslog-ng-incubator module collection: https://github.com/balabit/syslog-ng-incubator. What this means is that there is now a very lightweight way to create a infrastructure event stream on top of kafka, with known tools in the ops world. I relied on the librdkafka library to provide kafka producing, which I can recommend for C needs. - pyr
