:9092"
You can also pipe a custom log into it as well :)
From: Joseph Lawson
Sent: Thursday, August 07, 2014 5:35 PM
To: users@kafka.apache.org; Philip O'Toole
Subject: RE: Apache webserver access logs + Kafka producer
Check out my logst
quot;:\"%u\",\"first_request\":\"%r\",\"last_request_status\":\"%>s\",\"response_size_bytes\":%B,\"duration_usec\":
%D,\"@version\":1 }" logstash_json
CustomLog "|rotatelogs /var/log/httpd/access_log_json-%s
Fluentd might work or simply configure rsyslog or syslog-ng on the box to watch
the Apache log files, and send them to a suitable Producer (for example I wrote
something that will accept messages from a syslog client, and stream them to
Kafka. https://github.com/otoolep/syslog-gollector)
More
You might be interested by something like Logstash http://logstash.org for
logs and event processing.
Regards,
Florian
Le 5 août 2014 23:17, "Jonathan Weeks" a écrit :
> You can look at something like:
>
> https://github.com/harelba/tail2kafka
>
> (although I don’t know what the effort would be
You can look at something like:
https://github.com/harelba/tail2kafka
(although I don’t know what the effort would be to update it, as it doesn’t
look like it has been updated in a couple years)
We are using flume to gather logs, and then sending them to a kafka cluster via
a flume kafka sink
Hi,
I want to collect apache web server logs in real time and send it to Kafka
server. Is there any existing Producer available to do this operation, If
not can you please provide a way to implement it.
Regards,
Sree.
