We use Kafka (0.9.x) internally in our pipeline and now we would like to
ingest application logs sitting in local file system of servers external to
the Kafka cluster.

We could write a producer program running on the application servers to
push files to Kafka. However we wonder if we can leverage Kafka Connect to
pull files into Kafka. It requires a connector to access local file systems
and I am not sure if I can make use of existing connectors or I need to
write one.

Any thoughts or reference would be helpful.

Thanks,
B

Reply via email to