Re: sFlow/NetFlow/Pcap Plugin for Kafka Producer

2016-10-10 Thread Michael Noll
Aris, I am not aware of an out of the box tool for Pcap->Kafka ingestion (in my case back then we wrote our own). Maybe others know. On Monday, October 10, 2016, Aris Risdianto wrote: > Thank you for answer Michael. > > Actually, I have made a simple producer from Pcap to Kafka. Since it is

Re: sFlow/NetFlow/Pcap Plugin for Kafka Producer

2016-10-10 Thread Aris Risdianto
Thank you for answer Michael. Actually, I have made a simple producer from Pcap to Kafka. Since it is not structured, so it is difficult for further processing by a consumer. But, I will take a look at Avro as you mentioned. I just wondering, if there are any proper implementation for this requir

Re: sFlow/NetFlow/Pcap Plugin for Kafka Producer

2016-10-10 Thread Michael Noll
Aris, even today you can already use Kafka to deliver Netflow/Pcap/etc. messages, and people are already using it for that (I did that in previous projects of mine, too). Simply encode your Pcap/... messages appropriately (I'd recommend to take a look at Avro, which allows you to structure your d

sFlow/NetFlow/Pcap Plugin for Kafka Producer

2016-10-10 Thread Aris Risdianto
​Hello, ​Is there any plan or implementation to use Kafka for delivering sFlow/NetFlow/Pcap messages? Best Regards, Aris.