Hi folks, Sorry didn't clarify my problem. The problem has two folds: (1) use which way to collect incoming TCP streams from external connections, and it must be made on the fly; (2)use which method as Flume source, e.g., syslogTcp, Avro.
It seems syslog is unable to tap into TCP connections. Look forward to your opinions. Thanks, 2014-08-01 11:17 GMT+08:00 Liu Blade <hafzc...@gmail.com>: > Dear all, > > The scenario is we want to collect data over TCP connection which is send > to backend database server. But it is not possible to use an intrusive way, > which means we would not collect data on servers. > > Is that possible to use libpcap/winpcap to tap into TCP stream, convert it > to Avro/Thrift, and then send to Flume source? > > Very appreciate your suggestions. Please indicate if there are better > options. > > Cheers, > Blade > >