Can you please clarify a bit more on "made on fly". I interpret this as running in promiscuous mode to listen for data and create events out of it. Is this correct or I am completely off the track?
On Fri, Aug 1, 2014 at 11:25 AM, Liu Blade <hafzc...@gmail.com> wrote: > Hi folks, > > Sorry didn't clarify my problem. The problem has two folds: (1) use which > way to collect incoming TCP streams from external connections, and it must > be made on the fly; (2)use which method as Flume source, e.g., syslogTcp, > Avro. > > It seems syslog is unable to tap into TCP connections. Look forward to > your opinions. > > Thanks, > > > > 2014-08-01 11:17 GMT+08:00 Liu Blade <hafzc...@gmail.com>: > > Dear all, >> >> The scenario is we want to collect data over TCP connection which is send >> to backend database server. But it is not possible to use an intrusive way, >> which means we would not collect data on servers. >> >> Is that possible to use libpcap/winpcap to tap into TCP stream, convert >> it to Avro/Thrift, and then send to Flume source? >> >> Very appreciate your suggestions. Please indicate if there are better >> options. >> >> Cheers, >> Blade >> >> > > -- thanks ashish Blog: http://www.ashishpaliwal.com/blog My Photo Galleries: http://www.pbase.com/ashishpaliwal