Re: Flume/Avro schema manipulation

2014-08-30 Thread Javi Roman
It could be useful for you this project [1] the side where the source is converted to avro using a custom parser. [1] https://github.com/danieltardon/flume-ng-kafka-avro-sink On Fri, Aug 29, 2014 at 5:18 PM, Ed Judge wrote: > From initial reading of what it does, it look promising. So, I could

Re: Flume/Avro schema manipulation

2014-08-29 Thread Ed Judge
From initial reading of what it does, it look promising. So, I could ultimately leverage something like the readLine and toAvro commands Thanks, Ed On Aug 29, 2014, at 8:25 AM, Gaspar Muñoz wrote: > Hi Ed, > > maybe after read logs from your file, you can apply > org.apache.flume.sink.so

Re: Flume/Avro schema manipulation

2014-08-29 Thread Gaspar Muñoz
Hi Ed, maybe after read logs from your file, you can apply org.apache.flume.sink.solr.morphline.MorphlineInterceptor$Builder interceptor and then apply to Avro morphline .