AWS S3 flume source

2014-07-31 Thread Paweł
figuration file?* -- Paweł Róg

Re: AWS S3 flume source

2014-08-01 Thread Paweł
nel. I'm only afraid about this dynamic configuration. I'll open a new thread about this. It seems we have two totally separate things: * build S3 source * make flume configurable dynamically -- Paweł 2014-08-01 9:51 GMT+02:00 Otis Gospodnetic : > Hi, > > On Fri, Aug 1, 2014 at 4:

Flume dynamic configuraiton

2014-08-01 Thread Paweł
so hard? -- Paweł

Re: Flume dynamic configuraiton

2014-08-01 Thread Paweł
stable version (no needed to be pushed into master)? -- Paweł 2014-08-01 12:59 GMT+02:00 Ashish : > If you change the configuration file, Flume reloads it, unless you tell it > not to by specifying no-reload-conf option. > > > On Fri, Aug 1, 2014 at 3:35 PM, Paweł wrote: > >

Re: AWS S3 flume source

2014-08-01 Thread Paweł
Hi, Thanks for explanation Jonathan. I think I will also start working on it. When you have any patch (even draft) I'd be glad if you can attach it in JIRA. I'll do the same. What do you think? -- Paweł Róg 2014-08-01 20:19 GMT+02:00 Hari Shreedharan : > +1 on an S3 Source. I

Re: Flume dynamic configuraiton

2014-08-03 Thread Paweł Róg
Hi, I fetched a patch and see that zookeeper configuration provider doesn't listen on zookeeper and doesn't emit events when somethings changes in zookeeper. Did I miss something? -- Paweł 2014-08-01 13:16 GMT+02:00 Ashish : > > > > On Fri, Aug 1, 2014 at 4:40 PM,

Re: AWS S3 flume source

2014-08-05 Thread Paweł Róg
eg. unzip, deserialize avro or read JSON and convert it into log events. What do you think? -- Paweł Róg 2014-08-06 5:12 GMT+02:00 Viral Bajaria : > Agree to the feedback provided by Ashish. > > I have started writing one which is similar to the ExecSource, but I like > the idea of d

Re: Dynamic sink configuration

2014-10-28 Thread Paweł Róg
Hi, And as far as I know flume can be configured by zookeeper :D https://issues.apache.org/jira/browse/FLUME-1491 -- Pawel Rog 2014-10-28 17:02 GMT+01:00 Otis Gospodnetic : > As far as I know, Flume is configured only through the config and I > *think* Flume automatically reloads the config whe