Re: AWS SQS Flume Source

Sad about that. Thanks anyway, Denes. Best, Roberto On 06/04/2017 17:20, Denes Arvay wrote: Hi Roberto, No, unfortunately the Flume codebase doesn't contain AWS SQS source. Best, Denes On Thu, Apr 6, 2017 at 5:13 PM Roberto Coluccio mailto:roberto.coluc...@eng.it>> wrote: Hello com

Flume Cluster?

Is there such a thing as a flume cluster? If there is I can't find any documentation for it. If there is not, how does flume deal with scale and availability? thanks Jeff

Re: Flume Cluster?

http://ankitasblogger.blogspot.com/2011/05/installing-flume-in-cluster-complete.html [http://1.bp.blogspot.com/_UwzOsxzbAT0/TOarzTurqkI/AAU/O9K3mKpuw5U/S220-s80/Ankitjain_cs.jpg] Installing Flume in the

Re: Flume Cluster?

You can run as many flume agents as you want, they are shared nothing. So you can achieve scale by having your application , or a flume sink, distribute events over the wire to one of many agents downstream. The flume docs are a good primer if you haven't read them yet (https://flume.apache.o

Re: Flume Cluster?

Saikat, how up to date is this material? Considering what Iain Wright just said about lack of such a thing as a cluster? thanks JEff From: Saikat Kanjilal Sent: Friday, April 7, 2017 1:24:52 PM To: user@flume.apache.org Subject: Re: Flume Cluster? http://anki

Re: Flume Cluster?

It depends how you are defining "Cluster". I generally think of it as mutliple processes that are coordinating and using some kind of consesous algorithm. (IE Zookeeper). Perhaps my definition is wrong, or differs from yours. You can ofcourse achieve durability, high availability, and scale using