1) The source is Avro client. The events are lost. The intent of the
question is there a way I can provide failover for the very first Flume
Source without getting duplicate events.
2) Here is configuration for Failover sinks along with the logs.
ag1.sources=s1
ag1.channels=c1
ag1.sinks=k1 k2
a
Problem found and resolved... 2 versions on Lucene jar in the lib dir...
I delete the older... And it work fine !
Sorry,
Sylvain
Le 7 févr. 2014 08:24, "Luce Sylvain" a écrit :
> Hi all,
>
> I'm using for few days apache flume with elasticsearch.
>
> My source is a JMS queue
> My sink is elastics
Hi ed,
Thanks for your response. I was afraid that the solution was to write my own
serializer, not the most expert Java programmer :P
But I think that is the only solution, reading more at the docs:
This deserializer is able to read an Avro container file, and it generates one
event per Avro
Mayur,
The hdfs sink is going to keep trying to connect for maxRetries=10
Are you able to post the complete log? or at least another couple of
minutes ?
-Jeff
On Fri, Feb 7, 2014 at 1:32 AM, Mayur Gupta wrote:
> 1) The source is Avro client. The events are lost. The intent of the
> question
Sorry for the delayed reply, I'm pretty busy these days...
On Mon, Feb 3, 2014 at 10:51 AM, Pritchard, Charles X. -ND <
charles.x.pritchard@disney.com> wrote:
> I’ve got the SSL portion working well; if the client has a signed cert, I
> get a string back, if it doesn’t, I fall back to a gener
On Feb 7, 2014, at 4:25 PM, Mike Percy
mailto:mpe...@apache.org>> wrote:
I’ve posted sample code to the bug report I filed:
https://issues.apache.org/jira/browse/FLUME-2204
OK, cool.
Is AvroSource instantiated for every connection?
https://github.com/apache/flume/blob/flume-1.4/flume-ng-core/
Ok, after some help in the Avro mailing list I came up with a solution.
I was in the right path, with the avro schema in the flume header field and the
binary data from the values in the body field is possible to reconstruct the
original avro file. So now I don’t need to define the schema in the
Hi Dan,
Thanks for sharing! Glad you got it working =)
I'm sure this will be very helpful for future flume HDFS avro users.
Best,
Ed
On Sat, Feb 8, 2014 at 10:46 AM, Daniel Rodriguez wrote:
> Ok, after some help in the Avro mailing list I came up with a solution.
>
> I was in the right pat
On Fri, Feb 7, 2014 at 5:15 PM, Pritchard, Charles X. -ND <
charles.x.pritchard@disney.com> wrote:
>
> I’m finding it a challenge to see where in the AvroSource class I could
> actually push the data into Event headers.
> All of those methods are stateless when it comes to the connection — they
I’d like to be able to use the client CN in subsequent configuration/routing
parameters.
The bulk of the Flume config (e.g. selectors, sinks) works with event headers.
A bit confused as to what you’re asking/what your context is when you bring up
event persistence.
At the point the event is sub
Hello,
I am new to Flume. I try to build flume on mac os x, but project flume-ng-sdk
failed with error "[ERROR] Failed to execute goal
org.apache.rat:apache-rat-plugin:0.7:check (verify.rat) on project
flume-ng-sdk: Too many unapproved licenses”. Any suggestion ?
MacBook-Pro:flume l$ java -ver
On Fri, Feb 7, 2014 at 6:50 PM, Pritchard, Charles X. -ND <
charles.x.pritchard@disney.com> wrote:
> I’d like to be able to use the client CN in subsequent
> configuration/routing parameters.
> The bulk of the Flume config (e.g. selectors, sinks) works with event
> headers.
>
Does it need to
Looks like there is a file without the asf header. Can you check
flume-ng-sdk/target/rat.txt?
Thanks,
Hari
On Friday, February 7, 2014 at 8:10 PM, Xiaobo Liu wrote:
> Hello,
>
> I am new to Flume. I try to build flume on mac os x, but project flume-ng-sdk
> failed with er
13 matches
Mail list logo
