Congratulations Patrick! Well deserved!
Regards,
Arvind Prabhakar
On Mon, Nov 12, 2012 at 1:04 PM, Hari Shreedharan wrote:
> On behalf of the Apache Flume PMC, I am excited to welcome Patrick
> Wendell as a committer on Flume! Patrick has contributed significantly to
> the project,
[Moving the conversation to user@flume.apache.org as this is not a CDH
specific question]
Flume allows writing events to a directory whose path contains
substitutable tokens. At the time of writing out these events, these tokens
are substituted with corresponding header values. You can provide the
3.4.0.Final
Regards,
Arvind Prabhakar
On Wed, Jan 23, 2013 at 12:44 PM, Mike Percy wrote:
> If you want only the required library files, use Maven to pull in the
> exact set of dependencies.
>
>
> On Wed, Jan 23, 2013 at 12:24 PM, yogi nerella wrote:
>
>> Mike,
>>
>
I used the standard maven dependency plugin to get this information.
$ mvn dependency:tree
This will list out all the dependencies no matter what their scope is. But
you can safely ignore dependencies that have a test scope.
Regards,
Arvind Prabhakar
On Wed, Jan 23, 2013 at 1:39 PM, yogi
why it will fail during the event's removal. It is more
likely that there is a problem within the channel in that it cannot
dereference the event correctly. Looking at the logs will help us identify
the root cause for what you are experiencing.
Regards,
Arvind Prabhakar
On Wed, Jul 24, 2013 at
Sounds like a bug in ElasticSearch sink to me. Do you mind filing a Jira to
track this? Sample data to cause this would be even better.
Regards,
Arvind Prabhakar
On Thu, Jul 25, 2013 at 9:50 AM, Jeremy Karlson wrote:
> This was using the provided ElasticSearch sink. The logs were not
> h
shared and will help provide more details
for this problem, it will be great if you could attach them to this jira
and provide your comments.
[1] https://issues.apache.org/jira/browse/FLUME-2140
Regards,
Arvind Prabhakar
On Thu, Aug 1, 2013 at 10:33 AM, Paul Chavez <
p
discussion is going in FLUME-2173 in case you are interested.
https://issues.apache.org/jira/browse/FLUME-2173
Regards,
Arvind Prabhakar
On Wed, Aug 28, 2013 at 12:09 AM, Anat Rozenzon wrote:
> Hi,
>
> I want to get some statistics out of Flume (For example, how many records
> we
Congratulations Roshan!
Regards,
Arvind Prabhakar
On Tue, Sep 24, 2013 at 4:05 PM, Mike Percy wrote:
> Congrats Roshan, welcome!
>
> Mike
>
>
> On Tue, Sep 24, 2013 at 3:47 PM, Jarek Jarcec Cecho wrote:
>
>> Congratulations Roshan, well done!
>>
>> Jar
Congratulations Wolfgang!
Regards,
Arvind Prabhakar
On Tue, Sep 24, 2013 at 4:05 PM, Mike Percy wrote:
> Congrats Wolfgang, and welcome!
>
> Mike
>
>
> On Tue, Sep 24, 2013 at 3:46 PM, Jarek Jarcec Cecho wrote:
>
>> Congratulations Wolfgang, well done!
>>
>
Hi Alex,
Unfortunately interceptors can only be applied to the sources. At this
time, we do not have support for sink-side interceptors. There is
FLUME-1207 that tracks this request.
https://issues.apache.org/jira/browse/FLUME-1207
Regards,
Arvind Prabhakar
On Wed, Oct 2, 2013 at 4:45 AM
This is indirectly available in Flume (NG) via the number of sinks you
setup. Each sink operates on a single thread that drains the channel at a
steady rate. If you want to have a lower drain rate, reduce the number of
sinks; and conversely increase them for higher drain rate.
Regards,
Arvind
single
thread transfer semantics.
Regards,
Arvind Prabhakar
On Thu, May 8, 2014 at 5:47 AM, pravesh suyal wrote:
> Thanx Arvind.
>
> Is the steady rate configurable through the flume configurations?
> Otherwise, that would mean we need to adjust through adjusting the total
> number of
need all kinds of talks - deep technical talks, hands-on
tutorials, introductions for beginners, or case studies about the
awesome stuff you're doing with Flume.
Please consider submitting a proposal, at
http://events.linuxfoundation.org//events/apachecon-europe/program/cfp
Thanks,
Arvind Prabhakar
Hi Dave,
I will be happy to present Flume at your meetup if calendar permits. When
are you planning on hosting the meetup and where exactly?
Regards,
Arvind Prabhakar
On Fri, Aug 22, 2014 at 2:57 PM, Dave Mangot wrote:
> Hey,
>
> I'm the organizer for the San Francisco Loggin
Sounds good to me, looking forward to presenting Flume at your next meetup.
Regards,
Arvind Prabhakar
On Tue, Aug 26, 2014 at 11:49 PM, Dave Mangot wrote:
> We usually have them every two months. I think the last one might have
> been in July and since I'm an architect at Sales
.
Santiago (and others who would like to contribute) - please go ahead and
create the necessary Jiras if they do not exist already, and invite the
community to vote on those. That way we can prioritize the review and
commit for functionality that is aligned with community requirements.
Regards,
Arvind
the agent without applying any back
pressure to the upstream flow.
Regards,
Arvind Prabhakar
On Mon, Oct 20, 2014 at 11:39 AM, terrey shih wrote:
> Hi
>
> Yes, I have looked into that but that does not really work either because
> the extra IO might slow down the whole agent which a
and welcoming him to the Flume PMC.
Regards,
Arvind Prabhakar
Hi David,
The configuration you shared sets up a Flume Agent to listen in for Syslog
messages using UDP transport on port 5140. Hence Flume itself acts as the
receiver of the messages and not the sender.
Regards,
Arvind Prabhakar
On Mon, Nov 24, 2014 at 3:25 PM, David Novogrodsky
Hi Wayne,
Thanks for doing the investigation, this seems like a legitimate problem. I
have created an issue to track this (FLUME-2564
<https://issues.apache.org/jira/browse/FLUME-2564>). In case you already
have a patch to address this problem, please post that on the Jira.
Regards,
Flume is not suited for file transfers as such. With that, please see my
comments below:
- support for variable transaction size that could be set by the source or
> interceptor
>
The transactions are already variable sized. The only configuration that
applies on top is the maximum size of a tran
ng like an Oozie
>> action to trigger a job when the dataset is complete. ” - But how will
>> I know that flume completed its transfer (moreover we want this to happen
>> at regular intervals)
>>
>>
>>
>> Thanks,
>>
>> Manohar
>>
>>
Apache Flume.
Please join me in congratulating Hari on his appointment and welcoming him
to this role.
Regards,
Arvind Prabhakar
matically redirect to the
new location.
If you have any issues due to this migration, please let me know.
Regards,
Arvind Prabhakar
channel. Although it
probably will improve performance, it is hard to tell for sure unless we
test it out under load in different scenarios.
Regards,
Arvind Prabhakar
On Wed, Jul 4, 2012 at 3:33 AM, Juhani Connolly <
juhani_conno...@cyberagent.co.jp> wrote:
> It looks good to me as it pr
em is back up, you could route the traffic back to this agent.
I am sure that there are multiple other ways of doing this.
Regards,
Arvind Prabhakar
>
> Thanks,
> --
> ..Senthil
>
> "If there's anything more important than m
; both ports. Block the first one, all events will be redirected to the other
>> port. Wait 5 minutes, the mem channel should be clear now. Do you changes,
>> start the new config, redirect the traffic to these port and change the
>> other config.
>>
>> cheers
One clarification - as Mubarak mentioned, there is already a Jira for this
FLUME-1318 <https://issues.apache.org/jira/browse/FLUME-1318>. So instead
of filing a new issue, you can add your details and thoughts to this.
Regards,
Arvind Prabhakar
On Tue, Jul 10, 2012 at 2:20 AM, Arvind Pra
more of a long term target.
>
Perhaps what you are describing is a different type of persistent channel
that is optimized for high latency IO systems. I would encourage you to
take your idea one step further and see if that can be drafted as yet
another channel that serves this particu
[X] +1 Accept git as the primary source control for Apache Flume.
Regards,
Arvind Prabhakar
On Sun, Jul 15, 2012 at 12:22 PM, Hari Shreedharan <
hshreedha...@cloudera.com> wrote:
> This is a call for VOTE to change the primary source control for Apache
> Flume from Subversion t
configuration subsystem simply flags the second
inclusion as a problem and ignores it. By design, a sink can either be on
its own or in one explicit sink group.
[1] https://issues.apache.org/jira/browse/FLUME-1488
Regards,
Arvind Prabhakar
On Fri, Aug 17, 2012 at 8:59 AM, Chris Neal wrote
;
It does get added back for the subsequent invocations. The Failover sink
processor on the other hand has a back-off semantic which
will exponentially increase the waiting period before a sink is retried.
Regards,
Arvind Prabhakar
>
> Chris
>
> On Fri, Aug 17, 2012 at 12:01 PM, Arv
bet is to try out your deployment plan in staging and
test it for performance before going production.
Regards,
Arvind Prabhakar
On Tue, Sep 4, 2012 at 8:38 PM, Shara Shi wrote:
> Who can suggest me the maximum number of avro sinks can be served by one
> avro source?
>
> Dose i
Hi Prajakta,
You could possibly use the Exec source with the "tail -F /path/to/file"
command. One limitation of this approach is that it does not maintain any
state so you won't be able to resume/restart from a location within the
file. To address those cases, it may be necessary for you to write
35 matches
Mail list logo
