Hi,
It seems to me that the intention of the flume is to be used for intermediate
aggregation/processing of data which is to be dropped in some type of data
storage.
However, what is preventing us from implementing a customized sink that talks
to a remote program vic RPC (such as avro RPC)
Ha
The purpose of a sink is to take events from a channel and pass it on to a
further destination. That destination can be anything, including your
another program listening on rpc.
On Tue, Aug 12, 2014 at 1:26 PM, terreyshih wrote:
> Hi,
>
> It seems to me that the intention of the flume is to be
I could also do a talk/demo on the new Hive sink work.
-roshan
On Mon, Aug 11, 2014 at 3:25 PM, Jonathan Natkins
wrote:
> Hi everybody,
>
> I wanted to let you all know that we've gone and scheduled the next Flume
> meetup, which will be happening on Thursday, September 16 at the Cloudera
> San
Bumping this up; to make sure someone answers this.
P.S: let me know if i need to post these questions on a seperate thread.
Thanks,
Kushal Mangtani
From: Mangtani, Kushal
Sent: Friday, August 08, 2014 12:39 PM
To: user@flume.apache.org
Subject: RE: File Channel
Hi Roshan,
I tried searching around, but could not find the ticket.
Can you point me to the ticket which shows the details of the Hive Sink ?
Is it coming out in the next release ?
Thanks,
Viral
On Tue, Aug 12, 2014 at 1:43 PM, Roshan Naik wrote:
> I could also do a talk/demo on the new Hi
All,
I had a question around using flume with columnar file formats like Parquet
or ORC files.
Has anyone tried writing to HDFS by creating ORC files instead of the TEXT
or SEQUNCEFILE ?
Thanks,
Viral
The jira is FLUME-1734
The patch has been ready for a little while ... waiting on other committers
to review. Hopefully next flume version will have it.
-roshan
On Tue, Aug 12, 2014 at 2:59 PM, Viral Bajaria
wrote:
> Hi Roshan,
>
> I tried searching around, but could not find the ticket.
>
> Ca
I will take a look at it soon. Roshan - can you send me some API
references? Last time, I could not find any.
Roshan Naik wrote:
The jira is FLUME-1734
The patch has been ready for a little while ... waiting on other
committers to review. Hopefully next flume version will have it.
-roshan
On
Hi Hari,
Thanks for volunteering !
- Official Javadocs are here:
http://hive.apache.org/javadocs/r0.13.1/api/hcatalog/streaming/index.html.
-roshan
On Tue, Aug 12, 2014 at 3:45 PM, Hari Shreedharan wrote:
> I will take a look at it soon. Roshan - can you send me some API
> references? Las
Hey Roshan,
I think that's a great idea. I'll make a comment on the meetup page to
reflect this. Thanks for volunteering!
Natty
On Tue, Aug 12, 2014 at 1:43 PM, Roshan Naik wrote:
> I could also do a talk/demo on the new Hive sink work.
> -roshan
>
>
> On Mon, Aug 11, 2014 at 3:25 PM, Jonatha
Hello,guys
On Tue, Aug 12, 2014 at 10:38 PM, 基勇 <252637...@qq.com> wrote:
> But many scenes need to use both failover and load balancing to ensure
> environmental stability.
>
What stops you from using different sinks. Also load balancing sink
processor fails over between sinks if one sinks fails to send t
You are quite right. However, if the data is too large when the need to do load
balancing how to deal with?
-- 原始邮件 --
发件人: "Hari Shreedharan";;
发送时间: 2014年8月13日(星期三) 中午1:43
收件人: "user@flume.apache.org";
主题: Re: Flume sinkgroups sinks share problem
On Tue, Aug
13 matches
Mail list logo
