Hari,
I am using Flume 1.4.0.
Jeff,
Regarding this fixed size checkpoint file, what should be the ideal size of
this checkpoint file or in other words, what to consider while defining
checkpoint file?
Thanks,
Deepesh
On Friday, September 13, 2013, Hari Shreedharan wrote:
> Also, which version
What is the channel size you are trying to use?
Thanks,
Hari
On Friday, September 13, 2013 at 11:15 AM, Deepesh Malviya wrote:
> Hari,
>
> I am using Flume 1.4.0.
>
> Jeff,
>
> Regarding this fixed size checkpoint file, what should be the ideal size of
> this checkpoint file or in other
Deepesh,
The FileChannel uses a fixed size checkpoint file so it is not possible to
set it to unlimited size (the checkpoint file is mmap-ed to a fixed size
buffer). To change the capacity of the channel, use the following procedure:
Shutdown the agent.
Delete all files in the file channel's chec
Also, which version of Flume are you running. Looks like you are hitting
https://issues.apache.org/jira/browse/FLUME-1918 as well due to an unsupported
channel size in a previous version. This was fixed in Flume 1.4.0
Hari
Thanks,
Hari
On Friday, September 13, 2013 at 8:31 AM, Jeff Lord wr
I did not observe yesterday.
Now i realize that you are also subscribed to the flume ML.
Regards,
Shobha M
From: Babu, Prashanth [mailto:prashanth.b...@nttdata.com]
Sent: 13 September 2013 AM 07:46
To: user@flume.apache.org
Subject: RE: flume 1.4.0 avro source/sink with hdfs sink configuration -
Mahadevappa, Shobha would like to recall the message, "flume 1.4.0 avro
source/sink with hdfs sink configuration - no hdfs files created".
__
Disclaimer:This email and any attachments are sent in strictest confidence for
the sol
Mahadevappa, Shobha would like to recall the message, "flume 1.4.0 avro
source/sink with hdfs sink configuration - no hdfs files created".
__
Disclaimer:This email and any attachments are sent in strictest confidence for
the sol
Yes I tried splitting into agent and collector (with different names) but
it was in a single configuration file flume-avro.conf.
does that mean I need to have 2 separate configuration files, 1 for the
agent and 1 for the collector?
If so, is my flume launch command still the same then ? is it
.
Yes, it would be better for you to create 2 configurations one each for agent
and collector.
Run the following commands for starting the Flume instances in 2 different
command shells.
../bin/flume-ng agent --conf ./ -f flume-avro.conf
-Dflume.root.logger=DEBUG,LOGFILE -n agent &
../bin/flume-
I think you can do this on one node, but you will need to run two instances of
flume, each with a different agent name.
Paul
From: Suhas Satish [mailto:suhas.sat...@gmail.com]
Sent: Thursday, September 12, 2013 10:58 AM
To: user@flume.apache.org
Subject: Re: flume 1.4.0 avro source/sink with hdf
10 matches
Mail list logo
