In document the avro source agent example is given below, where is the
source file to write its content into sink, please help me.
a1.sources = r1a1.channels = c1a1.sources.r1.type =
avroa1.sources.r1.channels = c1a1.sources.r1.bind =
0.0.0.0a1.sources.r1.port = 4141
--
Thanks,
Kishore.
That is an avro source, which means the producer or the app producing
events needs to send it's data in the avro format. This is also used for
building a multi-hop flume pipeline. Is this what you're asking?
On Wed, Jun 25, 2014 at 12:37 PM, kishore alajangi <
alajangikish...@gmail.com> wrote:
Did you try using the spooldir source with an hdfs sink? What problems did
you face?
--
Sharninder
On Wed, Jun 25, 2014 at 12:15 PM, kishore alajangi <
alajangikish...@gmail.com> wrote:
> Hi Flume Experts,
>
> Could anybody help me to store avro files located in my localfilesystem
> into hdfs
My question is where is that input avro format file mentioned in the
configuration file.
Sent from my iPhone
On Jun 25, 2014, at 2:06 PM, Sharninder wrote:
> That is an avro source, which means the producer or the app producing events
> needs to send it's data in the avro format. This is also
That example only mentions the source part of a flume instance. You either
need another flume instance with an avro sink to feed to it OR write an
application that uses the client SDK to generate events in the avro format
to feed to this source. It's only an example and so where the data is
coming
Hi,
I'm trying to send a file (or events) over flume to a remote file store
(could be HDFS too, later) with the only condition that the entire
transmission be encrypted. The topology looks something like this:
file source->encrypted avro sink -> avro source -> file sink
This is failing at the se
yes sharninder, I tried with the below configuration, but it throws
"flume.EventDeliveryException: Could not find schema for event" error,
please help me
first I copied the schema file to /etc/flume.conf/schemas(
created this directory explicitly)/avro.avsc
#defined source as spooldir, channel as
