Nope, see the serializer field description
On Thu, Jun 19, 2014 at 11:42 AM, kishore alajangi <
alajangikish...@gmail.com> wrote:
> Hi Ashish,
>
> Do i need to use both avrosink and hdfssink to write the text file in avro
> format into hdfs?
>
>
> On Wed, Jun 18, 2014 at 12:13 PM, Ashish wrote:
Hi Ashish,
Do i need to use both avrosink and hdfssink to write the text file in avro
format into hdfs?
On Wed, Jun 18, 2014 at 12:13 PM, Ashish wrote:
> For reading -
> http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source
>
> For writing to HDFS -
> http://flume.apache.org/Fl
For reading -
http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source
For writing to HDFS - http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
Please refer to Sink properties for detailed configuration.
On Tue, Jun 17, 2014 at 7:38 PM, wrote:
> Hi flumers,
>
> Is there a way
Hi flumers,
Is there a way to read text files from local directory and write into Hdfs in
avro format by using flume?
Sent from my iPhone
\"type\": \"map\",
> \"values\": \"string\" } }, " +
> " {\"name\": \"body\", \"type\": \"bytes\" } ] }");
>
>
> On Thu, Oct 3, 2013 at 3:36 PM, Deepak Subhramanian <
>
gt; > sequence file. Is it not suppose to generate a avro file with default
> > > > > schema ? Or do I have to generate the avro data from text in my
> > > > > HTTPHandler source ?
> > > > >
> > > > > "{ \"type\
t;>
>>> "{ \"type\":\"record\", \"name\": \"Event\", \"fields\": [" +
>>>
>>> " {\"name\": \"headers\", \"type\": { \"type\": \"map\",
>>> \
t; } }, " +
>> " {\"name\": \"body\", \"type\": \"bytes\" } ] }");
>>
>>
>> On Thu, Oct 3, 2013 at 3:36 PM, Deepak Subhramanian <
>> deepak.subhraman...@gmail.com> wrote:
>>
gt;
> On Thu, Oct 3, 2013 at 3:36 PM, Deepak Subhramanian <
> deepak.subhraman...@gmail.com> wrote:
>
> Hi ,
>
> I want to convert xml files in text to an avro file and store it in hdfs .
> I get the xml files as a post request. I extended the HTTPHandler to
> process
" {\"name\": \"body\", \"type\": \"bytes\" } ] }");
>
>
>
> On Thu, Oct 3, 2013 at 3:36 PM, Deepak Subhramanian
> mailto:deepak.subhraman...@gmail.com)> wrote:
> > Hi ,
> >
> > I want to convert xml files in
" {\"name\": \"body\", \"type\": \"bytes\" } ] }");
On Thu, Oct 3, 2013 at 3:36 PM, Deepak Subhramanian <
deepak.subhraman...@gmail.com> wrote:
> Hi ,
>
> I want to convert xml files in text to an avro file and store it in hdfs .
>
Hi ,
I want to convert xml files in text to an avro file and store it in hdfs .
I get the xml files as a post request. I extended the HTTPHandler to
process the XML post request. Do I have to convert the data in text to avro
in HTTPHandler or does the Avro Sink or HDFSSink convert it directly to
12 matches
Mail list logo
