Hi All,
We are designing a near-real time pipeline in which we will receive
messages from IBM MQ. On the Hadoop side, we are planning to use Flume to
ingest the messages using JMS source.
The messages will include some custom header information, which we need to
extract as well. We discovered t
Hello,
I think you can achieve what you want with the JMSSourceConverter. Looking
at the Flume documentation it says that "The JMS source allows pluggable
converters, though it’s likely the default converter will work for most
purposes. The default converter is able to convert Bytes, Text, and Obj
You can try using blob handler in http source. Though blob is for binary,
we were able to push relatively large event.
For size limit, in our case we were not able to find default support in
flume. So we customized the code with a small function for checking the
size.
You can try similar.
Thanks,
Thank you, Muhammad. Much appreciated.
Regards
Kajal Kr. Das
Solution Architect - Etihad Ops BI
IBM
SUT #: +91 (0)80 4318 2743 | India Mobile #: +91 (0)98301 15013
E-mail: kajal@in.ibm.com
From: Muhammad Yaseen
To: user@flume.apache.org
Date: 08/31/2017 12:47 PM
Subject:
Hi,
Thanks for the suggestion. I will take a look at Blob Handler.
On Thu, Aug 31, 2017 at 1:28 PM, Archana Ravindran
wrote:
> You can try using blob handler in http source. Though blob is for binary,
> we were able to push relatively large event.
>
> For size limit, in our case we were not abl
