Amqp Plugin

2014-03-13 Thread David Sinclair
Hi all, I developed the original Amqp plugin for flume-og, and finally got around to finishing the Amqp plugin for flume-ng. https://github.com/stampy88/flume-ng-amqp-plugin Let me know if anyone has any problems or questions. dave

Re: JMS Source on 1.3.0?

2014-03-13 Thread Christopher Shannon
The people on my side who take care of our Hadoop infrastructure are certain IBM won't support infrastructure touched by 1.4. We might be able to get away with using the JMS component as a custom source and leave our SLA intact On Mar 13, 2014 5:32 PM, "Kris Ogirri" wrote: > I am not certain how

Re: JMS Source on 1.3.0?

2014-03-13 Thread Kris Ogirri
I am not certain how performing the update to Flume violate any Service contract one could have with IBM but I am certain that Flume 1.3 has a significant amount of issues with Hbase connectivity. You might have to discuss the legal implications with your IBM Sales Rep or Business Partner.( Disclai

Re: JMS Source on 1.3.0?

2014-03-13 Thread Christopher Shannon
Kris, How does running Flume 1.4 affect your service contract with IBM? On Mar 13, 2014 5:02 PM, "Kris Ogirri" wrote: > Hello Christoper, > > I believe the latest versions of BigInsights does come with Flume 1.3 but > I have been able to successfully upgrade Flume within BigInsights to the > mo

Re: Multiple flume agent on single machine

2014-03-13 Thread Christopher Shannon
This looks to be just what I need. Thanx, Jeff - Chris On Mar 13, 2014 4:52 PM, "Jeff Lord" wrote: > You can setup flume to use hdfs.proxyUser > > > https://cwiki.apache.org/confluence/display/FLUME/Flume+1.x+Secure+HDFS+Setup > > > On Thu, Mar 13, 2014 at 2:26 PM, Christopher Shannon < > cshan

Composing Customized HBase Event Serializer

2014-03-13 Thread Kris Ogirri
Hi, I was wondering if anyone could assist me with this issue. I am looking to create a customized Event serializer very similar to the Splitting event serializer found at this link While I am very familiar with the concept be

Re: JMS Source on 1.3.0?

2014-03-13 Thread Kris Ogirri
Hello Christoper, I believe the latest versions of BigInsights does come with Flume 1.3 but I have been able to successfully upgrade Flume within BigInsights to the most recent version I know of ( 1.4). The steps are straight-forward. 1) Download the flume v1.4 binary tarball from the Apache Flu

Re: Multiple flume agent on single machine

2014-03-13 Thread Jeff Lord
You can setup flume to use hdfs.proxyUser https://cwiki.apache.org/confluence/display/FLUME/Flume+1.x+Secure+HDFS+Setup On Thu, Mar 13, 2014 at 2:26 PM, Christopher Shannon wrote: > What if your sinks have to write out to destinations that have different > users and different levels of authoriz

Re: JMS Source on 1.3.0?

2014-03-13 Thread Christopher Shannon
IBM Big Insights. On Mar 13, 2014 4:47 PM, "Brock Noland" wrote: > I think it should work to run the 1.4 JMS source in 1.3. > > Out of curiosity, which vendor isn't shipping 1.4? > > Brock > > > On Thu, Mar 13, 2014 at 4:43 PM, Christopher Shannon < > cshannon...@gmail.com> wrote: > >> I know tha

Re: JMS Source on 1.3.0?

2014-03-13 Thread Brock Noland
I think it should work to run the 1.4 JMS source in 1.3. Out of curiosity, which vendor isn't shipping 1.4? Brock On Thu, Mar 13, 2014 at 4:43 PM, Christopher Shannon wrote: > I know that the JMS source is new in version 1.4, but has anyone tried > running this particular component on Flume 1.

JMS Source on 1.3.0?

2014-03-13 Thread Christopher Shannon
I know that the JMS source is new in version 1.4, but has anyone tried running this particular component on Flume 1.3.x? I can"t upgrade to 1.4 because of vendor lock-in. And I am condidering rolling my own JMS source for 1.3 if the source for 1.4 won't work. Any thoughts or recommendations?

Re: Multiple flume agent on single machine

2014-03-13 Thread Christopher Shannon
What if your sinks have to write out to destinations that have different users and different levels of authorization? How is security managed by Flume? On Mar 6, 2014 8:56 AM, "Simeon Zaharici" wrote: > Hello > > You do not need to run multiple flume agents, although this is possible. > You could

Re: Flume channel size value is 0 in ganglia

2014-03-13 Thread Abhijit Vaidya
Hi, > > I have flume setup to monitor with ganglia. But some how Channelsize > metric is not showing any data. Ganglia is not graphing. When I telnet to > see the Channelsize data, It returns 0 value. > > telnet localhost 8667 | grep -i channelsize > UNITS="" TN="30" TMAX="60" DMAX="0" SLOPE="bot