Flume Issues

2014-06-12 Thread Mangtani, Kushal
Hi, I have noticed a couple of issues in my flume setup. Below I have described my setup,issues, flume.conf Setup:- I'm using Flume-Ng 1.4 cdh4.4 Tarball for collecting aggregated logs. I am running a 2 tier(agent,collector) Flume Configuration with custom plugins. There are approximately 20 a

Flume event truncation to 16 bytes

2014-06-12 Thread Ran Mozes
Hi, I couldn’t find a helpful answer on the internet and I hope someone on this alias might be able to help: I have a simple flume setup which uses netcat as a source and a custom sink do deliver the events using http post to a target. The problem is that the events are being truncated to 16 byt

Flume restart after sync destination failure

2014-06-12 Thread saverio mucci
Hi all! I'm a new user to the ML and to Flume too. I started using flume to make sure that all my data gets into hbase from the frontend http server and i'm quite satisfied. The problem i got is connected to the moments when hbase does not respond correctly like a crash/or network problem then flu

Re: Flume restart after sync destination failure

2014-06-12 Thread Roshan Naik
Are you saying that flume does not resume normal operation after a HBase connectivity is restored ? -roshan On Thu, Jun 12, 2014 at 3:29 AM, saverio mucci wrote: > Hi all! > I'm a new user to the ML and to Flume too. > > I started using flume to make sure that all my data gets into hbase from >