Re: Flume Compile 1.5.0 for HBase 0.98.3

2014-07-27 Thread a...@hsk.hk
Hi, Thanks! I downloaded 1.5.0.1, if I add -DskipTests, I compiled it successfully. However, if run the following (i.e. with tests) , I still got error. Many thanks. Regards Arthur mvn clean install -Dhadoop.profile=hbase-98 -Dhbase.version=0.98.3-hadoop2 [INFO] --- maven-install-plugin

Re: Flume Compile 1.5.0 for HBase 0.98.3

2014-07-27 Thread a...@hsk.hk
Hi Hari, I have finally managed to compile it successfully, many thanks for your help!! I edited pom.xml and deleted the following lines (around line 247), and stop all Hadoop and HBase ### DELETED org.apache.hadoop hadoop-minicluster ${hadoop.v

Re: Flume Compile 1.5.0 for HBase 0.98.3

2014-07-27 Thread Hari Shreedharan
If you remove the -Dhbase.version and use the default one (0.98.2-hadoop2), then it should build fine (at least it builds fine for me). Flume built against hbase-98 should be able to write to hbase 0.98.3. Also, I remember a hadoop minicluster requirement that requires umask be set to 022 (not su

Re: Flume Compile 1.5.0 for HBase 0.98.3

2014-07-27 Thread Andrew Purtell
Something built against HBase 0.98.2-hadoop2 will definitely work with any later release that has also been built against Hadoop 2. We just released 0.98.4 last week. IIRC, setting the umask like that was needed for Hadoop 1 miniclusters. I haven't personally needed to set it when working with

Re: Flume Compile 1.5.0 for HBase 0.98.3

2014-07-27 Thread ac
Hi Andrew and Hari, Thank you! At the moment, I can just ignore the warning, the compilation works. Regards Arthur - Original Message - From: Andrew Purtell To: user@flume.apache.org Cc: a...@hsk.hk Sent: Mon, 28 Jul 2014 05:52:23 +0800 (HKT) Subject: Re: Flume Compile 1.5.0 for HBase 0

Flume 1.5.0 hdfs sink stuck with channel is full messages

2014-07-27 Thread Viral Bajaria
Hi, I am using 1.5.0 with the hdfs sink to write files to S3. The process writes fine for a while but eventually I started getting the following message: INFO [pool-5-thread-1] (org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents:224) - Last read was never committed - resett