Hi, I have tried several times about compiling Flume 1.5.0 for HBase 0.98.3, with some progress but still failed.
Can someone advise what the proper settings in pom.xml is? or which repository contains HBase 0.98.3 jar files? or any ideas to fix this? Many thanks!! Arthur [INFO] ------------------------------------------------------------------------ [INFO] Building Flume NG HBase Sink 1.5.0 [INFO] ------------------------------------------------------------------------ [WARNING] The POM for org.apache.hbase:hbase:jar:0.98.3 is missing, no dependency information available [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Flume ...................................... SUCCESS [0.873s] [INFO] Flume NG SDK ...................................... SUCCESS [1.681s] [INFO] Flume NG Configuration ............................ SUCCESS [0.249s] [INFO] Flume NG Core ..................................... SUCCESS [1.771s] [INFO] Flume NG Sinks .................................... SUCCESS [0.048s] [INFO] Flume NG HDFS Sink ................................ SUCCESS [0.914s] [INFO] Flume NG IRC Sink ................................. SUCCESS [0.144s] [INFO] Flume NG Channels ................................. SUCCESS [0.067s] [INFO] Flume NG JDBC channel ............................. SUCCESS [0.210s] [INFO] Flume NG file-based channel ....................... SUCCESS [0.246s] [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.127s] [INFO] Flume NG Node ..................................... SUCCESS [0.159s] [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.414s] [INFO] Flume NG HBase Sink ............................... FAILURE [0.064s] [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED [INFO] Flume NG Kite Dataset Sink ........................ SKIPPED [INFO] Flume Sources ..................................... SKIPPED [INFO] Flume Scribe Source ............................... SKIPPED [INFO] Flume JMS Source .................................. SKIPPED [INFO] Flume Twitter Source .............................. SKIPPED [INFO] Flume legacy Sources .............................. SKIPPED [INFO] Flume legacy Avro source .......................... SKIPPED [INFO] Flume legacy Thrift Source ........................ SKIPPED [INFO] Flume NG Clients .................................. SKIPPED [INFO] Flume NG Log4j Appender ........................... SKIPPED [INFO] Flume NG Tools .................................... SKIPPED [INFO] Flume NG distribution ............................. SKIPPED [INFO] Flume NG Integration Tests ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 7.385s [INFO] Finished at: Sat Jul 26 22:52:42 HKT 2014 [INFO] Final Memory: 41M/622M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: Failure to find org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :flume-ng-hbase-sink On 26 Jul, 2014, at 7:28 pm, a...@hsk.hk wrote: > Hi, > > I am trying to compile and run unit test (flume 1.5.0) for Hadoop 2.4.0 and > HBase 0.98.3. > > I got "cannot find symbol: class MiniDFSCluster”, is it something wrong in > pom.xml? please help!! > > Regards > Arthur > > > > > > > command: mvn clean test > > === log === > [ERROR] COMPILATION ERROR : > [INFO] ------------------------------------------------------------- > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29] > cannot find symbol > symbol : class MiniDFSCluster > location: package org.apache.hadoop.hdfs > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17] > cannot find symbol > symbol : class MiniDFSCluster > location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39] > cannot find symbol > symbol : class MiniDFSCluster > location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18] > cannot find symbol > symbol : class MiniDFSCluster > location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18] > cannot find symbol > symbol : class MiniDFSCluster > location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18] > cannot find symbol > symbol : class MiniDFSCluster > location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18] > cannot find symbol > symbol : class MiniDFSCluster > location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [INFO] 7 errors > [INFO] ------------------------------------------------------------- > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Flume ...................................... SUCCESS [0.649s] > [INFO] Flume NG SDK ...................................... SUCCESS [1:12.668s] > [INFO] Flume NG Configuration ............................ SUCCESS [1.092s] > [INFO] Flume NG Core ..................................... SUCCESS [6:52.046s] > [INFO] Flume NG Sinks .................................... SUCCESS [0.095s] > [INFO] Flume NG HDFS Sink ................................ FAILURE [1.990s] > [INFO] Flume NG IRC Sink ................................. SKIPPED > [INFO] Flume NG Channels ................................. SKIPPED > [INFO] Flume NG JDBC channel ............................. SKIPPED > [INFO] Flume NG file-based channel ....................... SKIPPED > [INFO] Flume NG Spillable Memory channel ................. SKIPPED > [INFO] Flume NG Node ..................................... SKIPPED > [INFO] Flume NG Embedded Agent ........................... SKIPPED > [INFO] Flume NG HBase Sink ............................... SKIPPED > [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED > [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED > [INFO] Flume Sources ..................................... SKIPPED > [INFO] Flume Scribe Source ............................... SKIPPED > [INFO] Flume JMS Source .................................. SKIPPED > [INFO] Flume Twitter Source .............................. SKIPPED > [INFO] Flume legacy Sources .............................. SKIPPED > [INFO] Flume legacy Avro source .......................... SKIPPED > [INFO] Flume legacy Thrift Source ........................ SKIPPED > [INFO] Flume NG Clients .................................. SKIPPED > [INFO] Flume NG Log4j Appender ........................... SKIPPED > [INFO] Flume NG Tools .................................... SKIPPED > [INFO] Flume NG distribution ............................. SKIPPED > [INFO] Flume NG Integration Tests ........................ SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 8:09.120s > [INFO] Finished at: Sat Jul 26 19:18:55 HKT 2014 > [INFO] Final Memory: 71M/455M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile > (default-testCompile) on project flume-hdfs-sink: Compilation failure: > Compilation failure: > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29] > cannot find symbol > [ERROR] symbol : class MiniDFSCluster > [ERROR] location: package org.apache.hadoop.hdfs > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17] > cannot find symbol > [ERROR] symbol : class MiniDFSCluster > [ERROR] location: class > org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39] > cannot find symbol > [ERROR] symbol : class MiniDFSCluster > [ERROR] location: class > org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18] > cannot find symbol > [ERROR] symbol : class MiniDFSCluster > [ERROR] location: class > org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18] > cannot find symbol > [ERROR] symbol : class MiniDFSCluster > [ERROR] location: class > org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18] > cannot find symbol > [ERROR] symbol : class MiniDFSCluster > [ERROR] location: class > org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] > /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18] > cannot find symbol > [ERROR] symbol : class MiniDFSCluster > [ERROR] location: class > org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :flume-hdfs-sink > >
