Hi Arthur, Almost done! You now need to copy them on the HBase folder.
hbase@hbasetest1:~/hbase-0.98.2-hadoop2/lib$ tree | grep -v .jar | grep -v .rb . ├── native │ └── Linux-x86 │ ├── libsnappy.a │ ├── libsnappy.la │ ├── libsnappy.so │ ├── libsnappy.so.1 │ └── libsnappy.so.1.2.0 I don't have any hadoop-snappy lib in my hbase folder and it works very well with Snappy for me... JM 2014-08-26 8:09 GMT-04:00 [email protected] <[email protected] >: > Hi JM, > > Below are my steps to install snappy lib, do I miss something? > > Regards > Arthur > > wget https://snappy.googlecode.com/files/snappy-1.1.1.tar.gz > tar -vxf snappy-1.1.1.tar.gz > cd snappy-1.1.1 > ./configure > make > make install > make[1]: Entering directory `/edh/hadoop_all_sources/snappy-1.1.1' > test -z "/usr/local/lib" || /bin/mkdir -p "/usr/local/lib" > /bin/sh ./libtool --mode=install /usr/bin/install -c > libsnappy.la '/usr/local/lib' > libtool: install: /usr/bin/install -c .libs/libsnappy.so.1.2.0 > /usr/local/lib/libsnappy.so.1.2.0 > libtool: install: (cd /usr/local/lib && { ln -s -f > libsnappy.so.1.2.0 libsnappy.so.1 || { rm -f libsnappy.so.1 && ln -s > libsnappy.so.1.2.0 libsnappy.so.1; }; }) > libtool: install: (cd /usr/local/lib && { ln -s -f > libsnappy.so.1.2.0 libsnappy.so || { rm -f libsnappy.so && ln -s > libsnappy.so.1.2.0 libsnappy.so; }; }) > libtool: install: /usr/bin/install -c .libs/libsnappy.lai > /usr/local/lib/libsnappy.la > libtool: install: /usr/bin/install -c .libs/libsnappy.a > /usr/local/lib/libsnappy.a > libtool: install: chmod 644 /usr/local/lib/libsnappy.a > libtool: install: ranlib /usr/local/lib/libsnappy.a > libtool: finish: > PATH="/edh/hadoop/spark/bin:/edh/hadoop/hbase/bin:/edh/hadoop/zookeeper//bin:/edh/hadoop/yarn/hadoop/bin:/edh/hadoop/yarn/hadoop/sbin:/usr/lib64/qt-3.3/bin:/opt/apache-maven-3.1.1/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/edh/hadoop/zookeeper//bin:/edh/hadoop/hive//bin:/usr/lib/jvm/jdk1.6.0_45//bin:/root/bin:/sbin" > ldconfig -n /usr/local/lib > > ---------------------------------------------------------------------- > Libraries have been installed in: > /usr/local/lib > If you ever happen to want to link against installed libraries > in a given directory, LIBDIR, you must either use libtool, and > specify the full pathname of the library, or use the `-LLIBDIR' > flag during linking and do at least one of the following: > - add LIBDIR to the `LD_LIBRARY_PATH' environment variable > during execution > - add LIBDIR to the `LD_RUN_PATH' environment variable > during linking > - use the `-Wl,-rpath -Wl,LIBDIR' linker flag > - have your system administrator add LIBDIR to `/etc/ld.so.conf' > See any operating system documentation about shared libraries for > more information, such as the ld(1) and ld.so(8) manual pages. > > ---------------------------------------------------------------------- > test -z "/usr/local/share/doc/snappy" || /bin/mkdir -p > "/usr/local/share/doc/snappy" > /usr/bin/install -c -m 644 ChangeLog COPYING INSTALL NEWS README > format_description.txt framing_format.txt '/usr/local/share/doc/snappy' > test -z "/usr/local/include" || /bin/mkdir -p "/usr/local/include" > /usr/bin/install -c -m 644 snappy.h snappy-sinksource.h > snappy-stubs-public.h snappy-c.h '/usr/local/include' > make[1]: Leaving directory `/edh/hadoop_all_sources/snappy-1.1.1' > > ll /usr/local/lib > -rw-r--r--. 1 root root 233554 Aug 20 00:14 libsnappy.a > -rwxr-xr-x. 1 root root 953 Aug 20 00:14 libsnappy.la > lrwxrwxrwx. 1 root root 18 Aug 20 00:14 libsnappy.so -> > libsnappy.so.1.2.0 > lrwxrwxrwx. 1 root root 18 Aug 20 00:14 libsnappy.so.1 -> > libsnappy.so.1.2.0 > -rwxr-xr-x. 1 root root 147726 Aug 20 00:14 libsnappy.so.1.2.0 > > > > On 26 Aug, 2014, at 7:38 pm, Jean-Marc Spaggiari <[email protected]> > wrote: > > > Hi Arthur, > > > > Do you have snappy libs installed and configured? HBase doesn't come with > > Snappy. So yo need to have it first. > > > > Shameless plug: > > > http://www.spaggiari.org/index.php/hbase/how-to-install-snappy-with-1#.U_xxSqdZuZY > > > > This is for 0.96 but should be very similar for 0.98. I will try it soon > > and post and update, but keep us posted here so we can support you... > > > > JM > > > > > > 2014-08-26 7:34 GMT-04:00 [email protected] < > [email protected] > >> : > > > >> Hi, > >> > >> I need to install snappy to HBase 0.98.4. (my Hadoop version is 2.4.1) > >> > >> Can you please advise what would be wrong? Should my pom.xml be > incorrect > >> and missing something? > >> > >> Regards > >> Arthur > >> > >> > >> Below are my commands: > >> bash -x ./dev-support/generate-hadoopX-poms.sh 0.98.4 0.98.4-hadoop2 > >> mvn -f pom.xml.hadoop2 install -DskipTests assembly:single > >> -Prelease,hadoop-snappy > >> > >> Iog: > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] Building HBase - Server 0.98.4-hadoop2 > >> [INFO] > >> ------------------------------------------------------------------------ > >> [WARNING] The POM for org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT > >> is missing, no dependency information available > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] Reactor Summary: > >> [INFO] > >> [INFO] HBase ............................................. SUCCESS > [3.129s] > >> [INFO] HBase - Common .................................... SUCCESS > [3.105s] > >> [INFO] HBase - Protocol .................................. SUCCESS > [0.976s] > >> [INFO] HBase - Client .................................... SUCCESS > [0.925s] > >> [INFO] HBase - Hadoop Compatibility ...................... SUCCESS > [0.183s] > >> [INFO] HBase - Hadoop Two Compatibility .................. SUCCESS > [0.497s] > >> [INFO] HBase - Prefix Tree ............................... SUCCESS > [0.407s] > >> [INFO] HBase - Server .................................... FAILURE > [0.103s] > >> [INFO] HBase - Testing Util .............................. SKIPPED > >> [INFO] HBase - Thrift .................................... SKIPPED > >> [INFO] HBase - Shell ..................................... SKIPPED > >> [INFO] HBase - Integration Tests ......................... SKIPPED > >> [INFO] HBase - Examples .................................. SKIPPED > >> [INFO] HBase - Assembly .................................. SKIPPED > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] BUILD FAILURE > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] Total time: 9.939s > >> [INFO] Finished at: Tue Aug 26 19:23:14 HKT 2014 > >> [INFO] Final Memory: 61M/2921M > >> [INFO] > >> ------------------------------------------------------------------------ > >> [ERROR] Failed to execute goal on project hbase-server: Could not > resolve > >> dependencies for project > org.apache.hbase:hbase-server:jar:0.98.4-hadoop2: > >> Failure to find org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT in > >> http://maven.oschina.net/content/groups/public/ was cached in the local > >> repository, resolution will not be reattempted until the update > interval of > >> nexus-osc has elapsed or updates are forced -> [Help 1] > >> [ERROR] > >> [ERROR] To see the full stack trace of the errors, re-run Maven with the > >> -e switch. > >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. > >> [ERROR] > >> [ERROR] For more information about the errors and possible solutions, > >> please read the following articles: > >> [ERROR] [Help 1] > >> > http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException > >> [ERROR] > >> [ERROR] After correcting the problems, you can resume the build with the > >> command > >> [ERROR] mvn <goals> -rf :hbase-server > >> > >> > >
