Hi JM Not too sure what you mean, do you mean I should create a new folder in my HBASE_SRC named lib/native/Linux-x86 and copy these files to this folder then try to compile it again?
Regards ARthur On 26 Aug, 2014, at 8:17 pm, Jean-Marc Spaggiari <[email protected]> wrote: > Hi Arthur, > > Almost done! You now need to copy them on the HBase folder. > > hbase@hbasetest1:~/hbase-0.98.2-hadoop2/lib$ tree | grep -v .jar | grep -v > .rb > . > ├── native > │ └── Linux-x86 > │ ├── libsnappy.a > │ ├── libsnappy.la > │ ├── libsnappy.so > │ ├── libsnappy.so.1 > │ └── libsnappy.so.1.2.0 > > I don't have any hadoop-snappy lib in my hbase folder and it works very > well with Snappy for me... > > JM > > 2014-08-26 8:09 GMT-04:00 [email protected] <[email protected] >> : > >> Hi JM, >> >> Below are my steps to install snappy lib, do I miss something? >> >> Regards >> Arthur >> >> wget https://snappy.googlecode.com/files/snappy-1.1.1.tar.gz >> tar -vxf snappy-1.1.1.tar.gz >> cd snappy-1.1.1 >> ./configure >> make >> make install >> make[1]: Entering directory `/edh/hadoop_all_sources/snappy-1.1.1' >> test -z "/usr/local/lib" || /bin/mkdir -p "/usr/local/lib" >> /bin/sh ./libtool --mode=install /usr/bin/install -c >> libsnappy.la '/usr/local/lib' >> libtool: install: /usr/bin/install -c .libs/libsnappy.so.1.2.0 >> /usr/local/lib/libsnappy.so.1.2.0 >> libtool: install: (cd /usr/local/lib && { ln -s -f >> libsnappy.so.1.2.0 libsnappy.so.1 || { rm -f libsnappy.so.1 && ln -s >> libsnappy.so.1.2.0 libsnappy.so.1; }; }) >> libtool: install: (cd /usr/local/lib && { ln -s -f >> libsnappy.so.1.2.0 libsnappy.so || { rm -f libsnappy.so && ln -s >> libsnappy.so.1.2.0 libsnappy.so; }; }) >> libtool: install: /usr/bin/install -c .libs/libsnappy.lai >> /usr/local/lib/libsnappy.la >> libtool: install: /usr/bin/install -c .libs/libsnappy.a >> /usr/local/lib/libsnappy.a >> libtool: install: chmod 644 /usr/local/lib/libsnappy.a >> libtool: install: ranlib /usr/local/lib/libsnappy.a >> libtool: finish: >> PATH="/edh/hadoop/spark/bin:/edh/hadoop/hbase/bin:/edh/hadoop/zookeeper//bin:/edh/hadoop/yarn/hadoop/bin:/edh/hadoop/yarn/hadoop/sbin:/usr/lib64/qt-3.3/bin:/opt/apache-maven-3.1.1/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/edh/hadoop/zookeeper//bin:/edh/hadoop/hive//bin:/usr/lib/jvm/jdk1.6.0_45//bin:/root/bin:/sbin" >> ldconfig -n /usr/local/lib >> >> ---------------------------------------------------------------------- >> Libraries have been installed in: >> /usr/local/lib >> If you ever happen to want to link against installed libraries >> in a given directory, LIBDIR, you must either use libtool, and >> specify the full pathname of the library, or use the `-LLIBDIR' >> flag during linking and do at least one of the following: >> - add LIBDIR to the `LD_LIBRARY_PATH' environment variable >> during execution >> - add LIBDIR to the `LD_RUN_PATH' environment variable >> during linking >> - use the `-Wl,-rpath -Wl,LIBDIR' linker flag >> - have your system administrator add LIBDIR to `/etc/ld.so.conf' >> See any operating system documentation about shared libraries for >> more information, such as the ld(1) and ld.so(8) manual pages. >> >> ---------------------------------------------------------------------- >> test -z "/usr/local/share/doc/snappy" || /bin/mkdir -p >> "/usr/local/share/doc/snappy" >> /usr/bin/install -c -m 644 ChangeLog COPYING INSTALL NEWS README >> format_description.txt framing_format.txt '/usr/local/share/doc/snappy' >> test -z "/usr/local/include" || /bin/mkdir -p "/usr/local/include" >> /usr/bin/install -c -m 644 snappy.h snappy-sinksource.h >> snappy-stubs-public.h snappy-c.h '/usr/local/include' >> make[1]: Leaving directory `/edh/hadoop_all_sources/snappy-1.1.1' >> >> ll /usr/local/lib >> -rw-r--r--. 1 root root 233554 Aug 20 00:14 libsnappy.a >> -rwxr-xr-x. 1 root root 953 Aug 20 00:14 libsnappy.la >> lrwxrwxrwx. 1 root root 18 Aug 20 00:14 libsnappy.so -> >> libsnappy.so.1.2.0 >> lrwxrwxrwx. 1 root root 18 Aug 20 00:14 libsnappy.so.1 -> >> libsnappy.so.1.2.0 >> -rwxr-xr-x. 1 root root 147726 Aug 20 00:14 libsnappy.so.1.2.0 >> >> >> >> On 26 Aug, 2014, at 7:38 pm, Jean-Marc Spaggiari <[email protected]> >> wrote: >> >>> Hi Arthur, >>> >>> Do you have snappy libs installed and configured? HBase doesn't come with >>> Snappy. So yo need to have it first. >>> >>> Shameless plug: >>> >> http://www.spaggiari.org/index.php/hbase/how-to-install-snappy-with-1#.U_xxSqdZuZY >>> >>> This is for 0.96 but should be very similar for 0.98. I will try it soon >>> and post and update, but keep us posted here so we can support you... >>> >>> JM >>> >>> >>> 2014-08-26 7:34 GMT-04:00 [email protected] < >> [email protected] >>>> : >>> >>>> Hi, >>>> >>>> I need to install snappy to HBase 0.98.4. (my Hadoop version is 2.4.1) >>>> >>>> Can you please advise what would be wrong? Should my pom.xml be >> incorrect >>>> and missing something? >>>> >>>> Regards >>>> Arthur >>>> >>>> >>>> Below are my commands: >>>> bash -x ./dev-support/generate-hadoopX-poms.sh 0.98.4 0.98.4-hadoop2 >>>> mvn -f pom.xml.hadoop2 install -DskipTests assembly:single >>>> -Prelease,hadoop-snappy >>>> >>>> Iog: >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Building HBase - Server 0.98.4-hadoop2 >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [WARNING] The POM for org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT >>>> is missing, no dependency information available >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Reactor Summary: >>>> [INFO] >>>> [INFO] HBase ............................................. SUCCESS >> [3.129s] >>>> [INFO] HBase - Common .................................... SUCCESS >> [3.105s] >>>> [INFO] HBase - Protocol .................................. SUCCESS >> [0.976s] >>>> [INFO] HBase - Client .................................... SUCCESS >> [0.925s] >>>> [INFO] HBase - Hadoop Compatibility ...................... SUCCESS >> [0.183s] >>>> [INFO] HBase - Hadoop Two Compatibility .................. SUCCESS >> [0.497s] >>>> [INFO] HBase - Prefix Tree ............................... SUCCESS >> [0.407s] >>>> [INFO] HBase - Server .................................... FAILURE >> [0.103s] >>>> [INFO] HBase - Testing Util .............................. SKIPPED >>>> [INFO] HBase - Thrift .................................... SKIPPED >>>> [INFO] HBase - Shell ..................................... SKIPPED >>>> [INFO] HBase - Integration Tests ......................... SKIPPED >>>> [INFO] HBase - Examples .................................. SKIPPED >>>> [INFO] HBase - Assembly .................................. SKIPPED >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] BUILD FAILURE >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Total time: 9.939s >>>> [INFO] Finished at: Tue Aug 26 19:23:14 HKT 2014 >>>> [INFO] Final Memory: 61M/2921M >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [ERROR] Failed to execute goal on project hbase-server: Could not >> resolve >>>> dependencies for project >> org.apache.hbase:hbase-server:jar:0.98.4-hadoop2: >>>> Failure to find org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT in >>>> http://maven.oschina.net/content/groups/public/ was cached in the local >>>> repository, resolution will not be reattempted until the update >> interval of >>>> nexus-osc has elapsed or updates are forced -> [Help 1] >>>> [ERROR] >>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the >>>> -e switch. >>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>>> [ERROR] >>>> [ERROR] For more information about the errors and possible solutions, >>>> please read the following articles: >>>> [ERROR] [Help 1] >>>> >> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException >>>> [ERROR] >>>> [ERROR] After correcting the problems, you can resume the build with the >>>> command >>>> [ERROR] mvn <goals> -rf :hbase-server >>>> >>>> >> >>
