Hi Rajesh,
This is what I have under :$HADOOP_COMMON_HOME/lib/native cd $HADOOP_COMMON_HOME/lib/native hduser@rhes564::/home/hduser/hadoop-2.6.0/lib/native> ls -ltr total 4936 -rwxr-xr-x 1 hduser hadoop 278622 Nov 13 2014 libhdfs.so.0.0.0 -rw-r-xr-x 1 hduser hadoop 440498 Nov 13 2014 libhdfs.a -rw-r-xr-x 1 hduser hadoop 476666 Nov 13 2014 libhadooputils.a -rw-r-xr-x 1 hduser hadoop 1634592 Nov 13 2014 libhadooppipes.a -rwxr-xr-x 1 hduser hadoop 805999 Nov 13 2014 libhadoop.so.1.0.0 -rw-r-xr-x 1 hduser hadoop 1380212 Nov 13 2014 libhadoop.a lrwxrwxrwx 1 hduser hadoop 16 Feb 8 2015 libhdfs.so -> libhdfs.so.0.0.0 lrwxrwxrwx 1 hduser hadoop 18 Feb 8 2015 libhadoop.so -> libhadoop.so.1.0.0 And If I do a search for snappy I get hduser@rhes564::/home/hduser/hadoop-2.6.0> find ./ -name '*snappy*' ./share/hadoop/common/lib/snappy-java-1.0.4.1.jar ./share/hadoop/kms/tomcat/webapps/kms/WEB-INF/lib/snappy-java-1.0.4.1.jar ./share/hadoop/httpfs/tomcat/webapps/webhdfs/WEB-INF/lib/snappy-java-1.0.4.1.jar ./share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar ./share/hadoop/tools/lib/snappy-java-1.0.4.1.jar Thanks, Dr Mich Talebzadeh LinkedIn https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A Practitioner’s Guide to Upgrading to Sybase ASE 15", ISBN 978-0-9563693-0-7. co-author "Sybase Transact SQL Guidelines Best Practices", ISBN 978-0-9759693-0-4 Publications due shortly: Complex Event Processing in Heterogeneous Environments, ISBN: 978-0-9563693-3-8 Oracle and Sybase, Concepts and Contrasts, ISBN: 978-0-9563693-1-4, volume one out shortly http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> NOTE: The information in this email is proprietary and confidential. This message is for the designated recipient only, if you are not the intended recipient, you should destroy it immediately. Any information in this message shall not be understood as given or endorsed by Peridale Technology Ltd, its subsidiaries or their employees, unless expressly so stated. It is the responsibility of the recipient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Rajesh Balamohan [mailto:rajesh.balamo...@gmail.com] Sent: 05 January 2016 11:46 To: user@hive.apache.org Subject: Re: Hive on TEZ fails starting Try ' beeline --hiveconf tez.task.launch.env="LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$HADOOP_COMMON_HOME/lib/native" --hiveconf tez.am.launch.env="LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$HADOOP_COMMON_HOME/lib/native" '. Please check if you have the lib*.so available in the native folder (or point it to the folder which contains the so files) ~Rajesh.B On Tue, Jan 5, 2016 at 4:00 PM, Mich Talebzadeh <m...@peridale.co.uk <mailto:m...@peridale.co.uk> > wrote: Hi, I have added the following to the LD_LIBRARY_PATH and JAVA_LIBRARY_PATH export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$HADOOP_COMMON_HOME/lib/native export JAVA_LIBRARY_PATH=$JAVA_LIBRARY_PATH:$HADOOP_COMMON_HOME/lib/native Trying to use TEZ, I still get the same error 0: jdbc:hive2://rhes564:10010/default> set hive.execution.engine=tez; No rows affected (0.002 seconds) 0: jdbc:hive2://rhes564:10010/default> use oraclehadoop; No rows affected (0.019 seconds) 0: jdbc:hive2://rhes564:10010/default> select count(1) from sales; INFO : Tez session hasn't been created yet. Opening session INFO : INFO : Status: Running (Executing on YARN cluster with App id application_1451986680090_0002) INFO : Map 1: -/- Reducer 2: 0/1 INFO : Map 1: 0/1 Reducer 2: 0/1 INFO : Map 1: 0(+1)/1 Reducer 2: 0/1 INFO : Map 1: 0(+1,-1)/1 Reducer 2: 0/1 INFO : Map 1: 0(+1,-1)/1 Reducer 2: 0/1 INFO : Map 1: 0(+1,-2)/1 Reducer 2: 0/1 INFO : Map 1: 0(+1,-2)/1 Reducer 2: 0/1 INFO : Map 1: 0(+1,-3)/1 Reducer 2: 0/1 INFO : Map 1: 0(+1,-3)/1 Reducer 2: 0/1 ERROR : Vertex failed, vertexName=Map 1, vertexId=vertex_1451986680090_0002_1_00, diagnostics=[Task failed, taskId=task_1451986680090_0002_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z Dr Mich Talebzadeh LinkedIn https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A Practitioner’s Guide to Upgrading to Sybase ASE 15", ISBN 978-0-9563693-0-7. co-author "Sybase Transact SQL Guidelines Best Practices", ISBN 978-0-9759693-0-4 Publications due shortly: Complex Event Processing in Heterogeneous Environments, ISBN: 978-0-9563693-3-8 Oracle and Sybase, Concepts and Contrasts, ISBN: 978-0-9563693-1-4, volume one out shortly http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> NOTE: The information in this email is proprietary and confidential. This message is for the designated recipient only, if you are not the intended recipient, you should destroy it immediately. Any information in this message shall not be understood as given or endorsed by Peridale Technology Ltd, its subsidiaries or their employees, unless expressly so stated. It is the responsibility of the recipient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Rajesh Balamohan [mailto:rajesh.balamo...@gmail.com <mailto:rajesh.balamo...@gmail.com> ] Sent: 05 January 2016 00:35 To: user@hive.apache.org <mailto:user@hive.apache.org> Subject: Re: Hive on TEZ fails starting By default it should add "LD_LIBRARY_PATH" in the container (ref: https://github.com/apache/tez/blob/abfc8bfb0a8620d31697a31ad516674a8d3f9f7c/tez-api/src/main/java/org/apache/tez/dag/api/TezConfiguration.java#L358) . In case your snappy native libs are present elsewhere in the cluster deployment, you can override using "tez.task.launch.env" and "tez.am.launch.env" (refer: https://github.com/apache/tez/blob/abfc8bfb0a8620d31697a31ad516674a8d3f9f7c/tez-api/src/main/java/org/apache/tez/dag/api/TezConfiguration.java#L412) ~Rajesh.B -- ~Rajesh.B
