It looks like those classes are added after 0.7 version of Tez. I got past that by using Tez version 0.8. May be we should add this to https://cwiki.apache.org/confluence/display/Hive/Hive-Tez+Compatibility to help others. or someone can give me permission to edit the wiki - my id is dharmesh.kakadia:)
But now, I am stuck into "Incompatible versions found, clientVersion=0.8.2, AMVersion=0.7.0" error. I tried also setting tez.am.disable.client-version-check=true but still the same problem. Any pointer would help. Also, where does tez AM Jar is picked from ? Thanks, Dharmesh On Monday, February 22, 2016, Dharmesh Kakadia <dhkaka...@gmail.com> wrote: > Hi, > > The hive 2.0 is exciting. Thanks for the great work ! > I am getting the following error while giving it a try with tez 0.7. > > java.lang.NoClassDefFoundError: > org/apache/tez/serviceplugins/api/TaskScheduler > at java.lang.ClassLoader.defineClass1(Native Method) > at java.lang.ClassLoader.defineClass(ClassLoader.java:791) > at > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) > at java.net.URLClassLoader.access$100(URLClassLoader.java:71) > at java.net.URLClassLoader$1.run(URLClassLoader.java:361) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:423) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > at java.lang.ClassLoader.loadClass(ClassLoader.java:356) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.<clinit>(TezSessionState.java:93) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.createAndInitSession(TezSessionPoolManager.java:209) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getNewSessionState(TezSessionPoolManager.java:258) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:238) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:415) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:343) > at > org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:134) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:158) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:101) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1840) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1584) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1361) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1184) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1172) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233) > at > org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184) > at > org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:400) > at > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:778) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:717) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:645) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.RunJar.run(RunJar.java:222) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > Caused by: java.lang.ClassNotFoundException: > org.apache.tez.serviceplugins.api.TaskScheduler > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:423) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > at java.lang.ClassLoader.loadClass(ClassLoader.java:356) > ... 38 more > FAILED: Execution Error, return code -101 from > org.apache.hadoop.hive.ql.exec.tez.TezTask. > org/apache/tez/serviceplugins/api/TaskScheduler > > I understand that its not able to find a Tez class from the classpath, but > could not understand why. I am using the same tez binaries with hive 1.2 > without any troubles. Is there are a required minimum version of Tez that > hive 2.0 supports? I downloaded 2.0 release from the website and using it > with 0.7 tez. Cluster is running latest hadoop/yarn. > > Thanks, > Dharmesh > >
