Unfortunately, I got the same error. Hadoop-2.4.0(HA enabled), Hive-0.13.1-rc3, tez-0.4 If I set 'hive.execution.engine' to mr by default, then Hive does work. but if changed it to 'tez', I got the followig error. please look at here for hive and tez configuration: http://pastebin.com/hid1AA83
> From: azur...@outlook.com > To: dev@hive.apache.org > Subject: RE: [VOTE] Apache Hive 0.13.1 Release Candidate 3 > Date: Thu, 5 Jun 2014 08:27:27 +0000 > > Ok, I'll try it today. and post back. > > > Date: Thu, 5 Jun 2014 01:20:10 -0700 > > Subject: Re: [VOTE] Apache Hive 0.13.1 Release Candidate 3 > > From: vgumas...@hortonworks.com > > To: dev@hive.apache.org > > > > Yu, > > > > I don't think tez-0.5 has been released yet. Can you try with tez-0.4 ( > > http://www.apache.org/dyn/closer.cgi/incubator/tez/tez-0.4.0-incubating/)? > > > > Thanks, > > --Vaibhav > > > > > > On Thu, Jun 5, 2014 at 1:16 AM, Yu Azuryy <azur...@outlook.com> wrote: > > > > > I just changed ConnectionURL and warehouse in hive-site.xml, > > > > > > As for tez-0.5-snapshot, > > > <property> > > > <name>tez.lib.uris</name> > > > <value>${fs.defaultFS}/data/tez/lib</value> > > > </property> > > > <property> > > > <name>tez.am.resource.memory.mb</name> > > > <value>1280</value> > > > </property> > > > > > > > > > None others. > > > > > > > > > > Date: Wed, 4 Jun 2014 23:28:07 -0700 > > > > Subject: Re: [VOTE] Apache Hive 0.13.1 Release Candidate 3 > > > > From: the...@hortonworks.com > > > > To: dev@hive.apache.org > > > > > > > > Yu, > > > > I am not able to reproduce this issue with hadoop 2.4.0 and tez 0.4 . > > > > I tried it with both file system cache enabled and disabled. > > > > What are the non default configurations you have on your machine ? > > > > > > > > Thanks, > > > > Thejas > > > > > > > > > > > > > > > > On Wed, Jun 4, 2014 at 10:56 PM, Yu Azuryy <azur...@outlook.com> wrote: > > > > > Hive-0.13.0 works well in my test cluster. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -1 > > > > > > > > > > Verified with hadoop-2.4.0 and tez-0.5-snapshot, > > > > > Hive cannot start? > > > > > > > > > > And I also built hive branch-0.13, the same error. > > > > > > > > > > [test@vm-10-154-** tmp]$ hive > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: > > > mapred.input.dir.recursive is deprecated. Instead, use > > > mapreduce.input.fileinputformat.input.dir.recursive > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: > > > mapred.max.split.size is deprecated. Instead, use > > > mapreduce.input.fileinputformat.split.maxsize > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: > > > mapred.min.split.size is deprecated. Instead, use > > > mapreduce.input.fileinputformat.split.minsize > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: > > > mapred.min.split.size.per.node is deprecated. Instead, use > > > mapreduce.input.fileinputformat.split.minsize.per.node > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: > > > mapred.min.split.size.per.rack is deprecated. Instead, use > > > mapreduce.input.fileinputformat.split.minsize.per.rack > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: mapred.reduce.tasks > > > is deprecated. Instead, use mapreduce.job.reduces > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: > > > mapred.reduce.tasks.speculative.execution is deprecated. Instead, use > > > mapreduce.reduce.speculative > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: > > > mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use > > > mapreduce.job.committer.setup.cleanup.needed > > > > > 14/06/05 13:53:45 WARN conf.HiveConf: DEPRECATED: > > > hive.metastore.ds.retry.* no longer has any effect. Use > > > hive.hmshandler.retry.* instead > > > > > Logging initialized using configuration in > > > jar:file:/letv/hive-0.13.0/lib/hive-common-0.13.1.jar!/hive-log4j.properties > > > > > Exception in thread "main" java.lang.RuntimeException: > > > java.io.IOException: Filesystem closed > > > > > at > > > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:357) > > > > > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) > > > > > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) > > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > > > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > > at java.lang.reflect.Method.invoke(Method.java:606) > > > > > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > > > > > Caused by: java.io.IOException: Filesystem closed > > > > > at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:727) > > > > > at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1780) > > > > > at > > > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1066) > > > > > at > > > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1062) > > > > > at > > > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > > > > > at > > > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1062) > > > > > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398) > > > > > at org.apache.hadoop.fs.FileSystem.deleteOnExit(FileSystem.java:1353) > > > > > at > > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createTezDir(TezSessionState.java:297) > > > > > at > > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:144) > > > > > at > > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:123) > > > > > at > > > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:355) > > > > > ... 7 more > > > > > > > > > >> Subject: Re: [VOTE] Apache Hive 0.13.1 Release Candidate 3 > > > > >> From: hbut...@hortonworks.com > > > > >> Date: Wed, 4 Jun 2014 22:42:32 -0700 > > > > >> To: dev@hive.apache.org > > > > >> > > > > >> +1 > > > > >> > > > > >> - Verified signature and checksum > > > > >> - Checked release notes > > > > >> - built source > > > > >> - ran a few unit tests > > > > >> - ran a few queries in local mode > > > > >> > > > > >> On Jun 2, 2014, at 7:20 PM, Thejas Nair <the...@hortonworks.com> > > > wrote: > > > > >> > > > > >> > +1 > > > > >> > > > > > >> > - Verified signatures and checksum of both packages > > > > >> > - Checked release notes > > > > >> > - Build source package > > > > >> > - Ran simple hive queries on newly built package in local mode > > > > >> > - Ran simple queries on package on single node cluster with both > > > > >> > tez > > > > >> > and mr as execution engines > > > > >> > - Ran unit tests > > > > >> > > > > > >> > > > > > >> > On Mon, Jun 2, 2014 at 1:02 PM, Sushanth Sowmyan < > > > khorg...@apache.org> wrote: > > > > >> >> Apache Hive 0.13.1 Release Candidate 3 is available here: > > > > >> >> > > > > >> >> http://people.apache.org/~khorgath/releases/0.13.1_RC3/artifacts/ > > > > >> >> > > > > >> >> Maven artifacts are available here: > > > > >> >> > > > > >> >> > > > https://repository.apache.org/content/repositories/orgapachehive-1015 > > > > >> >> > > > > >> >> Source tag for RC3 is at: > > > > >> >> > > > > >> >> http://svn.apache.org/viewvc/hive/tags/release-0.13.1-rc3/ > > > > >> >> > > > > >> >> Voting will remain open for 72 hours. > > > > >> >> > > > > >> >> Hive PMC Members: Please test and vote. > > > > >> >> > > > > >> >> Thanks, > > > > >> >> -Sushanth > > > > >> > > > > > >> > -- > > > > >> > CONFIDENTIALITY NOTICE > > > > >> > NOTICE: This message is intended for the use of the individual or > > > entity to > > > > >> > which it is addressed and may contain information that is > > > confidential, > > > > >> > privileged and exempt from disclosure under applicable law. If the > > > reader > > > > >> > of this message is not the intended recipient, you are hereby > > > notified that > > > > >> > any printing, copying, dissemination, distribution, disclosure or > > > > >> > forwarding of this communication is strictly prohibited. If you > > > > >> > have > > > > >> > received this communication in error, please contact the sender > > > immediately > > > > >> > and delete it from your system. Thank You. > > > > >> > > > > >> > > > > >> -- > > > > >> CONFIDENTIALITY NOTICE > > > > >> NOTICE: This message is intended for the use of the individual or > > > entity to > > > > >> which it is addressed and may contain information that is > > > confidential, > > > > >> privileged and exempt from disclosure under applicable law. If the > > > reader > > > > >> of this message is not the intended recipient, you are hereby > > > notified that > > > > >> any printing, copying, dissemination, distribution, disclosure or > > > > >> forwarding of this communication is strictly prohibited. If you have > > > > >> received this communication in error, please contact the sender > > > immediately > > > > >> and delete it from your system. Thank You. > > > > > > > > > > > > > -- > > > > CONFIDENTIALITY NOTICE > > > > NOTICE: This message is intended for the use of the individual or entity > > > to > > > > which it is addressed and may contain information that is confidential, > > > > privileged and exempt from disclosure under applicable law. If the > > > > reader > > > > of this message is not the intended recipient, you are hereby notified > > > that > > > > any printing, copying, dissemination, distribution, disclosure or > > > > forwarding of this communication is strictly prohibited. If you have > > > > received this communication in error, please contact the sender > > > immediately > > > > and delete it from your system. Thank You. > > > > > > > > > > -- > > CONFIDENTIALITY NOTICE > > NOTICE: This message is intended for the use of the individual or entity to > > which it is addressed and may contain information that is confidential, > > privileged and exempt from disclosure under applicable law. If the reader > > of this message is not the intended recipient, you are hereby notified that > > any printing, copying, dissemination, distribution, disclosure or > > forwarding of this communication is strictly prohibited. If you have > > received this communication in error, please contact the sender immediately > > and delete it from your system. Thank You. >
