It will use hadoop lib by default.. requirement is hadoop must be in class path
On Mon, Jan 9, 2012 at 3:30 PM, <ian.mey...@barclayscapital.com> wrote: > I did see that, and to try and ensure the right Hadoop libs are being > used, I’ve created the following entry in hive-site.xml:**** > > ** ** > > <property>**** > > <name>hive.aux.jars.path</name>**** > > > <value>/apps/hadoop/hadoop-0.20.203.0/hadoop-core-0.20.203.0.jar,/apps/hadoop/hadoop-0.20.203.0/hadoop-tools-0.20.203.0.jar</value> > **** > > <description>Force override jar locations</description>*** > * > > </property>**** > > ** ** > > Is that correct? Does it try to use $HADOOP_HOME/lib by default? I don’t > see any Hadoop libs in the hive/lib directory at all.**** > > ** ** > > Ian**** > > ** ** > > *From:* shashwat shriparv [mailto:dwivedishash...@gmail.com] > *Sent:* Friday, January 06, 2012 7:28 PM > > *To:* user@hive.apache.org > *Subject:* Re: Problem with Hive->Hadoop**** > > ** ** > > Check out this post may be will be useful for you**** > > ** ** > > > http://mail-archives.apache.org/mod_mbox/hive-user/201101.mbox/%3CAANLkTi=vttvpd3z5de24bja8lknwpvochpnrtb7eo...@mail.gmail.com%3E > **** > > ** ** > > https://issues.apache.org/jira/browse/HADOOP-4262**** > > ** ** > > ** ** > > http://search-hadoop.com/m/hrAvDrf0Vu/v=threaded**** > > Regards **** > > Shashwat**** > > ** ** > > ** ** > > On Fri, Jan 6, 2012 at 10:43 PM, alo.alt <wget.n...@googlemail.com> wrote: > **** > > Hi Ian, > > did you use compressed output or compressed files for input? > > - Alex > > Alexander Lorenz > http://mapredit.blogspot.com**** > > > > On Jan 6, 2012, at 7:55 AM, <ian.mey...@barclayscapital.com> < > ian.mey...@barclayscapital.com> wrote: > > > Hello, > > > > Using version .8 of Hive with version 0.20.203.0 of Hadoop. Defining and > loading tables worked fine, and I can query them with select *. However, a > summary query against any table results in the following exception. I’ve > see other documented issues like this regarding HBase and the Cloudera > stack, but nothing specific to what I’m seeing. > > > > Any thoughts? > > > > java.io.IOException: Call to **********/**********:50030 failed on local > exception: java.io.EOFException > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065) > > at org.apache.hadoop.ipc.Client.call(Client.java:1033) > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224) > > at org.apache.hadoop.mapred.$Proxy8.getProtocolVersion(Unknown > Source) > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:364) > > at > org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:460) > > at org.apache.hadoop.mapred.JobClient.init(JobClient.java:454) > > at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:437) > > at > org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:435) > > at > org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136) > > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133) > > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) > > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332) > > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123) > > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931) > > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > > at > org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > > at > org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > at java.lang.reflect.Method.invoke(Method.java:597) > > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > > Caused by: java.io.EOFException > > at java.io.DataInputStream.readInt(DataInputStream.java:375) > > at > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:774) > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:712) > > Job Submission failed with exception 'java.io.IOException(Call to > **********/**********:50030 failed on local exception: > java.io.EOFException)' > > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.MapRedTask > > > > Ian Meyers > > > > Barclays Capital > > FICC Solutions Architecture > > > > ( Direct : +44 (0) 20 777 37437 ( Extension: 37437 > > * ian.mey...@barclayscapital.com > > > > _______________________________________________ > > > > This e-mail may contain information that is confidential, privileged or > otherwise protected from disclosure. If you are not an intended recipient > of this e-mail, do not duplicate or redistribute it by any means. Please > delete it and any attachments and notify the sender that you have received > it in error. Unless specifically indicated, this e-mail is not an offer to > buy or sell or a solicitation to buy or sell any securities, investment > products or other financial product or service, an official confirmation of > any transaction, or an official statement of Barclays. Any views or > opinions presented are solely those of the author and do not necessarily > represent those of Barclays. This e-mail is subject to terms available at > the following link: www.barcap.com/emaildisclaimer. By messaging with > Barclays you consent to the foregoing. Barclays Capital is the investment > banking division of Barclays Bank PLC, a company registered in England > (number 1026167) with its registered office at 1 Churchill Place, London, > E14 5HP. This email may relate to or be sent from other members of the > Barclays Group. > > _______________________________________________**** > > > > > -- > Shashwat Shriparv > 09900059620 > 09663531241 > > > > <iframe src=" > http://rcm.amazon.com/e/cm?t=shriparv-20&o=1&p=48&l=ur1&category=kindlerotating&f=ifr"; > width="728" height="90" scrolling="no" border="0" marginwidth="0" > style="border:none;" frameborder="0"></iframe> > > **** >
