Re: Enabling fair scheduler using Bootstrap is failing

Hi, Today, I enabled logging while creating new job. Error which I see in log files are : ERROR org.apache.hadoop.security.UserGroupInformation (IPC Server handler 12 on 9000): PriviledgedActionException as:hadoop cause:java.io.IOException: File /mnt/var/lib/hadoop/tmp/mapred/system/ jobtracker.i

Re: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Hi Robin, Can you attach the execution logs? The logs contain the exception stack. Thanks, Shreepadma On Mon, Oct 29, 2012 at 10:19 AM, Chen Song wrote: > Is there anything interesting on hive.log? > > If you are running Hive shell with root user, by default, the hive.log > should be in /tmp/h

Re: Not able to run queries in Hive

Dean/Chuck Thank you very much for the responses. From: Dean Wampler To: user@hive.apache.org Sent: Monday, 29 October 2012 8:19 PM Subject: Re: Not able to run queries in Hive VirtualBox is a free alternative to VMWare, but I think paying for the latter

Re: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Is there anything interesting on hive.log? If you are running Hive shell with root user, by default, the hive.log should be in /tmp/hive.log. BTW, are you using MySQL as your metastore? On Mon, Oct 29, 2012 at 12:22 PM, Robin Verlangen wrote: > I have to add, while trying to do other operation

Re: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

I have to add, while trying to do other operations on hive by hand, it also fails. For example: *hive> drop table my_other_table;* *FAILED: Error in metadata: java.lang.reflect.UndeclaredThrowableException* *FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask* Best

Re: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Hi Chen, The user that ran this job is root and all hdfs folders are also owned by root. Best regards, Robin Verlangen *Software engineer* * * W http://www.robinverlangen.nl E ro...@us2.nl Disclaimer: The information contained in this message and attachments is intended s

Re: Query is taking long time to process and return the result

It's impossible to answer such a vague, open-ended question without specifics. What's the query, for example? How is the data organized (e.g., is it partitioned)? What are the cluster characteristics? On Mon, Oct 29, 2012 at 10:20 AM, shashwat shriparv < dwivedishash...@gmail.com> wrote: > I am t

Query is taking long time to process and return the result

I am trying to run hive query on huge amount of data(almost in half of petabyte), and these query running map reduce internally. it takes very long time to generate the data set(map reduce to complete) what optimization mechanism for hive and Hadoop i can use to make these query faster, one more im

Re: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Looks to me the permission issue. Can you check if the user (which ran the hive query) has write permission on */user/hive/warehouse/mydatabase.db/mytable?* On Mon, Oct 29, 2012 at 8:38 AM, Robin Verlangen wrote: > Hi there, > > Since today our Hive jobs suddenly fail (nothing changed actually)

Re: Not able to run queries in Hive

VirtualBox is a free alternative to VMWare, but I think paying for the latter is worth it. You can also download VMWare and VirtualBox virtual machine images from Cloudera and MapR (maybe not VirtualBox?) that have Hadoop and Hive fully configured. On Mon, Oct 29, 2012 at 8:55 AM, Connell, Chuck w

RE: Not able to run queries in Hive

No. Cygwin is not Linux. If you have only a Windows machine (and it is powerful) build a Linux virtual machine on it, using VmWare Workstation. That product is free for 30 days. Chuck From: BALAKRISHNAN VISWANATHAN [vbal...@yahoo.co.in] Sent: Monday, October 2

Re: Not able to run queries in Hive

Thanks for the response. If I switch my Windows OS from 32 bit to 64, will it resolve the issue? I don't have the feasibility to run Linux here in my office. Please suggest any alternate option on Windows From: "Connell, Chuck" To: "user@hive.apache.org" ; "v.

Re: Enabling fair scheduler using Bootstrap is failing

Hi, I tried this also in optional arguments "--site-config-file s3://viz-emr-hive/config/mapred-site.xml -m mapred.jobtracker.taskScheduler=org.apache.hadoop.mapred.FairScheduler" This time it goes to state "Bootstrapping" and then failed. Let me know what changes I can do to make it work. Than

RE: Not able to run queries in Hive

Cygwin is not Linux. It does not run native Linux code. From: yogesh.kuma...@wipro.com [yogesh.kuma...@wipro.com] Sent: Monday, October 29, 2012 9:20 AM To: user@hive.apache.org; v.balakrish...@tcs.com Subject: RE: Not able to run queries in Hive Bala, Then I t

Re: FAILED: Hive Internal Error

It just means the port on which you are trying to connect there is no hadoop service running on that port please recheck what port you are using for hadoop and check where you have specified the port no 54310 and check for port using netstat -nl | grep 54310 if giving any result else just check on

RE: Not able to run queries in Hive

Bala, Then I think the reason is Hive doesn't run on windows 32-bit. Pig also recommends 64-bit O.S I suggest you to switch to Linux(Ubuntu 64-bit). Regards Yogesh Kumar Dhari From: BALAKRISHNAN VISWANATHAN [vbal...@yahoo.co.in] Sent: Monday, October 29, 2012 6:

Re: Not able to run queries in Hive

Hi Yogesh, I am running in 32-Bit Windows 7 machine. Rhanks, Bala From: "yogesh.kuma...@wipro.com" To: user@hive.apache.org; v.balakrish...@tcs.com Sent: Monday, 29 October 2012 6:33 PM Subject: RE: Not able to run queries in Hive Hi Balkrishnan, AFAIK Hi

Enabling fair scheduler using Bootstrap is failing

Hi, I am trying to enable fair scheduler on my emr cluster at bootstrap. The steps I am doing are : 1. Creating Job instance from AWS console as "Create New Job Flow" with Job Type as Hive program. 2. Selecting "Start an Interactive Hive Session". 3. Selecting Master and core instance group and A

RE: Not able to run queries in Hive

Hi Balkrishnan, AFAIK Hive does't work on CYGWIN, I am not very sure, Are you running it on 32-Bit O.S. Regards Yogesh Kumar Dhari From: BALAKRISHNAN VISWANATHAN [vbal...@yahoo.co.in] Sent: Monday, October 29, 2012 6:22 PM To: user@hive.apache.org Subject: Not ab

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Hi there, Since today our Hive jobs suddenly fail (nothing changed actually). The end looks like this: *MapReduce Total cumulative CPU time: 38 minutes 31 seconds 260 msec* *Ended Job = job_201210291304_0015* *Loading data to table mydatabase.mytable* *rmr: DEPRECATED: Please use 'rm -r' instead.

UDAF issue - how to combine array data into one array

Hi All, I am researching some ways to combine array data with a UDAF. The raw data table schema is listed here: CREATE TABLE IF NOT EXISTS array_data (session_id string, properties array>); I would like to do such operation for it with a UDAF "array_combine": SELECT session_id, array_combine(