Re: hive 0.7.1 Error: Non-Partition column appears in the partition specification

2012-11-16 Thread Ruslan Al-Fakikh
Hey Pavel, Also note that the dynamic partition values are selected by ordering, not name, and taken as the last columns from the select clause. So you have to have a column for the author partition in your most outer 'select'. So your error messages are normal. In the first one you do not have a

RE: Do I need any Pig knowledge to learn Hive?

2012-11-16 Thread Connell, Chuck
The Hive query language (HiveQL) is completely different from Pig. Chuck Connell Nuance R&D Data Team From: Majid Azimi [mailto:majid.merk...@gmail.com] Sent: Friday, November 16, 2012 4:27 AM To: user@hive.apache.org Subject: Do I need any Pig knowledge to learn Hive? hi guys, Do I need any P

Re: How does hive decide to launch how many map tasks?

2012-11-16 Thread Cheng Su
Thank you so much :) On Fri, Nov 16, 2012 at 5:49 PM, Bejoy KS wrote: > Hi Chen > > The computation on the number of Input Splits/ map tasks is totally > determined by the InputFormat used as well as the split size. > > Hive used CombineHiveInput format so you may not be having one mapper per >

Re:

2012-11-16 Thread Mohammad Tariq
Thank you so much for the link Alex. Regards, Mohammad Tariq On Fri, Nov 16, 2012 at 2:19 PM, Alexander Alten-Lorenz wrote: > https://help.ubuntu.com/community/VMware/Player > > - Alex > > On Nov 16, 2012, at 9:47 AM, Mohammad Tariq wrote: > > > Hello Carl, > > > > I am not able to run

Re: Why hadoop job pending for so long?

2012-11-16 Thread Bejoy KS
Hi Chen Hope you ensured that you have enough free slots in your queue/pool if you are using fair/capacity scheduler in your cluster. Some times the job initialization would take some time if there are larger number of partitions and lots of small input files in them. Regards Bejoy KS Sent fr

Re: How does hive decide to launch how many map tasks?

2012-11-16 Thread Bejoy KS
Hi Chen The computation on the number of Input Splits/ map tasks is totally determined by the InputFormat used as well as the split size. Hive used CombineHiveInput format so you may not be having one mapper per file if your files are small. You can control the number of maps by controlling th

Re: Do I need any Pig knowledge to learn Hive?

2012-11-16 Thread Cheng Su
Hi, Majid. I think you don't need know about pig, but it will help if you have some SQL knowledge. On Fri, Nov 16, 2012 at 5:26 PM, Majid Azimi wrote: > hi guys, > > Do I need any Pig knowledge to learn Hive? Or understanding Hadoop will > suffice? -- Regards, Cheng Su

Do I need any Pig knowledge to learn Hive?

2012-11-16 Thread Majid Azimi
hi guys, Do I need any Pig knowledge to learn Hive? Or understanding Hadoop will suffice?

Why hadoop job pending for so long?

2012-11-16 Thread Cheng Su
Hi, all. I am running some hive queries. I use hive 0.9.0 + hadoop 0.20.205.0 But some of them are pending for quite a long time, say 30min or even longer. I have enough free map slots. In the jobtracker logs: 2012-11-16 15:00:26,686 WARN org.apache.hadoop.conf.Configuration: /data/local/ma

Re:

2012-11-16 Thread Alexander Alten-Lorenz
https://help.ubuntu.com/community/VMware/Player - Alex On Nov 16, 2012, at 9:47 AM, Mohammad Tariq wrote: > Hello Carl, > > I am not able to run the VM on my 64 bit Linux machine. I am using > Ubuntu-12.04. I tried it with both VMware player and workstation. I even > enabled the virtualizati

Re: Re:

2012-11-16 Thread Mohammad Tariq
Hello Carl, I am not able to run the VM on my 64 bit Linux machine. I am using Ubuntu-12.04. I tried it with both VMware player and workstation. I even enabled the virtualization on my machine after reading the error message I was getting. Still no luck. Am I missing something else?Please help