Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Rajesh Balamohan
Thanks a lot for providing this opportunity and to all for their messages. :) ~Rajesh.B On Wed, Dec 14, 2016 at 11:33 AM, Dharmesh Kakadia wrote: > Congrats Rajesh ! > > Thanks, > Dharmesh > > On Tue, Dec 13, 2016 at 7:37 PM, Vikram Dixit K > wrote: > >> Congrats Rajesh! :) >> >> On Tue, Dec 1

HMS connections to meta db

2016-12-13 Thread Huang Meilong
Hi all, Will HMS keep the connection to meta db when HMS is up? Or will HMS build connection to meta db every time the query comes to HMS and release connection to meta db when query finished?

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Dharmesh Kakadia
Congrats Rajesh ! Thanks, Dharmesh On Tue, Dec 13, 2016 at 7:37 PM, Vikram Dixit K wrote: > Congrats Rajesh! :) > > On Tue, Dec 13, 2016 at 9:36 PM, Pengcheng Xiong > wrote: > >> Congrats Rajesh! :) >> >> On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran < >> prasan...@apache.org >> > wro

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Vikram Dixit K
Congrats Rajesh! :) On Tue, Dec 13, 2016 at 9:36 PM, Pengcheng Xiong wrote: > Congrats Rajesh! :) > > On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran < > prasan...@apache.org > > wrote: > > > The Apache Hive PMC has voted to make Rajesh Balamohan a committer on the > > Apache Hive Project

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Pengcheng Xiong
Congrats Rajesh! :) On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran wrote: > The Apache Hive PMC has voted to make Rajesh Balamohan a committer on the > Apache Hive Project. Please join me in congratulating Rajesh. > > Congratulations Rajesh! > > Thanks > Prasanth

[ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Prasanth Jayachandran
The Apache Hive PMC has voted to make Rajesh Balamohan a committer on the Apache Hive Project. Please join me in congratulating Rajesh. Congratulations Rajesh! Thanks Prasanth

Sqoop potgres table to hive in parquet format problem.

2016-12-13 Thread ws
Hive: 2.1.0Sqoop: 1.4.6 ###hive> select * from dimemployee;OKFailed with exception java.io.IOException:java.lang.RuntimeException: hdfs://ip-172-31-38-171.ec2.internal:8020/user/hive/warehouse/db2.db/dimemployee/.metadata/schemas/1.avsc is not a Parquet file. expected magic number at tail [80, 6

Re: PARTITION error because different columns size

2016-12-13 Thread Furcy Pin
Actually, there is a legacy feature in Hive that would do exactly what you need : https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select#LanguageManualSelect-REGEXColumnSpecification Another way would simply to use dynamic partitioning : INSERT INTO TABLE employee_orc PARTITION *

RE: PARTITION error because different columns size

2016-12-13 Thread Joaquin Alzola
Hi Suresh I choose the * and not the specific fields because I have 520 columns. The data that I tested was only a testing ground. I suppose then that I need to select the 520 fileds. ☹ From: Suresh Kumar Sethuramaswamy [mailto:rock...@gmail.com] Sent: 13 December 2016 14:19 To: user@hive.apac

Re: PARTITION error because different columns size

2016-12-13 Thread Furcy Pin
Hi Joaquin, Suresh was faster than me ... Also, you should check this : https://cwiki.apache.org/confluence/display/Hive/Tutorial#Tutorial-Dynamic-PartitionInsert On Tue, Dec 13, 2016 at 3:19 PM, Suresh Kumar Sethuramaswamy < rock...@gmail.com> wrote: > Hi Joaquin > > In hive , when u run '

Re: PARTITION error because different columns size

2016-12-13 Thread Suresh Kumar Sethuramaswamy
Hi Joaquin In hive , when u run 'select * from employee' it is going to return the partitioned columns also at the end, whereas you don't want that to be inserted into ur ORC table , so ur insert query should look like INSERT INTO TABLE employee_orc PARTITION (country='USA', office='HQ

PARTITION error because different columns size

2016-12-13 Thread Joaquin Alzola
Hi List I change Spark to 2.0.2 and Hive 2.0.1. I have the bellow tables but the INSERT INTO TABLE employee_orc PARTITION (country='USA', office='HQ-TX') select * from employee where country='USA' and office='HQ-TX'; Is giving me --> Cannot insert into table `default`.`employee_orc` because the