Re: External table with Avro Serde

2013-09-23 Thread Sravya Tirukkovalur
Thank you, that was helpful! On Sat, Sep 21, 2013 at 7:02 PM, j.barrett Strausser < j.barrett.straus...@gmail.com> wrote: > Fairly sure you just forgot the 'Stored As' clause. > > The below works for me on .11 > > CREATE EXTERNAL TABLE avrotab > PARTITIONED BY(dq_dummy int) > ROW FORMAT SERDE 'o

Is there a way to check if a column exists or not?

2013-09-23 Thread Gary Zhao
Hello I'm query a table and I'm able to filter column value is "NULL", but looks like some record doesn't even have "NULL" value. Is there a way to filter them out? Thanks Gary

Re: Creating partition with __HIVE_DEFAULT_PARTITION__ value

2013-09-23 Thread Stephen Sprague
If its any help I've done this kind of thing frequently: 1. create the table on the new cluster. 2. distcp the data right into the hdfs directory where the table resides on the new cluster - no temp storage required. 3. run this hive command: msck repair table ; -- this command will create y

Re: Creating partition with __HIVE_DEFAULT_PARTITION__ value

2013-09-23 Thread Nitin Pawar
If I understand correctly, this is what you are trying to do. you have a data center where the data is written on a hive table (Data center A) you have another data center where you want to take backup of table from data center A you are using dist-cp to transfer data from data center A to B if

Re: Creating partition with __HIVE_DEFAULT_PARTITION__ value

2013-09-23 Thread Edward Capriolo
Did you try ALTER TABLE table ADD IF NOT EXISTS PARTITION (partition=NULL); If that does not work you will need to create a dynamic partition type query that will create the dummy partition. File a jira if the above syntax does not work. There should be SOME way to create the default partition by

Creating partition with __HIVE_DEFAULT_PARTITION__ value

2013-09-23 Thread Ivan Kruglov
Hello to everyone, I'm working on the task of syncing data between two tables which have similar structure (read the same set of partitions). The tables are in different data centers and one table is a backup copy of another one. I'm trying to achieve this goal through distcp-ing data into targ

Re: Wrapping an analytical function

2013-09-23 Thread Nitin Pawar
Abhishek, Frans has already raised JIRA for this. https://issues.apache.org/jira/browse/HIVE-4661 On Mon, Sep 23, 2013 at 5:19 PM, Abhishek Gayakwad wrote: > Hi Frans, > > I am also getting same error while using analytical functions with case > expression > > FAILED: ParseException line 3:19

Re: Wrapping an analytical function

2013-09-23 Thread Abhishek Gayakwad
Hi Frans, I am also getting same error while using analytical functions with case expression FAILED: ParseException line 3:19 missing KW_END at 'over' near '' it is not allowing to use arithmetic operators with analytical function as well NoViableAltException(273@[129:7: ( ( ( KW_AS )? identifi