Re: create table question

2014-04-22 Thread Sanjay Subramanian
For example if ur name node was hadoop_name_nodeIP:8020 (verify this thru your browser http://hadoop_name_nodeIP:50070) Modified Create Table == CREATE EXTERNAL TABLE states(abbreviation string, full_name string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LOCATION 'hdfs://hp83

Re: create table question

2014-04-22 Thread Shengjun Xin
in the ql, you set relative path tmp/states, according to the error message, you need to set absolute path On Wed, Apr 23, 2014 at 11:23 AM, EdwardKing wrote: > I use hadoop 2.2.0 and hive 0.13.0, I want to create a table from an > existing file, states.hql is follows: > CREATE EXTERNAL TABLE

create table question

2014-04-22 Thread EdwardKing
I use hadoop 2.2.0 and hive 0.13.0, I want to create a table from an existing file, states.hql is follows: CREATE EXTERNAL TABLE states(abbreviation string, full_name string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LOCATION 'tmp/states' ; [hadoop@master ~]$ hadoop fs -ls 14/04/22 20:17:32

Finding Max of a column without using any Aggregation functions

2014-04-22 Thread Subramanian, Sanjay (HQP)
Hey guys TABLE=STUDENT COLUMN=SCORE U want to find the max value in the column without using any aggregation functions. Its easy in a RDB context but I was trying to get a solution in Hive (clearly I have some spare time on my hands - LOL) select nfr.score from student nfr left oute

Re: How to get hdfs zip files in localfilesystem

2014-04-22 Thread Subramanian, Sanjay (HQP)
This looks like the file has Ctrl A (default delimiter) Try this CTRLA=$(echo -e "\x01”); sed 's/'${CTRLA}'/\t/g’ TheCombinedResultOfTheJob.txt > TheCombinedResultOfTheJob.tsv; less TheCombinedResultOfTheJob.tsv Thanks Warm Regards Sanjay From: Kishore kumar mailto:kish...@techdigita.in>> Rep

Re: Hive 0.13.0 - IndexOutOfBounds Exception

2014-04-22 Thread Bryan Jeffrey
Prasanth, Thank you for the help. It would not have occurred to me to look at partition sort and order issues from that dump. I may just apply the patch to my copy of 13. Regards, Bryan Jeffrey On Apr 22, 2014 2:41 PM, "Prasanth Jayachandran" < pjayachand...@hortonworks.com> wrote: > Bryan, >

Re: Hive 0.13.0 - IndexOutOfBounds Exception

2014-04-22 Thread Prasanth Jayachandran
Bryan, This issue is related to https://issues.apache.org/jira/browse/HIVE-6883 The workaround for this issue is to disable hive.optimize.sort.dynamic.partition optimization by setting it to false. We found this issue very late (towards the end of 0.13 release) and so wasn’t included in hive 0

Re: Hive 0.13.0 - IndexOutOfBounds Exception

2014-04-22 Thread Prasanth Jayachandran
Thanks Bryan. This is more than sufficient. As a workaround, can you try setting hive.optimize.sort.dynamic.partition=false and see if it helps? In the meantime, I will diagnose the issue. Thanks Prasanth Jayachandran On Apr 22, 2014, at 10:36 AM, Bryan Jeffrey wrote: > Prasanth, > > Was thi

Re: Hive 0.13.0 - IndexOutOfBounds Exception

2014-04-22 Thread Bryan Jeffrey
Prasanth, Was this additional information sufficient? This is a large road block to our adopting Hive 0.13.0. Regards, Bryan Jeffrey On Tue, Apr 22, 2014 at 7:41 AM, Bryan Jeffrey wrote: > Prasanth, > > The error seems to occur with just about any table. I mocked up a very > simple table to

Re: How to get hdfs zip files in localfilesystem

2014-04-22 Thread Kishore kumar
I am getting the message if i run below command to see the contents in merged file, please help how to do this, if I am storing the query result in local filesystem I can able to see the contents. # less TheCombinedResultOfTheJob.txt "TheCombinedResultOfTheJob.txt" may be a binary file. See it a

How to get hdfs zip files in localfilesystem

2014-04-22 Thread Kishore kumar
Hi Experts, Hive query result stored in hdfs with 75 zip files, I merged them and get into the local filesystem with '-getmerge', but I am unable to see the data after i unzipped the file, anything i am missing ? please help me. -- *Kishore *

Re: Hive 0.13.0 - IndexOutOfBounds Exception

2014-04-22 Thread Bryan Jeffrey
Prasanth, The error seems to occur with just about any table. I mocked up a very simple table to illustrate the problem (including input data, etc.) to make this easy to repeat. hive> create table loading_data_0 (A smallint, B smallint) partitioned by (range int) row format delimited fields term

RE: Kerberized Hive | Remote Access using Keytab

2014-04-22 Thread Savant, Keshav
Hi All, Can someone provide some information on below problem? Kind Regards, Keshav C Savant From: Savant, Keshav [mailto:keshav.c.sav...@fisglobal.com] Sent: Friday, April 18, 2014 3:52 PM To: user@hive.apache.org Subject: Kerberized Hive | Remote Access using Keytab Hi All, I have successful