Hive-0.9 errors out when I run order by with timestamp datatype colums

2014-03-14 Thread Rob Paul
Has anyone seen this error? Any workaround: : org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"reducesinkkey0":1},"value":{"_col0":1,"_col1":"aaa","_col2":"","_col3":"","_col4":1,"_col5":"","_col6":"2010-09-10 01:11:

Re: Writing data to LOCAL with Hive Server2

2014-03-14 Thread Stephen Sprague
well that does complicate matters then. :) how to get a file off a host you don't have access to? when you say no access i presume you mean you have no login access. I can think of some ideas: 1. make a case to get access so rsync can connect. (best) 2. can you run a "hdfs dfs -get" comma

Extract datetime from reverse Time stamp.

2014-03-14 Thread Manjula mohapatra
My rowkey contains reverseTimestamp ( Max value - current time stamp) Example 9223370646332874562 select FROM_UNIXTIME ( unix_timestamp( '9223370646332874562','MMddHHmmssSSS')) > from HiveTest limit 1; 9226-01-07 22:34:42--obviously this wont give me right result as its reverse tim

Re: HBase- Hive Integration

2014-03-14 Thread Nick Dimiduk
hbase-dev to bcc; adding hive-user. this is a question for the user lists, and more for Hive's than HBase, as HBaseStorageHandler is code in Hive project, not HBase. Hi Sai, You are embarking into a brave world. Because your aim is the interop across these different Apache projects, I highly reco

Re: Writing data to LOCAL with Hive Server2

2014-03-14 Thread Kumar V
Thanks Stephen. Yes, rsync would be easy.  But we don't have access to the servers the hiveserver2 is running on.  Basically, there is no way to reach those files from our boxes. That's why I was asking about writing it locally.  I'll check this list for import/export like you mentioned. Thanks

org.apache.hadoop.hive.metastore.HiveMetaStoreClient with webhcat REST

2014-03-14 Thread Adam Silberstein
Hi, I'm testing out the REST interface to webhcat and stuck doing basic DDL operations. Background on installation: --I installed packages with apt-get --I'm on CDH4.5 I successfully have created and loaded tables with chat command line. E.g.:hcat -e 'create table testtable (a string, b string

Re: Writing data to LOCAL with Hive Server2

2014-03-14 Thread Stephen Sprague
re: HiveServer2 this is not natively possible (this falls under the export rubric.) similarly, you can't load a file directly from your client using native syntax (import.) Believe me, you're not the only one who'd like this both of these functions. :) I'd search this list for import or export ut

Re: Hive - Sorting on the Partition Column data type Int . Output is Alphabetic Sort

2014-03-14 Thread Stephen Sprague
i agree. back in the days of v0.7 who knows if this was a bug or not. What i do know is i have int partitions all over the place and they sort in numeric context just fine every day. i'm running v0.12. pretty sure this worked fine at v0.8 as well - that's when i started in hive. good luck! On

Moving Hive tables between database

2014-03-14 Thread Clay McDonald
Hello everyone, what method should I use to move Hive tables between database? Thanks, Clay

RE: ALTER TABLE RENAME TO fully qualified name

2014-03-14 Thread Clay McDonald
Thanks Navis! Clay -Original Message- From: Navis류승우 [mailto:navis@nexr.com] Sent: Thursday, March 13, 2014 11:51 PM To: user@hive.apache.org Subject: Re: ALTER TABLE RENAME TO fully qualified name HIVE-4064 is expected to solve this kind of problems in hive but not in progress ev

Writing data to LOCAL with Hive Server2

2014-03-14 Thread Kumar V
Hi,    Is it possible to write data to a local file system using Hive server 2 ?  When I use 'insert overwrite local directory /tmp/hivedata ...', it writes data in the directory on the box on which hive server 2 is running. What can I do to write this data to the file system of the bo

Re: Hive - Sorting on the Partition Column data type Int . Output is Alphabetic Sort

2014-03-14 Thread Nitin Pawar
Can you first try updating hive to atleast 0.11 if you can not move to 0.12 ? On Fri, Mar 14, 2014 at 4:49 PM, Arafat, Moiz wrote: > My comments inline > > > > *From:* Stephen Sprague [mailto:sprag...@gmail.com] > *Sent:* Friday, March 14, 2014 12:23 AM > > *To:* user@hive.apache.org > *Subject

RE: Hive - Sorting on the Partition Column data type Int . Output is Alphabetic Sort

2014-03-14 Thread Arafat, Moiz
My comments inline From: Stephen Sprague [mailto:sprag...@gmail.com] Sent: Friday, March 14, 2014 12:23 AM To: user@hive.apache.org Subject: Re: Hive - Sorting on the Partition Column data type Int . Output is Alphabetic Sort wow. its still sorting based on string context. ok, some followups.

Re: Best way to avoid cross join

2014-03-14 Thread fab wol
Hey Nitin, in import1 are at least 1.2 mio rows, with almost the same amount of distinct id's and approxametly 40k distinct keywords. et_keywords contains roundabout 2000 keywords. So the result of this cross join will be ca. 2.4 bio rows which need to be checked (see INSTR() function). Thx for l

Re: ALTER TABLE RENAME TO fully qualified name

2014-03-14 Thread Navis류승우
Yes, there are some similar issues, fixed in various ways. Thinking of merging all of them into one. I'll check HIVE-2584. Thanks. 2014-03-14 14:50 GMT+09:00 chenchun : > Navis, I have already done that, can you take a look? see > https://issues.apache.org/jira/browse/HIVE-2584 > > -- > chenchun