Re: HIve temp file

2014-01-19 Thread Ben Kim
The problem was that my custom built UDAF with subqueries caused all UDAF logics to run only on reducers. I created a jira relating to this (HIVE-6230<https://issues.apache.org/jira/browse/HIVE-6230> ) *Benjamin Kim* *benkimkimben at gmail* On Tue, Jan 14, 2014 at 3:25 PM, Ben Kim

HIve temp file

2014-01-13 Thread Ben Kim
Hello! When i run hive job, it creates large temporary files on /tmp/hive-ben/hive_2014-01-14_15-01-39_521_3015861149916225685-1/ somewhere around 300GB. this number tends to get larger if i use lower number of reducers. with 5 reducers the size goes up to 1TB my input files are total 1GB, but

Is colocating hdfs2.0 table and hdfs1.0 table possible?

2013-06-26 Thread Ben Kim
Hello Hive users! just a quick question, Is colocating hdfs2.0 table and hdfs1.0 table possible? whici it means I've setup hive 0.11.0 with hadoop2.0 and want one of the table to be exist on a remote hadoop1.0.3. so i used following sql, only getting errors hive> create external table pokesHD

Re: HDFS directory in /user/hive/warehouse getting "hive" as Owner ?

2013-06-07 Thread Ben Kim
Hi apoloze for bringing up old post(email) but does *hive.metastore.execute.setugi *property work properly? I'm using Hive 0.11 with Hadoop 2.0.0 after setting hive.metastore.execute.setugi to true and logging into *ben*system account, if i create a table with "*create table pokes(foo int, bar str

Re: Hive Thrift Client

2012-07-17 Thread Ben Kim
missed by some > reason. > You can try applying the patch or using hive in trunk. > > 2012/7/17 Ben Kim > >> I tested it on 0.8.1 and 0.9.0 >> >> Ben >> >> >> On Tue, Jul 17, 2012 at 3:03 PM, Navis류승우 wrote: >> >>> Can I ask the h

Re: Hive Thrift Client

2012-07-16 Thread Ben Kim
I tested it on 0.8.1 and 0.9.0 Ben On Tue, Jul 17, 2012 at 3:03 PM, Navis류승우 wrote: > Can I ask the hive version you are currently using? > > > 2012/7/17 Ben Kim > >> Did you get around to solve this problem? >> >> I running into the same problem and can

Re: Hive Thrift Client

2012-07-16 Thread Ben Kim
Did you get around to solve this problem? I running into the same problem and can't find a fix anywhere. For Hiveserver you will need to create your own when running the server such as running "hive --service hiveserver & >> hiveserver.log 2>&1" but it writes no logs. I think a connection is gett

Hive with HBase ACL possible?

2012-06-19 Thread Ben Kim
Has anyone been success full with integrating HBase ACL with Hive? Recent versions of HBase (0.92.1 and 0.94.0) come with ACL features. I tried to integrate Hive 0.9.0 with HBase 0.94.0. I ran hive cli client like following hive --auxpath "$HIVE_HOME/lib/hive-hbase-handler-0.9.0.jar,$HIVE_HOME/lib