Re: hive partition pruning on joining on partition column

2013-10-11 Thread Nitin Pawar
one easiest way to do this is create a table where each date maps to week of month, week of year, day of week, day of month and then do the join on just date and put the conditions on where clause. Its easy to manipulate the date column for my understanding and you can join just based on date and

hive partition pruning on joining on partition column

2013-10-11 Thread java8964 java8964
I have the requirement trying to support in hive, not sure if it is doable. I have the hadoop 1.1.1 with Hive 0.9.0 (Using deby as the meta store) If I partition my data by a dt column, so if my table 'foo' have some partitions like 'dt=2013-07-01' to 'dt=2013-07-30'. Now the user want to query al

Re: NPE org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable

2013-10-11 Thread Yin Huai
Hello Xinyang, Can you attach the query plan (the output of "EXPLAIN")? I think a bad plan caused the error. Also, can you try hive trunk? Looks like it is a bug fixed after the release of 0.11. Thanks, Yin On Fri, Oct 11, 2013 at 9:21 AM, xinyan Yang wrote: > Development environment,hive 0

Re: NPE org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable

2013-10-11 Thread xinyan Yang
Development environment,hive 0.11、hadoop 1.0.3 2013/10/11 xinyan Yang > Hi, > when i run this sql,it fails,can anyone give me a advise > > > select e.udid as udid,e.a

NPE org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable

2013-10-11 Thread xinyan Yang
Hi, when i run this sql,it fails,can anyone give me a advise select e.udid as udid,e.app_id as app_id from acorn_3g.ClientChannelDefine cc join ( select udid,app_id,from_

Re: [ANN] Hivemall: Hive scalable machine learning library

2013-10-11 Thread Nitin Pawar
Just tried this for some hot trends in forum managements. Was pretty impressive. I will try this more deeply and if possible integrate in my product. Thanks for the awesome work. Nitin On Fri, Oct 11, 2013 at 12:58 PM, Makoto YUI wrote: > Hi, > > I added support for the-state-of-the-art clas

Re: NullPointerException on Sample Tables / CDH 4.4

2013-10-11 Thread fab wol
somehow after three days of searching, i just deployed client configuration for all hive roles again, and the error seems to be gone. lets see what the future brings. cheers 2013/10/11 fab wol > hey everyone, > > I've got supplied with a decent ten node CDH 4.4 cluster, only 7 days old, > and

NullPointerException on Sample Tables / CDH 4.4

2013-10-11 Thread fab wol
hey everyone, I've got supplied with a decent ten node CDH 4.4 cluster, only 7 days old, and someone tried some HBase stuff on it. I wanted to apply my (on another cluster working) workflow's to that cluster (consisting of HiveQL Scripts and Oozie Workflows) but unfortunately i the following issue

Re: [ANN] Hivemall: Hive scalable machine learning library

2013-10-11 Thread Makoto YUI
Hi, I added support for the-state-of-the-art classifiers (those are not yet supported in Mahout) and Hivemall's cute(!?) logo as well in Hivemall 0.1-rc3. Newly supported classifiers include - Confidence Weighted (CW) - Adaptive Regularization of Weight Vectors (AROW) - Soft Confidence Weight