Re: Configure Hive in Cluster

2013-01-22 Thread venkatramanan
No, all the nodes are up and running. i dont know, when hive takes the other nodes "HOST NAME" thats the error i guess.. revert me if am wrong On Wednesday 23 January 2013 01:07 PM, Nitin Pawar wrote: when you ran the query, did the VM shutdown ? On Wed, Jan 23, 2013 at 12:57 PM, venkatraman

Re: Re: Configure Hive in Cluster

2013-01-22 Thread Nitin Pawar
when you ran the query, did the VM shutdown ? On Wed, Jan 23, 2013 at 12:57 PM, venkatramanan < venkatraman...@smartek21.com> wrote: > Hi, > > I got the following error while executing the "select count(1) from > tweettrend;" > > Below are the exact log msg from the jobtracker Web Interface > >

Fwd: Re: Configure Hive in Cluster

2013-01-22 Thread venkatramanan
Hi, I got the following error while executing the "select count(1) from tweettrend;" Below are the exact log msg from the jobtracker Web Interface *Hive Cli Error:* Exception in thread "Thread-21" java.lang.RuntimeException: Error while reading from task log url at org.apache.hadoop.hi

Re: how may map-reduce needed in a hive query

2013-01-22 Thread Nitin Pawar
if you look closely in first phase it executes your transform and in second it does your sum operation On Wed, Jan 23, 2013 at 11:24 AM, Richard wrote: > thanks. I used explain command and get the plan, but I am still confused. > The below is the description of two map-reduce stages: > > it see

Re:how may map-reduce needed in a hive query

2013-01-22 Thread Richard
thanks. I used explain command and get the plan, but I am still confused. The below is the description of two map-reduce stages: it seems that in stage-1 the aggregation has already been done, why stage-2 has aggregation again? == STAGE PLANS: Stage: Stage-1 Map

Re: how may map-reduce needed in a hive query

2013-01-22 Thread Nitin Pawar
you can run explain extended (your query) to get more details On Wed, Jan 23, 2013 at 9:15 AM, Richard wrote: > I am wondering how to determine the number of map-reduce for a hive query. > > for example, the following query > > select > sum(c1), > sum(c2), > k1 > from > { > select transform(*

how may map-reduce needed in a hive query

2013-01-22 Thread Richard
I am wondering how to determine the number of map-reduce for a hive query. for example, the following query select sum(c1), sum(c2), k1 from { select transform(*) using 'mymapper' as c1, c2, k1 from t1 } a group by k1; when i run this query, it takes two map-reduce, but I expect it to take

Re: missing documentation?

2013-01-22 Thread Lauren Blau
Thanks. There are at least 0.8.1 versions there. I still have not found 0.9.0 or the new 0.10.0 anywhere. Lauren On Tue, Jan 22, 2013 at 9:47 AM, Abdelrhman Shettia wrote: > Hi Lauren , > > You may want to try the following link . > > https://github.com/l1x/apache-hive/tree/master/hive-0.7.1/doc

Re: Table schema size limit to 4000 chars ?

2013-01-22 Thread Jakob Homan
There shouldn't be any problems with comments in Avro schemas. You just need to make sure they're escaped properly. We did run into a problem with schema.literal values longer than 4k (the size of the backing mysql varchar field), so internally we just bump this value for our Hive installs: ALTE

Re: missing documentation?

2013-01-22 Thread Abdelrhman Shettia
Hi Lauren , You may want to try the following link . https://github.com/l1x/apache-hive/tree/master/hive-0.7.1/docs Thanks -Abdelrahman Hortonworks, Inc. Technical Support Engineer Abdelrahman Shettia ashet...@hortonworks.com Office phone: (708) 689-9609 How am I doing? Please feel free to

specification of SERDE in RCFile

2013-01-22 Thread Mathieu Despriee
Hi folks, Through samples here and there, I've seen tables definitions using RCFile storage specifying a SERDE in somecase, and sometimes not. ie : sometimes ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe' STORED AS RCFILE some other times, only : STORED AS RCFILE My qu

Re: Missing tables!

2013-01-22 Thread Dean Wampler
Are you using Derby? Did you change directories? By default, Derby drops the metastore_db in the current directory, but you can specify an absolute path for it in the hive-site.xml config file, e.g.,: javax.jdo.option.ConnectionURL jdbc:derby:;databaseName=/path/to/metastore_db;create=true

missing documentation?

2013-01-22 Thread Lauren Blau
The documentation links are broken on hive.apache.org for every release newer than 0.7.1. Has the documentation been moved elsewhere? Thanks, lauren