Re: Configure Hive in Cluster

2013-01-23 Thread Nitin Pawar
Server$Handler$1.run(Server.java:1388) >> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.security.auth.Subject.doAs(Subject.java:415) >> at >> org.apache.hado

Re: Configure Hive in Cluster

2013-01-22 Thread venkatramanan
.hadoop.mapred.Task.reportFatalError(Task.java:298) at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTask.java:2829) thanks, Venkat Original Message ---- Subject:Re: Configure Hive in Cluster Date: Thu,

Re: Re: Configure Hive in Cluster

2013-01-22 Thread Nitin Pawar
ect.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382) > > at org.apache.hadoop.ipc.Client.call(Client.java:1070) > at org.apache.hadoop.

Fwd: Re: Configure Hive in Cluster

2013-01-22 Thread venkatramanan
n Source) at org.apache.hadoop.mapred.Task.reportFatalError(Task.java:298) at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTask.java:2829) thanks, Venkat Original Message Subject: Re: Configure Hive in Cluster Date: Thu,

Re: Configure Hive in Cluster

2013-01-17 Thread venkatramanan
Can you suggest me the mandatory hive parameters and clustering configuration steps On Thursday 17 January 2013 12:56 PM, Nitin Pawar wrote: looks like a very small cluster with very limited memory to run mapreduce jobs also number of map/reduce slots on nodes are less so at a time only one ma

Re: Configure Hive in Cluster

2013-01-16 Thread Nitin Pawar
looks like a very small cluster with very limited memory to run mapreduce jobs also number of map/reduce slots on nodes are less so at a time only one map is running. but still 15 min is a lot of time for 600MB memory On Thu, Jan 17, 2013 at 12:47 PM, venkatramanan < venkatraman...@smartek21.com

Re: Configure Hive in Cluster

2013-01-16 Thread venkatramanan
Below details are the cluster configuration Configured Capacity : 82.8 GB DFS Used : 1.16 GB Non DFS Used : 31.95 GB DFS Remaining: 49.69 GB DFS Used% : 1.4 % DFS Remaining% : 60.01 % Live Nodes

Re: Configure Hive in Cluster

2013-01-16 Thread nagarjuna kanamarlapudi
What's the size of your cluster .. Number of nodes and their capacity On Thursday, January 17, 2013, Nitin Pawar wrote: > how many number of nodes you have for select query? > whats your select query? > > if its just a select * from table then it does not run any mapreduce job > so its just takin

Re: Configure Hive in Cluster

2013-01-16 Thread Nitin Pawar
how many number of nodes you have for select query? whats your select query? if its just a select * from table then it does not run any mapreduce job so its just taking time to show data on your screen if you are using that query On Thu, Jan 17, 2013 at 12:24 PM, venkatramanan < venkatraman...@s

Re: Configure Hive in Cluster

2013-01-16 Thread venkatramanan
I didnt set any hive parameters and my total table size is 610 MB only On Thursday 17 January 2013 12:11 PM, Nitin Pawar wrote: a bit more details on size of table and select query will help also did you set any hive parameters ? On Thu, Jan 17, 2013 at 12:12 PM, venkatramanan mailto:venkatr

Re: Configure Hive in Cluster

2013-01-16 Thread Nitin Pawar
a bit more details on size of table and select query will help also did you set any hive parameters ? On Thu, Jan 17, 2013 at 12:12 PM, venkatramanan < venkatraman...@smartek21.com> wrote: > Hi All, > > Am Newbie in apache hive. I have create a table and thats points to the > HDFS Folder path a

Configure Hive in Cluster

2013-01-16 Thread venkatramanan
Hi All, Am Newbie in apache hive. I have create a table and thats points to the HDFS Folder path and its takes 15 min to execute the simple "*select*" stmt, Can anyone suggest me for a best practices and performance improvement on hive. Thanks in Advance Venkat