problems with indices

2011-09-19 Thread rohan monga
Hi, I have a table and index that look like CREATE TABLE table_t1(id1 int, id2 int) CREATE INDEX table_t1_idx ON TABLE table_t1(id1) AS 'org.apache.hadoop.hive.ql.index.AggregateIndexHandler' WITH DEFERRED REBUILD IDXPROPERTIES("AGGREGATES"="count(id2)"); ALTER INDEX table_t1_idx ON table_t1 REB

Re: Decommission of datanode(Urgent)

2011-09-19 Thread Vikas Srivastava
Hey!! i m using 0.20.2 apache hadoop and hive 0.7.0 , i thing i would like to ask is that i have to do make exclude file on all the datanodes or only on NAMENODE. if on NN then i did that but not working. i did that watever u said but its not working actually wat happen is all lives nodes went

Time/date functions - timezone

2011-09-19 Thread Sam William
I have all my slave nodes on PDT timezone. However when I run this query , select from_unixtime(unix_timestamp()) from dual; (dual is a one row table that I created). I get the date/time in UTC.What do I do get the PDT time ( i dont want to write a udf for this ) . Sam William sa

java.lang.RuntimeException: Error while reading from task log url

2011-09-19 Thread Krish Khambadkone
Hi, I am trying to run a join query against two HBase tables from Hive and I get the following exception, after some googling, I found this URL https://issues.apache.org/jira/browse/HIVE-1579. Are there any resolutions to this? java.lang.RuntimeException: Error while reading from task log

RE: Decommission of datanode(Urgent)

2011-09-19 Thread Siddharth Tiwari
Hi Vikas, oh I see, then it should work as u per ur configuration. What you can try is, first stop the services and then edit the conf file, restart the engine again, note ur exclude file must not have any entry to start with, after starting hadoop with 0 byte exclude, go and put the full IP

Re: Decommission of datanode(Urgent)

2011-09-19 Thread Vikas Srivastava
hey sid , thanks but i tried for the same also.. 1: first stop cluster *"please make note that this file must be included at the namenode startup"* is this wat you mean is to add file at *dfs.hosts.exclude* in hdfs-site and after that start-dfs.sh ,start-mapred.sh and after starting server ,

RE: Decommission of datanode(Urgent)

2011-09-19 Thread Siddharth Tiwari
Hi vikas, Please include your exclude file in hdfs-site.xml under the property dfs.hosts.exclude. please make note that this file must be included at the namenode startup and then u hv to edit it for the datanodes you want to exclude. Secondly, after editin it for the ip:port of the retiring d

Problem with Hive query.

2011-09-19 Thread trang van anh
Dear all, I have problem with running query with Hive: My situation: i set up hadoop cluster as following, it running well. Namenode: server1 datanodes:server2,server3 I setup hive at server1, and setup metastore as mysql, that's ok. i created external table named "user_search" and point to hd

Decommission of datanode(Urgent)

2011-09-19 Thread Vikas Srivastava
Hey folks !! i tried to decommission datanode from hadoop cluster... steps i followed 1: add this in core site * dfs.hosts.exclude /home/hadoop/excludes true * 1: add this in mapred-site * mapred.hosts.exclude /home/hadoop/excludes true * 3:create a excludes f