Re: Hadoop cluster hangs on big hive job

2013-03-06 Thread Daning Wang
clause.** > ** > > ** ** > > Thanks, > > Chalcy**** > > *From:* Daning Wang [mailto:dan...@netseer.com] > *Sent:* Wednesday, March 06, 2013 3:08 PM > *To:* user@hive.apache.org > *Subject:* Hadoop cluster hangs on big hive job > > ** ** > > We have 5 nodes

Hadoop cluster hangs on big hive job

2013-03-06 Thread Daning Wang
We have 5 nodes cluster(Hadoop 1.0.4), It hung a couple of times while running big hive jobs(hive-0.8.1). Basically all the nodes are dead, from that trasktracker's log looks it went into some kinds of loop forever. All the log entries like this when problem happened. Any idea how to debug the is

Re: Hive to read sequencefile

2012-07-09 Thread Daning Wang
rg/Hive/languagemanual-ddl.html#LanguageManualDDL-Create%252FDropTable > > > 2012/7/10 Daning Wang > >> Hi all, >> >> New to here. I have sequence files and I want to read in Hive, I did >> some search on the net. looks the way I need to do >> >> 1.

Hive to read sequencefile

2012-07-09 Thread Daning Wang
Hi all, New to here. I have sequence files and I want to read in Hive, I did some search on the net. looks the way I need to do 1. Write new FileInputFormat so Hive can read both key and value. (ref http://osdir.com/ml/hive-user-hadoop-apache/2009-10/msg00034.html) 2. Write a SerDe to deseriali