need some Clarification about tmp folder(urgent)

2012-03-12 Thread hadoop hive
Hi Folks, i Have some question like in my tmp folder on hdfs i have a user called hadoop whose having much space, i need to free this space so please help me out. * /tmp/hive-hadoop/hive_2012-03-13_04-32-14_701_8751021191431391338/-ext-10002/ * Is it part of data stored in hdfs or its just a te

Re:hive-Nullpointer Exception From ConditionalResolverSkewJoin

2012-03-12 Thread 王锋
the problem is occurred when I enabled the configuration item : hive.optimize.skewjoin After disable the property,hive can run normally. At 2012-03-13 12:06:53,"王锋" wrote: Exception: java.lang.NullPointerException at org.apache.hadoop.hive.ql.plan.ConditionalResolverSkewJoin.getT

hive-Nullpointer Exception From ConditionalResolverSkewJoin

2012-03-12 Thread 王锋
Exception: java.lang.NullPointerException at org.apache.hadoop.hive.ql.plan.ConditionalResolverSkewJoin.getTasks(ConditionalResolverSkewJoin.java:97) at org.apache.hadoop.hive.ql.exec.ConditionalTask.execute(ConditionalTask.java:81) at org.apache.hadoop.hive.ql.exec.Task.

RE: External table point of clarification

2012-03-12 Thread Tucker, Matt
Hi Keith, That's correct. Any files that are in a directory that's referenced by Hive are assumed to be in the same table. You'll need to make a directory for each table and then load each CSV file into the appropriate directory. Matt Tucker -Original Message- From: Keith Wiley [mai

External table point of clarification

2012-03-12 Thread Keith Wiley
It appears as if the syntax for creating an external table takes a column description and a directory where the table (a .csv file) should be found. Notably, it doesn't take the path to the file, rather it takes the path to the directory containing the file. ...which means that if I have multi

Re: Basic statement problems

2012-03-12 Thread Keith Wiley
It has started working now. I don't know what I changed. I dropped every single table from hive, explicitly created a new directory on HDFS and moved the .csv file to that directory, ran hive again and created the table. This time it worked. I can perform queries against the directory. Mayb

Re: Basic statement problems

2012-03-12 Thread Balaji Rao
What does a simple "select * from stringmap limit 10" return ? On Mon, Mar 12, 2012 at 12:51 PM, Keith Wiley wrote: > On Mar 9, 2012, at 16:46 , Steven Wong wrote: > >> The LOCATION clause has to specify the directory that contains (only) your >> data files. > > I've tried it both ways: > > CREA

Re: Basic statement problems

2012-03-12 Thread Keith Wiley
On Mar 9, 2012, at 16:46 , Steven Wong wrote: > The LOCATION clause has to specify the directory that contains (only) your > data files. I've tried it both ways: CREATE EXTERNAL TABLE stringmap (ObjectTypeCode INT, AttributeName STRING, AttributeValue INT, LangId INT, Value STRING, DisplayOrde

Re: Error

2012-03-12 Thread Keith Wiley
Thanks for the suggestion, but my hadoop directory doesn't have a build directory at all. I suppose that makes sense. I haven't tried to rebuild hadoop since I installed it (CDH3). I'm just using the executables as they came in the original .zip. Gah, hive sorta works but I can't get this la

Re: Is it possible to get the progress of a query through thrift server?

2012-03-12 Thread Felix . 徐
Can you provide some references? Thanks very much! 在 2012年3月12日 下午11:28,Edward Capriolo 写道: > Yes. You have access to the job counters through thrift, as well as a > method to test if query is done. > > Edward > > On Mon, Mar 12, 2012 at 11:12 AM, Felix.徐 wrote: > > Hi all, > > I want to build a

Re: Is it possible to get the progress of a query through thrift server?

2012-03-12 Thread Edward Capriolo
Yes. You have access to the job counters through thrift, as well as a method to test if query is done. Edward On Mon, Mar 12, 2012 at 11:12 AM, Felix.徐 wrote: > Hi all, > I want to build a website to monitor the execution of queries sent to hive , > is there any way to realize it?

Is it possible to get the progress of a query through thrift server?

2012-03-12 Thread Felix . 徐
Hi all, I want to build a website to monitor the execution of queries sent to hive , is there any way to realize it?

Re: Re: how to join like a "In A but not in B" operation?

2012-03-12 Thread sac . khurana
Try this SELECT a.key. FROM a LEFT SEMI JOIN b on (a.key <> b.key) Sent from BlackBerry® on Airtel -Original Message- From: "Raghunath, Ranjith" Date: Mon, 12 Mar 2012 05:43:09 To: 'user@hive.apache.org'; 'sac.khur...@gmail.com' Subject: Re: Re: how to join like a "In A but not in

Re: how to compute histogram on non-numeric data set?

2012-03-12 Thread Philip Tromans
Is that not just a COUNT(1) and a GROUP BY? Phil. 2012/3/12 Richard : > I have noticed histogram_numeric(col, n), but it seems to require numeric > column. > I have a string column, they are numeric like string but are category label, > e.g, > > 11, 200034 > > two different strings are two di

Re:Re: how to join like a "In A but not in B" operation?

2012-03-12 Thread Richard
this approach works, I did not realize "var=NULL" is different from "var is NULL" before. Richard At 2012-03-12 12:03:00,"Evan Pollan" wrote: I used a left outer join with a constraint on a joined row column value being null -- logically equivalent to a "not in" clause. Looks funny, but