Re: Re: multiple tables join with only one hug table.

2011-08-13 Thread Koert Kuipers
I am not aware of any optimization that does something like that. Anyone? Also your suggestion means 10 hash tables would have to be in memory. I think that with a normal map-reduce join in hive you can join 10 tables at once (meaning in a single map-reduce) if they all join on the same key. 2011

Re: Hive server with hiveconf parameters

2011-08-13 Thread Achi Chen
Hi Ayon, According to this issue: https://issues.apache.org/jira/browse/HIVE-2139. Hiveserver doesn't accept -hiveconf until next release (0.8.0) Achi Chen 2011/8/13 Ayon Sinha > Hi, > How do I start the hiveserver with the -hiveconf parameters? > > -Ayon > See My Photos on Flickr

Re:Re: multiple tables join with only one hug table.

2011-08-13 Thread Daniel,Wu
Thanks, it works, but not as effective as possible: suppose we join 10 small tables (s1,s2...s10) with one huge table (big) in a database house system (the join is between big table and small table, like star schema), after I set the parameters as you set, it will have 10 mapside join, after on

Re: Reducer Issue in New Setup

2011-08-13 Thread hadoop n00b
Hi All, It turned out to be a DNS issue as Loren pointed out. It's working fine now. Not going for CDH3 right now as this was only a hardware move. Thanks for your help! On Thu, Aug 11, 2011 at 10:18 PM, Loren Siebert wrote: > Can you run normal MR jobs, like the example Pi calculation? Somet