Re: cross join

2012-12-03 Thread Mark Grover
Periya, I am using Hive-0.8.1 and was able to get joins to work with: 1. No on clause 2. "on (true)" as the on clause to work. I am not entirely sure why you are getting exceptions with the above queries. Perhaps, there were some bugs in 0.7.1 that got resolved in 0.8.1? As far as workarounds go,

Re: Hive 0.7 use the old mapred API

2012-12-03 Thread Mark Grover
Yong, In my opinion, #2 wouldn't be that hard to do. Of course, upgrading to the new API (albeit by updating Hive) would the right thing to do long term. Mark On Mon, Dec 3, 2012 at 7:42 AM, java8964 java8964 wrote: > Hi, > > Our company current is using CDH3 release, which comes with Hive 0.7

Re: Skew join failure

2012-12-03 Thread Mark Grover
Hey David, Sure thing. Play around with that property's value, see if that makes any difference. Also, if you could search to see if a file with a name like *hive_skew_join_ **bigkeys* exists on HDFS. Perhaps, it's looking at a different path. If so, we can figure out how to fix that. Mark On Mo

Re: Skew join failure

2012-12-03 Thread David Morel
On 30 Nov 2012, at 16:46, Mark Grover wrote: Hi David, It seems like Hive is unable to find the skewed keys on HDFS. Did you set *hive.skewjoin.key property? If so, to what value?* Hey Mark, thanks for answering! I didn't set it to anything, but left it at its default value (100,000 IIRC). I

Hive 0.7 use the old mapred API

2012-12-03 Thread java8964 java8964
Hi, Our company current is using CDH3 release, which comes with Hive 0.7.1. Right now, I have the data coming from another team, which also provides the custom InputFormat and RecorderReader, but using the new mapreduce API. I am trying to build a hive table on these data, and hope I can reuse t