Re: hive auto join conversion

2014-08-12 Thread Chen Song
Yeah, I was trying the same thing, though a little big ugly. My query needs to LJ/J with multiple tables. When there are 1 or 2 LJ/Js, rewriting works but when there are > 3 tables, the got the same exception triggered by the following bug. https://issues.apache.org/jira/browse/HIVE-5891 Chen

Re: hive auto join conversion

2014-07-30 Thread Eugene Koifman
would manually rewriting the query from (T1 union all T2) LOJ S to equivalent (T1 LOJ S) union all (T2 LOJ S) help work around this issue? On Wed, Jul 30, 2014 at 6:19 PM, Chen Song wrote: > I tried that and I got the following error. > > FAILED: SemanticException [Error 10227]: Not all clauses

Re: hive auto join conversion

2014-07-30 Thread Chen Song
I tried that and I got the following error. FAILED: SemanticException [Error 10227]: Not all clauses are supported with mapjoin hint. Please remove mapjoin hint. I then tried turning off auto join conversion. set hive.auto.convert.join=false But no luck, same error. Looks like it is a known is

Re: hive auto join conversion

2014-07-30 Thread Navis류승우
Could you do it with hive.ignore.mapjoin.hint=false? Mapjoin hint is ignored from hive-0.11.0 by default (see https://issues.apache.org/jira/browse/HIVE-4042) Thanks, Navis 2014-07-31 10:04 GMT+09:00 Chen Song : > I am using cdh5 with hive 0.12. We have some hive jobs migrated from hive > 0.10

hive auto join conversion

2014-07-30 Thread Chen Song
I am using cdh5 with hive 0.12. We have some hive jobs migrated from hive 0.10 and they are written like below: select /*+ MAPJOIN(sup) */ c1, c2, sup.c from ( select key, c1, c2 from table1 union all select key, c1, c2 from table2 ) table left outer join sup on (table.c1 = sup.key) distribute by