Re: 回复: hive 0.11 auto convert join bug report

2013-09-25 Thread Steven Wong
ed by the XML >> serialization/deserialization of the MapredWork containing the join >> operator (HashMap serialization/deserialization will reverse the order of >> key-value pairs in the same bucket) and was exposed by HIVE-4078 because >> the copy of Mapredwork in the case

Re: 回复: hive 0.11 auto convert join bug report

2013-09-25 Thread Steven Wong
** > > *From:* Amit Sharma [mailto:amsha...@netflix.com] > *Sent:* Friday, September 13, 2013 6:05 AM > *To:* user@hive.apache.org > *Subject:* Re: 回复: hive 0.11 auto convert join bug report > > ** ** > > Hi Navis, > > ** ** > > I was trying to look

RE: 回复: hive 0.11 auto convert join bug report

2013-09-16 Thread Sun, Rui
: user@hive.apache.org Subject: Re: 回复: hive 0.11 auto convert join bug report Hi Navis, I was trying to look at this email thread as well as the jira to understand the scope of this issue. Does this get triggered only in cases of using aliases which end up mapping to the same value upon hashing

Re: 回复: hive 0.11 auto convert join bug report

2013-09-15 Thread Navis류승우
Hi, sorry for late reply. As Chun Chen said, same hashcode would make this problem vivid. But it can be happened whenever the appearing order in JOIN expression is different with that of parents. Thanks. 2013/9/13 Amit Sharma > Hi Navis, > > I was trying to look at this email thread as wel

Re: 回复: hive 0.11 auto convert join bug report

2013-09-12 Thread Amit Sharma
Hi Navis, I was trying to look at this email thread as well as the jira to understand the scope of this issue. Does this get triggered only in cases of using aliases which end up mapping to the same value upon hashing? Or can this be triggered under other conditions as well? What if the aliases ar

Re: 回复: hive 0.11 auto convert join bug report

2013-08-11 Thread Navis류승우
Hi, Hive is notorious making different result with different aliases. Changing alias was a final way to avoid bug in desperate situation. I think the patch in the issue is ready, wish it's helpful. Thanks. 2013/8/11 : > Hi Navis, > > My colleague chenchun finds that hashcode of 'deal' and 'dim

回复: hive 0.11 auto convert join bug report

2013-08-11 Thread wzc1989
Hi Navis, My colleague chenchun finds that hashcode of 'deal' and 'dim_pay_date' are the same and the code in MapJoinProcessor.java ignores the order of rowschema. I look at your patch and it's exactly the same place we are working on. Thanks for your patch. 在 2013年8月11日星期日,下午9:38,Navis류승우 写道:

Re: 回复: hive 0.11 auto convert join bug report

2013-08-11 Thread Navis류승우
Hi, I've booked this on https://issues.apache.org/jira/browse/HIVE-5056 and attached patch for it. It needs full test for confirmation but you can try it. Thanks. 2013/8/11 : > Hi all: > when I change the table alias dim_pay_date to A, the query pass in hive > 0.11(https://gist.github.com/code

回复: hive 0.11 auto convert join bug report

2013-08-11 Thread wzc1989
Hi all: when I change the table alias dim_pay_date to A, the query pass in hive 0.11(https://gist.github.com/code6/6187569#file-hive11_auto_convert_join_change_alias_pass): use test; create table if not exists src ( `key` int,`val` string); load data local inpath '/Users/code6/git/hive/data/files

hive 0.11 auto convert join bug report

2013-08-08 Thread wzc1989
Hi all: I'm currently testing hive11 and encounter one bug with hive.auto.convert.join, I construct a testcase so everyone can reproduce it(or you can reach the testcase here:https://gist.github.com/code6/6187569#file-hive11_auto_convert_join_bug): use test; create table src ( `key` int,`val`