AW: Count bug in Hive 3.0.0.3.1

2020-04-28 Thread Julien Tane
e: Count bug in Hive 3.0.0.3.1 I have tested the script with Hive 2.3.6, Hive 3.1.2, and Hive 4.0.0-SNAPSHOT (all with minor modifications), and have not found any problem. So, I guess all the master branches are fine. If Hive 3.0.0.3.1 is the release included in HDP 3.0.0 or HDP 3.0.1, I remembe

Re: Count bug in Hive 3.0.0.3.1

2020-04-28 Thread Tim Havens
Unsubscribe On Tue, Apr 28, 2020, 1:23 AM Deepak Krishna wrote: > Hi team, > > We came across a bug related to count function. We are using hive > 3.0.0.3.1 with Tez 0.9.0.3.1. PFA the queries to replicate the issue. > > Please register this as a bug and let us know if we can support in anyway >

Re: Count bug in Hive 3.0.0.3.1

2020-04-28 Thread Sungwoo Park
I have tested the script with Hive 2.3.6, Hive 3.1.2, and Hive 4.0.0-SNAPSHOT (all with minor modifications), and have not found any problem. So, I guess all the master branches are fine. If Hive 3.0.0.3.1 is the release included in HDP 3.0.0 or HDP 3.0.1, I remember that this Hive-LLAP/Tez releas

Re: Count bug in Hive 3.0.0.3.1

2020-04-28 Thread Peter Vary
Hi Deepak, If I were you, I would test your repro case on the master branch. If it is fixed, I think you should try to find the fix which solves the problem and cherry-pick the fix to branch-3 and branch-3.1 so the fix is there in the next release. If the problem is still present on the master

Count bug in Hive 3.0.0.3.1

2020-04-27 Thread Deepak Krishna
Hi team, We came across a bug related to count function. We are using hive 3.0.0.3.1 with Tez 0.9.0.3.1. PFA the queries to replicate the issue. Please register this as a bug and let us know if we can support in anyway to fix the issue. It would also be helpful to know if there are any other w

Re: bug in hive

2014-09-23 Thread Shushant Arora
Hi Alan 1.When writer takes exclusive lock , hive won't allow to write anyone(even the session which holds lock) to write in table. Do I need to pass lock handle to read query or I am missing here something. 2.Or you mean to insert using hadoop filesystem not using hive ? On Tue, Sep 23, 2014 at

Re: bug in hive

2014-09-23 Thread Alan Gates
Shushant, Creating a patched jar that would include the lock functionality you want is unlikely to work. Wouldn't the following workflow work for you: 1. Writer locks the table explicitly via LOCK TABLE 2. Writer inserts 3. Writer unlocks the table explicitly via UNLOCK TABLE If you're using

Re: bug in hive

2014-09-22 Thread John Omernik
Shushant - What I believe what Stephen is sarcastically trying to say is that some organizational education may be in order here. Hive itself is not even at version 1.0, those of us who use Hive in production know this, and have to accept that there will be bugs like the one you are trying to addr

Re: bug in hive

2014-09-20 Thread Shushant Arora
Hi Stephen We have cloudera setup deployed in our cluster, which we cannot update due to orgs policy. Till the time its not updated to version 0.14, How can I achieve the locking feature please suggest. On Sun, Sep 21, 2014 at 10:40 AM, Stephen Sprague wrote: > great policy. install open sourc

Re: bug in hive

2014-09-20 Thread Stephen Sprague
great policy. install open source software that's not even version 1.0 into production and then not allow the ability to improve it (but of course reap all the rewards of its benefits.) so instead of actually fixing the problem the right way introduce a super-hack work-around cuz, you know, that's

Re: bug in hive

2014-09-20 Thread Shushant Arora
Hi Alan I have 0.10 version of hive deployed in my org's cluster, I cannot update that because of org's policy. How can I achieve exclusive lock functionality while inserting in dynamic partition on hive 0.10 ? Does calling hive scripts via some sort of java api with patched jar included will help

Re: bug in hive

2014-09-20 Thread Alan Gates
Up until Hive 0.13 locks in Hive were really advisory only, since as you note any user can remove any other user's lock. In Hive 0.13 a new type of locking was introduced, see https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-LockManager This new locking is a

bug in hive

2014-09-20 Thread Shushant Arora
Hive version 0.9 and later has a bug While inserting in a hive table Hive takes an exclusive lock. But if table is partitioned , and insert is in dynamic partition , it will take shared lock on table but if all partitions are static then hive takes exclusive lock on partitions in which data is b

Bug in Hive Partition windowing functions?

2014-04-29 Thread Keith
Hi, we have an issue with windowing function query never completed when running against the large dataset > 25,000 rows. That is the reducer (only one) never exit and it appears stuck in an infinite loop. I looked at the Reducer counter and it never changes over the 6 hours when it gets stuck i

Re: Bug in Hive Split function (Tested on Hive 0.9 and 0.11)

2013-10-09 Thread John Omernik
I opened a JIRA on this: https://issues.apache.org/jira/browse/HIVE-5506 On Wed, Oct 9, 2013 at 9:44 AM, John Omernik wrote: > Hello all, I think I have outlined a bug in the hive split function: > > Summary: When calling split on a string of data, it will only return all > array items if the

Bug in Hive Split function (Tested on Hive 0.9 and 0.11)

2013-10-09 Thread John Omernik
Hello all, I think I have outlined a bug in the hive split function: Summary: When calling split on a string of data, it will only return all array items if the the last array item has a value. For example, if I have a string of text delimited by tab with 7 columns, and the first four are filled,

回复: BUG IN HIVE-4650 seems not fixed

2013-08-01 Thread wzc1989
Hi Yin: Thanks for the patch, I patch it and pass this testcase, I will use it with our hive11 production test. 在 2013年8月1日星期四,上午5:09,Yin Huai 写道: > I just uploaded a patch to https://issues.apache.org/jira/browse/HIVE-4968. > You can try it and see if the problem has been resolved for you

Re: 回复: BUG IN HIVE-4650 seems not fixed

2013-07-31 Thread Yin Huai
I just uploaded a patch to https://issues.apache.org/jira/browse/HIVE-4968. You can try it and see if the problem has been resolved for your query. On Wed, Jul 31, 2013 at 11:21 AM, Yin Huai wrote: > Seems it is another problem. > Can you try > > > SELECT * > FROM (SELECT VAL001 x1, >

Re: 回复: BUG IN HIVE-4650 seems not fixed

2013-07-31 Thread Yin Huai
Seems it is another problem. Can you try SELECT * FROM (SELECT VAL001 x1, VAL002 x2, VAL003 x3, VAL004 x4, VAL005 y FROM (SELECT /*+ mapjoin(v2) */ (VAL001- mu1) * 1/(sd1) VAL001, (VAL002- mu2) * 1/(sd2) VAL002,

回复: BUG IN HIVE-4650 seems not fixed

2013-07-28 Thread wzc1989
Hi: I attach the output of EXPLAIN, and the hive I use is compiled from trunk and my hadoop version is 1.0.1. I use default hive configuration. -- wzc1...@gmail.com 已使用 Sparrow (http://www.sparrowmailapp.com/?sig) 已使用 Sparrow (http://www.sparrowmailapp.com/?sig) 在 2013年7月29日星期一,下午1:08,Yi

Re: 回复: BUG IN HIVE-4650 seems not fixed

2013-07-28 Thread Yin Huai
Hi, Can you also post the output of EXPLAIN? The execution plan may be helpful to locate the problem. Thanks, Yin On Sun, Jul 28, 2013 at 8:06 PM, wrote: > What I mean by "not pass the testcase in HIVE-4650" is that I compile the > trunk code and run the query in HIVE-4650: > SELECT * > FROM

回复: BUG IN HIVE-4650 seems not fixed

2013-07-28 Thread wzc1989
What I mean by "not pass the testcase in HIVE-4650" is that I compile the trunk code and run the query in HIVE-4650: SELECT * FROM (SELECT VAL001 x1, VAL002 x2, VAL003 x3, VAL004 x4, VAL005 y FROM (SELECT /*+ mapjoin(v2) */ (VAL001- mu1) * 1/(sd1

BUG IN HIVE-4650 seems not fixed

2013-07-28 Thread wzc1989
hi all: We are currently testing hive 0.11 against our production environment and run into some problems. Some of them are related to the param "hive.auto.convert.join". We disable this param and some failed testcases passed. By searching in hive jira issues I find that the patch in HIVE-465

skewjoin bug in Hive?

2012-02-14 Thread 董友良
Hi We used hive0.7 with Hadoop 0.20.5. I have a sql like this: set mapred.reduce.tasks=256; set hive.groupby.skewindata = true; set hive.optimize.skewjoin=true; A Long sql here join 2 big table ….. I found a error as follow: Ended Job = job_201202080532_94374 java

FW: a potential bug in HIVE/HADOOP ? -- MetaStore, createDatabase()

2011-12-14 Thread Bing Li
fyi --- 11年12月14日,周三, Bing Li 写道: 发件人: Bing Li 主题: a potential bug in HIVE/HADOOP ? -- MetaStore, createDatabase() 收件人: "hive dev list" 日期: 2011年12月14日,周三,下午8:32 Hi, developers When I ran Hive UT with the candidate build of Hive-0.8.0, I found that TestEmbeddedHiveMet

FW: a potential bug in HIVE/HADOOP ? -- MetaStore, createDatabase()

2011-12-14 Thread Bing Li
fyi --- 11年12月14日,周三, Bing Li 写道: 发件人: Bing Li 主题: a potential bug in HIVE/HADOOP ? -- MetaStore, createDatabase() 收件人: "hive dev list" 日期: 2011年12月14日,周三,下午8:32 Hi, developers When I ran Hive UT with the candidate build of Hive-0.8.0, I found that TestEmbeddedHiveMet