any views on the problem
>
>
> From: saurabhmishra.i...@outlook.com
> To: user@hive.apache.org; navis....@nexr.com
> Subject: RE: Hive Query Unable to distribute load evenly in reducers
> Date: Tue, 16 Oct 2012 11:23:29 +0530
>
>
> by using m
any views on the problem
From: saurabhmishra.i...@outlook.com
To: user@hive.apache.org; navis@nexr.com
Subject: RE: Hive Query Unable to distribute load evenly in reducers
Date: Tue, 16 Oct 2012 11:23:29 +0530
by using mapjoin if you are implying setting
set hive.auto.convert.join=true
by using mapjoin if you are implying setting
set hive.auto.convert.join=true;
then this configuration i am already using, but to no avail...:(
Date: Tue, 16 Oct 2012 14:17:47 +0900
Subject: Re: Hive Query Unable to distribute load evenly in reducers
From: navis@nexr.com
To: user
uration to
> better load distribute in the reducers
>
> > Date: Mon, 15 Oct 2012 16:29:56 +0100
>
> > Subject: Re: Hive Query Unable to distribute load evenly in reducers
> > From: philip.j.trom...@gmail.com
> > To: user@hive.apache.org
>
> >
> > Is yo
hing on the lines of
> > select a, b, c, count(D) from tableA join tableB on a.x=b.y join group
> > by a, b,c;
> >
> >
> >> From: liy...@gmail.com
> >> Date: Mon, 15 Oct 2012 21:10:39 +0800
> >> Subject: Re: Hive Query Unable to distribute load
...@gmail.com
>> Date: Mon, 15 Oct 2012 21:10:39 +0800
>> Subject: Re: Hive Query Unable to distribute load evenly in reducers
>> To: user@hive.apache.org
>
>>
>> And your queries were?
>>
>> On Mon, Oct 15, 2012 at 8:09 PM, Saurabh Mishra
>> wrot
The queries are simple joins, something on the lines of
select a, b, c, count(D) from tableA join tableB on a.x=b.y join group by
a, b,c;
> From: liy...@gmail.com
> Date: Mon, 15 Oct 2012 21:10:39 +0800
> Subject: Re: Hive Query Unable to distribute load evenly in reducers
&
And your queries were?
On Mon, Oct 15, 2012 at 8:09 PM, Saurabh Mishra
wrote:
> Hi,
> I am firing some hive queries joining tables containing upto 30millions
> records each. Since the load on the reducers is very significant in these
> cases, i specifically set the following parameters before exe
