ail.com]
> Sent: 26 September 2012 22:27
> To: user@hive.apache.org
> Cc: ;
> Subject: Re: Hive configuration property
>
> Hi Ashok,
>
> Thanks for the reply, can you please tell me how many reducers should be
> considered using for 1 GB of intermediate data.
>
omatically determine number of reducers.
Thanks
Ashok S.
From: Abhishek [mailto:abhishek.dod...@gmail.com]
Sent: 26 September 2012 22:27
To: user@hive.apache.org
Cc: ;
Subject: Re: Hive configuration property
Hi Ashok,
Thanks for the reply, can you please tell me how many reducers should be
consid
epends on ur
> data size.
>
> Regards
> Ashok S.
>
> From: Bejoy KS [mailto:bejoy...@yahoo.com]
> Sent: 26 September 2012 21:04
> To: user@hive.apache.org
> Subject: Re: Hive configuration property
>
> Hi Abshiek
>
> Based on my experience you
Yes Abshiek,
By setting below prop. You ll get better result. The no should depends on ur
data size.
Regards
Ashok S.
From: Bejoy KS [mailto:bejoy...@yahoo.com]
Sent: 26 September 2012 21:04
To: user@hive.apache.org
Subject: Re: Hive configuration property
Hi Abshiek
Based on my experience
> yield you better performance numbers.
>
> Regards,
> Bejoy KS
>
> From: Abhishek
> To: "user@hive.apache.org"
> Cc: "user@hive.apache.org"
> Sent: Wednesday, September 26, 2012 7:04 PM
> Subject: Re: Hive configuration prop
e.org"
Cc: "user@hive.apache.org"
Sent: Wednesday, September 26, 2012 7:04 PM
Subject: Re: Hive configuration property
Thanks Bharath, Your points make sense.I'll try this "hive.exec.reducers.max"
property.
Regards
Abhi
Sent from my iPhone
On Sep 26, 201
Thanks Bharath, Your points make sense.I'll try this "hive.exec.reducers.max"
property.
Regards
Abhi
Sent from my iPhone
On Sep 26, 2012, at 9:23 AM, bharath vissapragada
wrote:
>
> I'm no expert in hive, but here are my 2 cents.
>
> By default hive schedules a reducer per every 1 GB of
I'm no expert in hive, but here are my 2 cents.
By default hive schedules a reducer per every 1 GB of data ( change that
value by modifying *hive.exec.reducers.bytes.per.reducer ) *. If your input
data is huge, there will be large number of reducers, which might be
unnecessary.( Sometimes large nu
Hi all,
I have doubt regarding below properties, is it a good practice to override
below properties in hive.
If yes, what is the optimal values for the following properties?
set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
set hive.exec.reducers.m
