YES!
That did it, I will be adding that one to our global config. Good to see
they defaulted it to false in 0.14.
Thanks Prasanth
On Thu, Mar 12, 2015 at 9:29 PM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:
> Hi
>
> Can you try with hive.optimize.sort.dynamic.partition set to
Hi
Can you try with hive.optimize.sort.dynamic.partition set to false?
Thanks
Prasanth
On Thu, Mar 12, 2015 at 9:02 PM -0700, "Alex Bohr"
mailto:a...@gradientx.com>> wrote:
I'm inserting from an unpartitioned table with a 6 hours of data into a table
partitioned by hour.
The source table
I'm inserting from an unpartitioned table with a 6 hours of data into a
table partitioned by hour.
The source table is 400M rows and 500GB so it's needs a lot of reducers
working on the data - Hive chose 544 which sounds good.
But 538 reducers did nothing and the other 6 are working for over an h
