Hi Gopal - actually no., the table is not partitioned/bucketed.
Everyday the whole table gets cleaned up and populated with last 120 days'
data...
What are the other properties I can try to improve the performance of
reduce steps...?
Suresh V
http://www.justbirds.in
On Sat, Jan 9, 2016 at
e Hive on Spark.
>
>
>
> What normally works is Hive on MR. Have you tried:
>
>
>
> set hive.execution.engine=mr;
>
>
>
> Sounds like it times out for one reason or other!
>
>
>
> *From:* Suresh V [mailto:verdi...@gmail.com]
> *Sent:* 09 January 2016 1
Dear all
We have a Hive query that 'insert overwrites' from one main hive table to
another table about 24million rows every day.
This query was working fine so long, but lately it has started to hang at
the reduce steps.
It just gets stuck after all maps are completed. We checked the logs and it
