Re: OOM with Hive on Tez

2014-08-26 Thread Suma Shivaprasad
Am using Tez 0.4.0 and counters for the query run are as below 2014-08-26 14:06:41,203 INFO [Thread-13]: exec.Task (TezTask.java:execute(171)) - org.apache.tez.common.counters.DAGCounter: 2014-08-26 14:06:41,205 INFO [Thread-13]: exec.Task (TezTask.java:execute(173)) -NUM_FAILED_TASKS: 67 20

OOM with Hive on Tez

2014-08-26 Thread Suma Shivaprasad
Trying to run a query on Tez with the following configurations *set hive.tez.container.size=5120* *set mapreduce.map.child.java.opts=-Xmx5120M* *set hive.tez.java.opts=-Xmx4096M* *set hive.auto.convert.join.noconditionaltask.size=805306000* *set tez.am.resource.memory.mb=5120* *set tez.am.java.op