On 11/6/14, 11:09 AM, Kostas Tzoumas wrote:
I am running into the same error [1] with plain Tez (not Hive):
Any advice on what configuration parameters I should start looking at?
Both issues are related to the Tez memory distributor
(InitialMemoryAllocator) impl used.
http://tez.apache.org/
Am using Tez 0.4.0 and counters for the query run are as below
2014-08-26 14:06:41,203 INFO [Thread-13]: exec.Task
(TezTask.java:execute(171)) - org.apache.tez.common.counters.DAGCounter:
2014-08-26 14:06:41,205 INFO [Thread-13]: exec.Task
(TezTask.java:execute(173)) -NUM_FAILED_TASKS: 67
20
Trying to run a query on Tez with the following configurations
*set hive.tez.container.size=5120*
*set mapreduce.map.child.java.opts=-Xmx5120M*
*set hive.tez.java.opts=-Xmx4096M*
*set hive.auto.convert.join.noconditionaltask.size=805306000*
*set tez.am.resource.memory.mb=5120*
*set tez.am.java.op
