Not really sure if this is an issue on the Hive or Tez side, but when we open a Hive shell and set tez.task.resource.memory.mb to a different value than listed in tez-site.xml, the query that's run doesn't seem to pick up the setting and instead uses the one in the config file. However, if we let the Tez session timeout within the shell, then set the tez task memory to some value, the query run in the new session will use the manual setting as expected. Also, if you set the option as a command line setting when launching the hive shell, it will also use the manual setting as expected.
Has anyone else run into this as well or know what the root cause of this behavior is? Using Hive 2.0.1 and Tez 0.8.4. -- George A. Liaw (408) 318-7920 george.a.l...@gmail.com LinkedIn <http://www.linkedin.com/in/georgeliaw/>
