Re: Hive on Tez Counters

2014-08-25 Thread Siddharth Seth
0.5 is almost out, the vote should be closed within a day. You'' have to use a build of Hive from the Tez branch though. TEZ-1118 is the patch you'll need to pick up to fix the CPU counters. This should apply directly on the 0.4 branch, if that's the approach you want to take. On Mon, Aug 25, 20

Re: Hive on Tez Counters

2014-08-25 Thread Suma Shivaprasad
Hi Siddharth/Gunther, Thanks for replying to my queries. I was particularly interested in the CPU counter since I was doing some benchmarking on queries. Can you please clarify if I just blindly take a mod(CPU counter) for all tasks and add them up..would they be fine..or should I take a patch fro

Re: Hive on Tez Counters

2014-08-21 Thread Gunther Hagleitner
Hive logs the same counters regardless of whether you run with Tez or MR. We've removed some counters in hive 0.13 (HIVE-4518) - the specific one you're looking for might be in that list. Thanks, Gunther. On Thu, Aug 21, 2014 at 11:13 AM, Siddharth Seth wrote: > I'll let Hive folks answer the

Re: Hive on Tez Counters

2014-08-21 Thread Siddharth Seth
I'll let Hive folks answer the questions about the Hive counters. In terms of the CPU counter - that was a bug in Tez-0.4.0, which has been fixed in 0.5.0. COMMITTED_HEAP_BYTES just represents the memory available to the JVM (Runtime.getRuntime().totalMemory()). This will only vary if the VM is s