Hive Operator Counters

2013-02-05 Thread Jie Li
Hi all, Does anyone notice that the operator counters are not properly maintained? They are useful for understanding the query plan and execution, e.g how many rows each operator is processing and producing, and how much time each operator is spending. NUM_INPUT_ROWS NUM_OUTPUT_ROWS TIME_TAKEN T

Hive JDBC driver query statement timeout.

2013-02-05 Thread Kugathasan Abimaran
Hi, Is there a way to set the hive statement query timeout in hive jdbc driver? -- Thanks, With Regards, Abimaran

unbalanced transaction calls

2013-02-05 Thread James Warren
As part of our daily workflow, we're running a few hundred hive queries that are coordinated through oozie. Recently we're encountering issues where on average a job or two fails - and never the same query. The observed error is: FAILED: Error in metadata: java.lang.RuntimeException: commitTrans

Re: Out Of Memory on localmode.

2013-02-05 Thread Edward Capriolo
In that situation I might turn the setting off entirely. You would guess that the common use case is not "really small datasets" better the query to take longer then to oom a machine. On Tue, Feb 5, 2013 at 3:12 AM, Bennie Schut wrote: > Hi, > > > > Just in case anyone else ever runs into this. >

Out Of Memory on localmode.

2013-02-05 Thread Bennie Schut
Hi, Just in case anyone else ever runs into this. Lately our cluster kept on killing itself with an OOM message in the kernel log. It took me a while to realize why this happened since no single process was causing it. I traced it back to a few queries running concurrently on a really small dat