Re: job counters in customized hive map/reduce script.

2011-04-07 Thread Carl Steinbach
Right now Hive's TRANSFORM mechanism does not allow you set counters. There's a ticket open for adding this feature: https://issues.apache.org/jira/browse/HIVE-1649 Thanks. Carl On Thu, Apr 7, 2011 at 10:35 AM, Avram Aelony wrote: > > Can you try using using streaming from Hive? > >htt

Re: job counters in customized hive map/reduce script.

2011-04-07 Thread Avram Aelony
Can you try using using streaming from Hive? http://wiki.apache.org/hadoop/Hive/LanguageManual/Transform Cheers, ~Avram On Apr 7, 2011, at 10:28 AM, Henry Liu wrote: > > I'd like to report some counters in my customized map and reduce ruby scripts > for hive, just like hadoop strea

job counters in customized hive map/reduce script.

2011-04-07 Thread Henry Liu
I'd like to report some counters in my customized map and reduce ruby scripts for hive, just like hadoop streaming does by writing to stderr. Such as. #increment hadoop counters $stderr.puts("reporter:counter:Impression,Total,1") if first_click == 0 && click_details.empty?