Can you try using using streaming from Hive?
http://wiki.apache.org/hadoop/Hive/LanguageManual/Transform
Cheers,
~Avram
On Apr 7, 2011, at 10:28 AM, Henry Liu wrote:
>
> I'd like to report some counters in my customized map and reduce ruby scripts
> for hive, just like hadoop streaming does by writing to stderr.
>
> Such as.
>
>
>
> #increment hadoop counters
> $stderr.puts("reporter:counter:Impression,Total,1")
> if first_click == 0 && click_details.empty?
> $stderr.puts("reporter:counter:Impression,NoClick,1")
> end
>
> $stderr.puts ("reporter:status: status rid #{rid}")
> $stderr.puts ("test debug message: rid #{rid}")
>
>
> These are all logged as regular messages, no counters/status recognized at
> all.
>
> Anyone has any ideas?
>
> Thanks.
>
