Re: UDAF and group by

2011-09-04 Thread Huan Li
tePartial() and merge(). So to do this i > run: > > set hive.map.aggr=false; > select myUdf(col1, col2) from table group by col3; > > Now this seems to work. But are my assumptions correct that this will never > call terminatePartial() or merge()? > Thanks Koert > >

Re: UDAF and group by

2011-09-01 Thread Huan Li
Koert, Not sure what you mean by "results can be merged between groups". UDAF should be used to aggregated records by group. Why need to merge between groups? Can you give some examples of what kind of query you'd like to run? 2011/8/30 Koert Kuipers > If i run my own UDAF with group by, can i

How HQL Queries are Converted to Hadoop Jobs

2011-06-16 Thread Huan Li
I want to take a look at what's the implementations for queries like JOIN/MAPJOIN/SORT BY/ORDER BY... I have source code for hive, but I can not figure out where to start. Any ideas? Thanks, Huan