That setting will make Hive more aggressive about trying to convert a join to a local task, where it bypasses the job tracker. When you're experimenting with queries on a small data set, it can make things much faster, but won't be useful for large data sets where you need the cluster.
dean On Tue, Jan 8, 2013 at 9:11 AM, Santosh Achhra <santoshach...@gmail.com>wrote: > > > Is setting hive.auto.convert.join to true will help setting mapreduce > local task and conditional task ? > > Good wishes,always ! > Santosh > > > On Tue, Jan 8, 2013 at 4:04 PM, Santosh Achhra <santoshach...@gmail.com>wrote: > >> Hello, >> >> I was reading an article on web which tells about MapReduce local Task >> and use of hash table files and conditional tasks to improve performance of >> hive queries. >> >> Any idea how to implement this ? I am aware of Map joins but I am sure >> how to implement Map reduce local tasks with hash tables. >> >> Good wishes,always ! >> Santosh >> > > -- *Dean Wampler, Ph.D.* thinkbiganalytics.com +1-312-339-1330