Re: Map Reduce Local Task

2013-01-08 Thread bejoy_ks
- From: Santosh Achhra Date: Wed, 9 Jan 2013 00:11:37 To: Reply-To: user@hive.apache.org Subject: Re: Map Reduce Local Task Thank you Dean, One of our table is very small, it has only 16,000 rows and other big table has 45 million plus records. Wont doing a loacl task help in this case ? Good

Re: Map Reduce Local Task

2013-01-08 Thread Santosh Achhra
Thank you Dean, One of our table is very small, it has only 16,000 rows and other big table has 45 million plus records. Wont doing a loacl task help in this case ? Good wishes,always ! Santosh On Tue, Jan 8, 2013 at 11:59 PM, Dean Wampler < dean.wamp...@thinkbiganalytics.com> wrote: > more ag

Re: Map Reduce Local Task

2013-01-08 Thread Dean Wampler
That setting will make Hive more aggressive about trying to convert a join to a local task, where it bypasses the job tracker. When you're experimenting with queries on a small data set, it can make things much faster, but won't be useful for large data sets where you need the cluster. dean On Tu

Re: Map Reduce Local Task

2013-01-08 Thread Santosh Achhra
Is setting hive.auto.convert.join to true will help setting mapreduce local task and conditional task ? Good wishes,always ! Santosh On Tue, Jan 8, 2013 at 4:04 PM, Santosh Achhra wrote: > Hello, > > I was reading an article on web which tells about MapReduce local Task and > use of hash table

Map Reduce Local Task

2013-01-08 Thread Santosh Achhra
Hello, I was reading an article on web which tells about MapReduce local Task and use of hash table files and conditional tasks to improve performance of hive queries. Any idea how to implement this ? I am aware of Map joins but I am sure how to implement Map reduce local tasks with hash tables.