-
From: Santosh Achhra
Date: Wed, 9 Jan 2013 00:11:37
To:
Reply-To: user@hive.apache.org
Subject: Re: Map Reduce Local Task
Thank you Dean,
One of our table is very small, it has only 16,000 rows and other big table
has 45 million plus records. Wont doing a loacl task help in this case ?
Good
Thank you Dean,
One of our table is very small, it has only 16,000 rows and other big table
has 45 million plus records. Wont doing a loacl task help in this case ?
Good wishes,always !
Santosh
On Tue, Jan 8, 2013 at 11:59 PM, Dean Wampler <
dean.wamp...@thinkbiganalytics.com> wrote:
> more ag
That setting will make Hive more aggressive about trying to convert a join
to a local task, where it bypasses the job tracker. When you're
experimenting with queries on a small data set, it can make things much
faster, but won't be useful for large data sets where you need the cluster.
dean
On Tu
Is setting hive.auto.convert.join to true will help setting mapreduce local
task and conditional task ?
Good wishes,always !
Santosh
On Tue, Jan 8, 2013 at 4:04 PM, Santosh Achhra wrote:
> Hello,
>
> I was reading an article on web which tells about MapReduce local Task and
> use of hash table
Hello,
I was reading an article on web which tells about MapReduce local Task and
use of hash table files and conditional tasks to improve performance of
hive queries.
Any idea how to implement this ? I am aware of Map joins but I am sure how
to implement Map reduce local tasks with hash tables.