Almost all operations in hive can exploit map reduce for parallelism.
(isnt not really done on the thread level) essentially if you run a
hive job and there is multiple mappers or reducers it was parallelism.
On Fri, Jun 22, 2012 at 5:14 AM, Jayanth Muthya wrote:
> Thanks or clarifying, I'll look
Thanks or clarifying, I'll look into it too and see if I can find anything.
-Jayanth
On Thu, Jun 21, 2012 at 10:47 PM, Jerome Banks wrote:
> set hive.exec.parallel=true;
>
> This will run Hive jobs in parallel, if they are able to do so.
>
> As for multi-threading in the actual job itself, I do
set hive.exec.parallel=true;
This will run Hive jobs in parallel, if they are able to do so.
As for multi-threading in the actual job itself, I don't think so, but I'm
not sure. The query planner will merge steps together, in order to try to
minimize the number of MR jobs needed to run a query, b
Hi,
I was looking into some of the source code for hive. And had a few
questions regarding parallelism in hive. Can a map task in
hive exploit parallelism and run multiple threads? If it can do that, does
it do it by default? or does a user have to configure the settings?
This question seems really
