Re: Regarding hive.exec.parallel

2019-05-08 Thread Zoltan Haindrich
Hey Varun! I'm not sure about you actual query; but hive.exec.parallel enable to execute stages in parallel The full tez dag is usually "one stage" of the execution (but you should take a look at the explain). If you would be using mr engine there might have been some speedup; but in case of te

Regarding hive.exec.parallel

2019-05-07 Thread Varun Rao
Hello, We were wondering what the benefits are of setting hive.exec.parallel to true. I know that this will execute any possible tasks in parallel. For example MapReduce stages, sampling stages, merge stages, limit stages etc will be executed in parallel allowing for the overall job to be complete