Re: Ways to reduce launching time of query in Hive 2.2.1

2018-04-16 Thread Sungwoo Park
Do you use Tez session pool along with LLAP (as Thai suggests in the previous reply)? If a new query finds an idle AM in Tez session pool, there will be no launch cost for AM. If no idle AM is found or if you specify a queue name, a new AM should start in order to serve the query. This is explained

Re: Ways to reduce launching time of query in Hive 2.2.1

2018-04-16 Thread Thai Bui
The best approach would be to use a demonized containers such as Hive LLAP + Tez session pool or Spark on Hive. I’m not that familiar with Spark on Hive so I can’t comment on it but Hive on LLAP has worked really well for me when coupled with Tez session pool. You’ll have to specify how many Tez A