Re: How to run multiple Hive queries in parallel

2012-10-22 Thread Bejoy KS
, 22 Oct 2012 18:22:03 To: Reply-To: user@hive.apache.org Cc: ; Subject: Re: How to run multiple Hive queries in parallel Hi Bejoy and Bertrand Thanks for quick reply. I think tasks slots are not available in my cluster because I have only 4 slave machines. Actually I am beginner to HIVE. So

Re: How to run multiple Hive queries in parallel

2012-10-22 Thread Chunky Gupta
Hi Bejoy and Bertrand Thanks for quick reply. I think tasks slots are not available in my cluster because I have only 4 slave machines. Actually I am beginner to HIVE. So, if you can let me know how I can check if time slots are available or not. I have different users credentials to log in int

Re: How to run multiple Hive queries in parallel

2012-10-22 Thread Bertrand Dechoux
Bejoy is right. I just want to say explicitly that the scheduler configuration is something which is orthogonal to the use of Hive. (ie same problem with Pig or standard MapReduce jobs). Regards Bertrand PS : There is also the capacity scheduler. On Mon, Oct 22, 2012 at 2:18 PM, Bejoy KS wrote

Re: How to run multiple Hive queries in parallel

2012-10-22 Thread Bejoy KS
Hi Is your hive queries in waiting mode even though there are task slots available on your cluster? If task slots are getting exhausted and you need parallelism here, then you may need to look at some approaches of using fair scheduler and different user accounts for each user so that each use