Re: Performance tuning in hive

2012-09-28 Thread Abhishek
: user@hive.apache.org > Cc: user@hive.apache.org > Subject: Re: Performance tuning in hive > > Hi Bejoy, > > How to use CTAS with Clustered By. > > I am getting following error when doing > > Create table as select > > CTAS does not support partitioning in the ta

Re: Performance tuning in hive

2012-09-28 Thread Bejoy KS
dheld, please excuse typos. -Original Message- From: Abhishek Date: Fri, 28 Sep 2012 11:14:56 To: Bejoy Ks Reply-To: user@hive.apache.org Cc: user@hive.apache.org Subject: Re: Performance tuning in hive Hi Bejoy, How to use CTAS with Clustered By. I am getting following error when

Re: Performance tuning in hive

2012-09-28 Thread Abhishek
s > your data set. > > Regards, > Bejoy KS > > From: Abhishek > To: "user@hive.apache.org" > Cc: "user@hive.apache.org" > Sent: Friday, September 28, 2012 5:16 AM > Subject: Re: Performance tuning in hive > > Hi Bejoy, > > Th

Re: Performance tuning in hive

2012-09-28 Thread Abhishek
; > Cc: "user@hive.apache.org" > Sent: Friday, September 28, 2012 5:16 AM > Subject: Re: Performance tuning in hive > > Hi Bejoy, > > Thanks for the reply.Can I know whether combination of > 1) Indexing and Bucketing >Or > 2) bucketing with Rc file &g

Re: Performance tuning in hive

2012-09-28 Thread Bejoy KS
if those suits your data set.   Regards, Bejoy KS From: Abhishek To: "user@hive.apache.org" Cc: "user@hive.apache.org" Sent: Friday, September 28, 2012 5:16 AM Subject: Re: Performance tuning in hive Hi Bejoy, Thanks for the repl

Re: Performance tuning in hive

2012-09-27 Thread Abhishek
then RC files gives you a performance > edge but if the queries are spanned across pretty much all columns then use > the more generalized Sequence Files. > > > Regards, > Bejoy KS > > From: Abhishek > To: Hive > Sent: Thursday, September 27, 2012 7:03 PM >

Re: Performance tuning in hive

2012-09-27 Thread Bejoy KS
2012 7:03 PM Subject: Performance tuning in hive Hi all, I am trying to increase the performance of some queries in hive, all queries mostly contain left outer join , group by and conditional checks, union all. I have over riden some properities in hive shell Set io.sort.mb=512 Set io.sort.

Performance tuning in hive

2012-09-27 Thread Abhishek
Hi all, I am trying to increase the performance of some queries in hive, all queries mostly contain left outer join , group by and conditional checks, union all. I have over riden some properities in hive shell Set io.sort.mb=512 Set io.sort.factor=100 Set mapred.child.jvm.opts=-Xmx2048mb Set