Re: Cartesian Product in HIVE

2012-10-01 Thread Abhishek
k > To: user@hive.apache.org > Cc: user@hive.apache.org > Cc: Bejoy Ks > Subject: Re: Cartesian Product in HIVE > Sent: Oct 1, 2012 09:32 > > Thanks for the reply Bejoy. I did not any order by in the query. Here are the > properities I have used and query, table sizes - set

Fw: Cartesian Product in HIVE

2012-09-30 Thread Bejoy KS
s goes well try doing map side join. hive> set auto.convert.join=true; hive>SELECT t2.col1,t3.col1FROM table2 t2JOIN table3 t3; --Original Message-- From: Abhishek To: user@hive.apache.org Cc: user@hive.apache.org Cc: Bejoy Ks Subject: Re: Cartesian Product in HIVE Sent: Oct 1, 2012 0

Re: Cartesian Product in HIVE

2012-09-30 Thread Abhishek
ail.com > > Date: Sat, 29 Sep 2012 07:44:06 -0700 > > Subject: Re: Cartesian Product in HIVE > > To: user@hive.apache.org; bejoy...@yahoo.com > > > > Thanks for the reply Bejoy. > > > > I tried to map join, by setting the property mentioned by you and Even &

Re: Cartesian Product in HIVE

2012-09-30 Thread abhishek dodda
OIN table3 t3 table2 : 997406 rows total bytes: 20848934 -- 19.88 mb table3 : 20773 rows total bytes: 353127 -- 0.33 mb #of Mappers: 4 #of reducers: 1 > > Regards > Bejoy KS > >> From: abhishek.dod...@gmail.com >> Date: Sat, 29 Sep 2012 07:44:06 -0700 >> Subject:

RE: Cartesian Product in HIVE

2012-09-30 Thread Bejoy KS
r two tables. Regards Bejoy KS > From: abhishek.dod...@gmail.com > Date: Sat, 29 Sep 2012 07:44:06 -0700 > Subject: Re: Cartesian Product in HIVE > To: user@hive.apache.org; bejoy...@yahoo.com > > Thanks for the reply Bejoy. > > I tried to map join, by setting the prope

Re: Cartesian Product in HIVE

2012-09-29 Thread abhishek dodda
t from handheld, please excuse typos. > > From: Abhishek > Date: Fri, 28 Sep 2012 23:56:16 -0400 > To: Hive > ReplyTo: user@hive.apache.org > Cc: Bejoy Ks > Subject: Cartesian Product in HIVE > > Hi all, > > I have use case where we

Re: Cartesian Product in HIVE

2012-09-28 Thread Bejoy KS
Sep 2012 23:56:16 To: Hive Reply-To: user@hive.apache.org Cc: Bejoy Ks Subject: Cartesian Product in HIVE Hi all, I have use case where we are doing Cartesian product of two tables with One table with 990k rows Second table 20k rows Query is Cartesian product of just two columns. So it comes

Cartesian Product in HIVE

2012-09-28 Thread Abhishek
Hi all, I have use case where we are doing Cartesian product of two tables with One table with 990k rows Second table 20k rows Query is Cartesian product of just two columns. So it comes around 20 billion rows For one hour it is processing like around 5 billion rows. So the process takes ar