RE: Hive-645 is slow to insert query results to mysql

2012-03-11 Thread Lu, Wei
Hi Viral and Bejoy.K.S I can see that both of you are suggesting Sqoop, and I will have a try ☺. Thanks, Wei From: Bejoy Ks [mailto:bejoy...@yahoo.com] Sent: Saturday, March 10, 2012 2:11 AM To: user@hive.apache.org; Lu, Wei Subject: Re: Hive-645 is slow to insert query results to mysql Hi Wei

Re: Hive-645 is slow to insert query results to mysql

2012-03-09 Thread Bejoy Ks
http://archive.cloudera.com/cdh/3/sqoop/SqoopDevGuide.html  Regards Bejoy.K.S From: Viral Bajaria To: "Lu, Wei" ; "user@hive.apache.org" Sent: Friday, March 9, 2012 11:19 PM Subject: RE: Hive-645 is slow to insert query results to mysql Hey Wei, I hav

RE: Hive-645 is slow to insert query results to mysql

2012-03-09 Thread Viral Bajaria
Hey Wei, I have used the udf before and figured it is only useful for summary results and not for big datasets due to the fault tolerant nature of map/reduce. If you don't have a well defined primary key you will end up with more rows than your query results. And you are correct in saying that thi