Re: Import from MySQL to Hive using Sqoop

2013-06-26 Thread tofunmibabatunde
Unsubscribe Sent from my BlackBerry® wireless handheld from Glo Mobile. -Original Message- From: Omkar Joshi Date: Thu, 27 Jun 2013 11:55:39 To: user@hive.apache.org Reply-To: user@hive.apache.org Subject: RE: Import from MySQL to Hive using Sqoop Hi Nitin, Thanks for the inputs

RE: Import from MySQL to Hive using Sqoop

2013-06-26 Thread Omkar Joshi
Hi Nitin, Thanks for the inputs - will try out those. Regards, Omkar Joshi From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Thursday, June 27, 2013 11:48 AM To: user@hive.apache.org Subject: Re: Import from MySQL to Hive using Sqoop Disclaimer: I am not a sqoop guru so here are just

Re: Import from MySQL to Hive using Sqoop

2013-06-26 Thread Nitin Pawar
Disclaimer: I am not a sqoop guru so here are just suggestions, sqoop documentation says, "Sqoop job to import data for Hive into a particular partition by specifying the --hive-partition-key and --hive-partition-value arguments" I have not tried these, but not sure will it works in case of dynam

Import from MySQL to Hive using Sqoop

2013-06-26 Thread Omkar Joshi
Hi, I have to import > 400 million rows from a MySQL table(having a composite primary key) into a PARTITIONED Hive table Hive via Sqoop. The table has data for two years with a column departure date ranging from 20120605 to 20140605 and thousands of records for one day. I need to partition the