Re: move hive tables from one cluster to another cluster

Here's the doc for "msck repair table" (or on EMR, "alter table recover partitions"): https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE) . -- Lefty On Fri, Feb 28, 2014 at 5:04 PM, Brad Ruderman wrote: > Hi, just want to give

Re: move hive tables from one cluster to another cluster

Hi, just want to give warning about export/import to different hive versions see this bug: https://issues.apache.org/jira/browse/HIVE-5318 Thanks, Brad On Fri, Feb 28, 2014 at 1:55 PM, Edward Capriolo wrote: > Hive also has export import utilities. > > > https://cwiki.apache.org/confluence/disp

Re: move hive tables from one cluster to another cluster

Hive also has export import utilities. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport With hive thrift this should be fairly easy to script. On Fri, Feb 28, 2014 at 4:53 PM, Stephen Sprague wrote: > that advice is way over complicating something that is very easy

Re: move hive tables from one cluster to another cluster

that advice is way over complicating something that is very easy. instead, please take this approach. 1. run the ddl to create the table on the new cluster 2. distcp the hdfs data into the appropriate hdfs directory. 3. run "msck repair table " in hive to discover the partitions and populate the m

Re: move hive tables from one cluster to another cluster

If you are using Mysql as a database, you need to take a mysql dump of the metastore database and search/replace the old namenode hostname with the new namenode hostname. Once that is completed, import the metastore database. Thanks On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv < dwivedish

Re: move hive tables from one cluster to another cluster

this is a FAQ. see doc on: msck repair table this will scan hdfs and create the corresponding partitions in the metastore. On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv < dwivedishash...@gmail.com> wrote: > Where was your meta data in derby or MySql? > > > *Warm Regards_**∞_* > * Shashw

Re: move hive tables from one cluster to another cluster

Where was your meta data in derby or MySql? *Warm Regards_**∞_* * Shashwat Shriparv* [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image: https://twitter.com/shriparv] [image: https://www

Re: move hive tables from one cluster to another cluster

Hi, I have moved warehouse file to another cluster. but still i didn't see the tables on the other cluster. How to rebulid the metadata? Thanks Soniya On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K wrote: > 1. you can use distcp to copy the files to the new cluster > 2. rebuild metadata > > > On

Re: move hive tables from one cluster to another cluster

1. you can use distcp to copy the files to the new cluster 2. rebuild metadata On Thu, Feb 27, 2014 at 8:07 PM, soniya B wrote: > Dear experts, > > I want to move my hive tables from one cluster to another cluster. how can > i do it? > > Thanks > Soniya. >

move hive tables from one cluster to another cluster

Dear experts, I want to move my hive tables from one cluster to another cluster. how can i do it? Thanks Soniya.