Re: Adding Hive Partitions Programatically.

2012-03-01 Thread Roberto Congiu
Also consider that if you're using the metastore API, you'll most likely need to recompile whenever you upgrade hive, while you most likely won't need to do that if you use thrift. R. On Mon, Feb 27, 2012 at 9:58 AM, Edward Capriolo wrote: > You can use the metastore API directly if you source

Re: Adding Hive Partitions Programatically.

2012-03-01 Thread Aniket Mokashi
If you have hive-server running somewhere you can do following- HiveConf hiveConf = new HiveConf(MyClass.class); hiveConf.set("hive.metastore.local", "false"); hiveConf.set(ConfVars.METASTOREURIS.varname, url); HiveMetaStoreClient client = new HiveMetaStoreClient(hiveConf); and then do- client

Re: Adding Hive Partitions Programatically.

2012-02-27 Thread Edward Capriolo
You can use the metastore API directly if you source all the correct hadoop and hive xml files, have all of hives/lib in your classpath and network access. It is much more graceful to correct through the thrift service. On Mon, Feb 27, 2012 at 12:53 PM, Hans Uhlig wrote: > I am using external t

Re: Adding Hive Partitions Programatically.

2012-02-27 Thread Hans Uhlig
I am using external tables already. Is the Metastore API not a usable API from inside another Java Application? On Mon, Feb 27, 2012 at 9:19 AM, Edward Capriolo wrote: > The most programmatic way is to use external tables and then use > HiveService (thrift) to add the partition after your MR job

Re: Adding Hive Partitions Programatically.

2012-02-27 Thread Edward Capriolo
The most programmatic way is to use external tables and then use HiveService (thrift) to add the partition after your MR job has ran successfully. On Mon, Feb 27, 2012 at 12:17 PM, Hans Uhlig wrote: > How can you add a partition to a table programmatically? I have a > mapreduce=  job that needs