Hive-thrift is definitely best option till now. That said, I am wondering
if its possible to load megastore in local mode[1] to avoid dependency on
external service. Can I read the HIVE_CONF_DIR for javax.jdo.option.*
parameters and talk to sql server hosting hive metadata?
[1] https://cwiki.apach
But then you're writing Java code!!! The Horror!!!
;^P
On Tue, Feb 12, 2013 at 10:53 AM, Edward Capriolo wrote:
> If you use hive-thrift/hive-service you can get the location of a
> table through the Table API (instead of Dean's horrid bash-isms)
>
>
> http://hive.apache.org/docs/r0.7.0/api/org/
If you use hive-thrift/hive-service you can get the location of a
table through the Table API (instead of Dean's horrid bash-isms)
http://hive.apache.org/docs/r0.7.0/api/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.Client.html#get_table(java.lang.String,
java.lang.String)
Table t = ..
;
mailto:user@hive.apache.org>>
Subject: Re: How to load hive metadata from conf dir
In our case we needed to access hive meta data inside our oozie workflows
we were using Hcatalog as our hive metadata store and it was easy to access
table meta data directly via Hcatalog apis )
para
I'll mention another bash hack that I use all the time:
hive -e 'some_command' | grep for_what_i_want |
sed_command_to_remove_just_i_dont_want
For example, the following command will print just the value of
hive.metastore.warehouse.dir, sending all the logging junk written to
stderr to /dev/null
e.org<mailto:user@hive.apache.org>" <
> user@hive.apache.org<mailto:user@hive.apache.org>>
> Date: Tuesday, 12 February 2013 10:27 AM
> To: "user@hive.apache.org<mailto:user@hive.apache.org>" <
> user@hive.apache.org<mailto:user@hive.apache.org>&
er.markgro...@gmail.com>>
Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Date: Tuesday, 12 February 2013 10:27 AM
To: "user@hive.apache.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: Re
Hi Parag,
I think your question boils down to:
How does one access Hive metadata from MapReduce jobs?
In the past, when I've had to write MR jobs and needed Hive metadata, I
ended up writing a wrapper Hive query that used a custom mapper and reducer
by using hive's transform functionality to do t
Hello Hive Users,
I am writing a program in java which is bundled as JAR and executed using
hadoop jar command. I would like to access hive metadata (read partitions
informations) in this program. I can ask user to set HIVE_CONF_DIR
environment variable before calling my program or ask for any re
