Re: Caching metastore objects

2015-05-27 Thread Scott C Gray
2015 01:25 AM Subject: Re: Caching metastore objects Siva / Scott, Such a framework exists in some form : https://issues.apache.org/jira/browse/HIVE-2038 To make it even more generic there was a proposal https://issues.apache.org/jira/browse/HIVE-2147 But there was a resistance from a com

Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
Awesome!! On Wed, May 27, 2015 at 10:55 AM, Ashutosh Chauhan wrote: > Siva / Scott, > > Such a framework exists in some form : > https://issues.apache.org/jira/browse/HIVE-2038 > To make it even more generic there was a proposal > https://issues.apache.org/jira/browse/HIVE-2147 But there was a

Re: Caching metastore objects

2015-05-26 Thread Ashutosh Chauhan
Siva / Scott, Such a framework exists in some form : https://issues.apache.org/jira/browse/HIVE-2038 To make it even more generic there was a proposal https://issues.apache.org/jira/browse/HIVE-2147 But there was a resistance from a community for it. May be now community is ready for it : ) Ashu

Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
Thanks for the replies. @Ashutosh - thanks for the pointer! Yes I was running 0.11 metastore. Let me try with 0.13 metastore! Maybe my woes will be gone. If they don't then I'll continue working along these lines. @Alan - agreed. Caching MTables seems like a better approach if 0.13 metastore perf

Re: Caching metastore objects

2015-05-26 Thread Ashutosh Chauhan
Are you running pre-0.12 or with hive.metastore.try.direct.sql = false; Work done on https://issues.apache.org/jira/browse/HIVE-4051 should alleviate some of your problems. On Mon, May 25, 2015 at 8:19 PM, Sivaramakrishnan Narayanan < tarb...@gmail.com> wrote: > Apologies if this has been discu

Re: Caching metastore objects

2015-05-26 Thread Scott C Gray
apache.org Date: 05/26/2015 01:57 PM Subject: Re: Caching metastore objects Sivaramakrishnan Narayanan May 25, 2015 at 20:19 Apologies if this has been discussed in the past - my searches did not pull up any relevant threads. If there

Re: Caching metastore objects

2015-05-26 Thread Alan Gates
Sivaramakrishnan Narayanan May 25, 2015 at 20:19 Apologies if this has been discussed in the past - my searches did not pull up any relevant threads. If there are better solutions available out of the box, please let me know! Problem statement

Caching metastore objects

2015-05-25 Thread Sivaramakrishnan Narayanan
Apologies if this has been discussed in the past - my searches did not pull up any relevant threads. If there are better solutions available out of the box, please let me know! Problem statement -- We have a setup where a single metastoredb is used by Hive, Presto and Spar