[ 
https://issues.apache.org/jira/browse/HIVE-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14632048#comment-14632048
 ] 

ASF GitHub Bot commented on HIVE-11294:
---------------------------------------

GitHub user alanfgates opened a pull request:

    https://github.com/apache/hive/pull/46

    Hbase metastore

    HIVE-11294 Cache aggregated stats in hbase

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/alanfgates/hive hbase-metastore

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/hive/pull/46.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #46
    
----
commit 58ca965ca58925e4846e14cf37d64638edb3e353
Author: Alan Gates <ga...@apache.org>
Date:   2015-01-23T19:05:19Z

    Creating branch for hbase metastore development.
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1654331 
13f79535-47bb-0310-9956-ffa450edef68

commit e81704eeaf061e7152c63379b828debdfdfe9a8e
Author: Alan Gates <ga...@apache.org>
Date:   2015-02-04T20:00:49Z

    HIVE-9453 Initial patch [hbase-metastore branch] (Alan Gates, reviewed by 
Thejas Nair)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1657394 
13f79535-47bb-0310-9956-ffa450edef68

commit 120047c308a011f17f94258779e4c47fcff191a5
Author: Alan Gates <ga...@apache.org>
Date:   2015-02-10T21:41:19Z

    HIVE-9578 Add support for getDatabases and alterDatabase calls 
[hbase-metastore branch]
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658821 
13f79535-47bb-0310-9956-ffa450edef68

commit c7dcf4a85d5cef4151d7b72115b4a1027af488ac
Author: Alan Gates <ga...@apache.org>
Date:   2015-02-10T22:47:53Z

    HIVE-9579 Support all get tables [hbase-metastore branch]
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658829 
13f79535-47bb-0310-9956-ffa450edef68

commit cd82601f6e5c4aea5db72b74629b6aada23cf7c2
Author: Alan Gates <ga...@apache.org>
Date:   2015-02-19T18:51:39Z

    HIVE-9606 Need a tool to export metadata from RDBMS based metastore into 
HBase [hbase-metastore branch] (Alan Gates, reviewed by Thejas Nair)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1660974 
13f79535-47bb-0310-9956-ffa450edef68

commit 21ba0a93dcadcf8726ae7a18e81f758921552697
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-02T18:17:01Z

    HIVE-9641 Fill out remaining partition functions in HBaseStore (Alan Gates 
reviewed by Vaibhav Gumashta)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1663386 
13f79535-47bb-0310-9956-ffa450edef68

commit bb0010caa8734af34ecac7b5b054afd95b49b0e0
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-05T03:46:28Z

    HIVE-9677 Implement privileges call in HBaseStore (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664220 
13f79535-47bb-0310-9956-ffa450edef68

commit 408d467bffa0923714b8262427f1d1d72ba9932d
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-05T04:09:31Z

    HIVE-9763 Remove M* classes from RawStore interface (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664226 
13f79535-47bb-0310-9956-ffa450edef68

commit be575b84a8d5b4764550499c60bdccb7b0d1f82f
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-05T04:35:53Z

    HIVE-9802 Refactor HBaseReadWrite to allow different implementations 
underneath, also includes code from HIVE-9783 Move serialization of objects in 
HBase to protocol buffers (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664227 
13f79535-47bb-0310-9956-ffa450edef68

commit 646468fcdfd612524961751ba3575a26a1fb3fcb
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-12T19:41:56Z

    HIVE-9885 HBase metastore protobufs need to check hasX() functions for 
values that are not auto set in serialization [hbase-metastore branch] (Alan 
Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666280 
13f79535-47bb-0310-9956-ffa450edef68

commit d268b81bcd2fbaae6fdbfe2f980f644ce5e3d92d
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-12T20:01:30Z

    HIVE-9874 Partition storage descriptors being set from table sd without 
copying [hbase-metastore branch] (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666285 
13f79535-47bb-0310-9956-ffa450edef68

commit 24f224867b70bacc91a877242aee1b0b84efd127
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-17T15:50:31Z

    HIVE-9942 Implement functions methods in HBaseStore (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667338 
13f79535-47bb-0310-9956-ffa450edef68

commit 35ac8b0257614523064c1b3647a91e123b78e999
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-18T17:41:50Z

    HIVE-10008 Need to refactor itests for hbase metastore (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667596 
13f79535-47bb-0310-9956-ffa450edef68

commit 10cfdd96b69084bf0da7b864113d073006147e77
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-20T16:14:46Z

    HIVE-10010 Alter table results in NPE [hbase-metastore branch] (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1668071 
13f79535-47bb-0310-9956-ffa450edef68

commit 63080f82c02c2b7756be09209bf07f03280e4f9b
Author: Alan Gates <ga...@apache.org>
Date:   2015-03-23T21:34:11Z

    HIVE-10018 Activating SQLStandardAuth results in NPE [hbase-metastore 
branch] (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1668746 
13f79535-47bb-0310-9956-ffa450edef68

commit 72004b826b71ced04f8bce4e3eb42c0264e0c9a6
Author: Thejas Nair <the...@apache.org>
Date:   2015-03-27T05:28:11Z

    HIVE-10091 : Generate Hbase execution plan for partition filter conditions 
in HbaseStore api calls - initial changes (Thejas Nair, reviewed by Alan Gates)
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1669514 
13f79535-47bb-0310-9956-ffa450edef68

commit 913dba22627cf2d555bb0b22105e4bde0c6a7aa5
Author: Vaibhav Gumashta <vgumas...@apache.org>
Date:   2015-04-02T20:59:42Z

    HIVE-9693: Introduce a stats cache for aggregate stats in HBase metastore 
(Vaibhav Gumashta reviewed by Alan Gates)
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670966 
13f79535-47bb-0310-9956-ffa450edef68

commit e9a7173a52a7a2bd91a6edddf54c1b354a7b101d
Author: Alan Gates <ga...@apache.org>
Date:   2015-04-02T23:46:04Z

    HIVE-10205 A few lines accidentally removed from HBaseReadWrite (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670993 
13f79535-47bb-0310-9956-ffa450edef68

commit ea1fc22f6b5ee4eed728598d554348bbb77d21b1
Author: Vaibhav Gumashta <vgumas...@apache.org>
Date:   2015-04-03T00:27:00Z

    HIVE-10207: Fix test failure in TestAggregateStatsCache
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670994 
13f79535-47bb-0310-9956-ffa450edef68

commit 185908979d4e701ff0ee4988f07750dce777460c
Author: Alan Gates <ga...@apache.org>
Date:   2015-04-07T22:41:01Z

    HIVE-10090 Add connection manager for Tephra (Alan Gates)
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1671966 
13f79535-47bb-0310-9956-ffa450edef68

commit f752b4ab6941d8f6907a97133a77aefb7303b4d7
Author: Alan Gates <ga...@apache.org>
Date:   2015-04-08T02:29:25Z

    Merge from trunk to hbase-metastore branch.
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1671993 
13f79535-47bb-0310-9956-ffa450edef68

commit f95254d35ddeaa0712966f22dbbdb2fa1c49d0a9
Author: Alan Gates <ga...@apache.org>
Date:   2015-04-14T14:47:30Z

    hbase-metastore merge trunk to branch.
    
    
    git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1673437 
13f79535-47bb-0310-9956-ffa450edef68

commit afe1b5e3ad59474ddbcddf91865ec6b43171ee1d
Author: Vaibhav Gumashta <vgumas...@apache.org>
Date:   2015-04-23T21:33:24Z

    HIVE-10383: Add tests for partition level statistics + refactor stats tests 
of TestHBaseStore [hbase-metastore branch] (Vaibhav Gumashta reviewed by Alan 
Gates)

commit 1a64664aedbf0b36544380005b19db79e5c4364c
Author: Alan Gates <ga...@hortonworks.com>
Date:   2015-06-05T23:07:58Z

    Merge branch 'master' into hbase-metastore

commit 15012469afb8e0c0354b82c972f058ed3cd0d221
Author: Alan Gates <ga...@hortonworks.com>
Date:   2015-06-18T00:20:19Z

    HIVE-10954 AggregateStatsCache duplicated in HBaseMetastore (gates)

commit 4cc8c7ff674553f214324b41c93610822280507d
Author: Alan Gates <ga...@hortonworks.com>
Date:   2015-06-29T18:11:40Z

    HIVE-11057 HBase metastore chokes on partition with ':' in name (gates)

commit 6ea5c0956972eb4582d9318d9866b441a92f7aab
Author: Alan Gates <ga...@hortonworks.com>
Date:   2015-06-29T18:32:19Z

    HIVE-10952 Describe a non-partitioned table fail (gates)

commit 1a1c0d817da036025f1c3b953af7b52403c048ba
Author: Alan Gates <ga...@hortonworks.com>
Date:   2015-07-01T22:47:03Z

    HIVE-11061 Table renames not propagated to partition table in HBase 
metastore (gates)

commit 738e901a5c9a69342f29fffbfc53cb53ff192694
Author: Alan Gates <ga...@hortonworks.com>
Date:   2015-07-17T22:34:32Z

    HIVE-11294 Add new stats cache to hbase

----


> Use HBase to cache aggregated stats
> -----------------------------------
>
>                 Key: HIVE-11294
>                 URL: https://issues.apache.org/jira/browse/HIVE-11294
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: hbase-metastore-branch
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>             Fix For: hbase-metastore-branch
>
>         Attachments: HIVE-11294.patch
>
>
> Currently stats are cached only in the memory of the client.  Given that 
> HBase can easily manage the scale of caching aggregated stats we should be 
> using it to do so.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to