[ https://issues.apache.org/jira/browse/HIVE-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14632048#comment-14632048 ]
ASF GitHub Bot commented on HIVE-11294: --------------------------------------- GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/46 Hbase metastore HIVE-11294 Cache aggregated stats in hbase You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hbase-metastore Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/46.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #46 ---- commit 58ca965ca58925e4846e14cf37d64638edb3e353 Author: Alan Gates <ga...@apache.org> Date: 2015-01-23T19:05:19Z Creating branch for hbase metastore development. git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1654331 13f79535-47bb-0310-9956-ffa450edef68 commit e81704eeaf061e7152c63379b828debdfdfe9a8e Author: Alan Gates <ga...@apache.org> Date: 2015-02-04T20:00:49Z HIVE-9453 Initial patch [hbase-metastore branch] (Alan Gates, reviewed by Thejas Nair) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1657394 13f79535-47bb-0310-9956-ffa450edef68 commit 120047c308a011f17f94258779e4c47fcff191a5 Author: Alan Gates <ga...@apache.org> Date: 2015-02-10T21:41:19Z HIVE-9578 Add support for getDatabases and alterDatabase calls [hbase-metastore branch] git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658821 13f79535-47bb-0310-9956-ffa450edef68 commit c7dcf4a85d5cef4151d7b72115b4a1027af488ac Author: Alan Gates <ga...@apache.org> Date: 2015-02-10T22:47:53Z HIVE-9579 Support all get tables [hbase-metastore branch] git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658829 13f79535-47bb-0310-9956-ffa450edef68 commit cd82601f6e5c4aea5db72b74629b6aada23cf7c2 Author: Alan Gates <ga...@apache.org> Date: 2015-02-19T18:51:39Z HIVE-9606 Need a tool to export metadata from RDBMS based metastore into HBase [hbase-metastore branch] (Alan Gates, reviewed by Thejas Nair) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1660974 13f79535-47bb-0310-9956-ffa450edef68 commit 21ba0a93dcadcf8726ae7a18e81f758921552697 Author: Alan Gates <ga...@apache.org> Date: 2015-03-02T18:17:01Z HIVE-9641 Fill out remaining partition functions in HBaseStore (Alan Gates reviewed by Vaibhav Gumashta) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1663386 13f79535-47bb-0310-9956-ffa450edef68 commit bb0010caa8734af34ecac7b5b054afd95b49b0e0 Author: Alan Gates <ga...@apache.org> Date: 2015-03-05T03:46:28Z HIVE-9677 Implement privileges call in HBaseStore (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664220 13f79535-47bb-0310-9956-ffa450edef68 commit 408d467bffa0923714b8262427f1d1d72ba9932d Author: Alan Gates <ga...@apache.org> Date: 2015-03-05T04:09:31Z HIVE-9763 Remove M* classes from RawStore interface (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664226 13f79535-47bb-0310-9956-ffa450edef68 commit be575b84a8d5b4764550499c60bdccb7b0d1f82f Author: Alan Gates <ga...@apache.org> Date: 2015-03-05T04:35:53Z HIVE-9802 Refactor HBaseReadWrite to allow different implementations underneath, also includes code from HIVE-9783 Move serialization of objects in HBase to protocol buffers (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664227 13f79535-47bb-0310-9956-ffa450edef68 commit 646468fcdfd612524961751ba3575a26a1fb3fcb Author: Alan Gates <ga...@apache.org> Date: 2015-03-12T19:41:56Z HIVE-9885 HBase metastore protobufs need to check hasX() functions for values that are not auto set in serialization [hbase-metastore branch] (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666280 13f79535-47bb-0310-9956-ffa450edef68 commit d268b81bcd2fbaae6fdbfe2f980f644ce5e3d92d Author: Alan Gates <ga...@apache.org> Date: 2015-03-12T20:01:30Z HIVE-9874 Partition storage descriptors being set from table sd without copying [hbase-metastore branch] (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666285 13f79535-47bb-0310-9956-ffa450edef68 commit 24f224867b70bacc91a877242aee1b0b84efd127 Author: Alan Gates <ga...@apache.org> Date: 2015-03-17T15:50:31Z HIVE-9942 Implement functions methods in HBaseStore (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667338 13f79535-47bb-0310-9956-ffa450edef68 commit 35ac8b0257614523064c1b3647a91e123b78e999 Author: Alan Gates <ga...@apache.org> Date: 2015-03-18T17:41:50Z HIVE-10008 Need to refactor itests for hbase metastore (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667596 13f79535-47bb-0310-9956-ffa450edef68 commit 10cfdd96b69084bf0da7b864113d073006147e77 Author: Alan Gates <ga...@apache.org> Date: 2015-03-20T16:14:46Z HIVE-10010 Alter table results in NPE [hbase-metastore branch] (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1668071 13f79535-47bb-0310-9956-ffa450edef68 commit 63080f82c02c2b7756be09209bf07f03280e4f9b Author: Alan Gates <ga...@apache.org> Date: 2015-03-23T21:34:11Z HIVE-10018 Activating SQLStandardAuth results in NPE [hbase-metastore branch] (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1668746 13f79535-47bb-0310-9956-ffa450edef68 commit 72004b826b71ced04f8bce4e3eb42c0264e0c9a6 Author: Thejas Nair <the...@apache.org> Date: 2015-03-27T05:28:11Z HIVE-10091 : Generate Hbase execution plan for partition filter conditions in HbaseStore api calls - initial changes (Thejas Nair, reviewed by Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1669514 13f79535-47bb-0310-9956-ffa450edef68 commit 913dba22627cf2d555bb0b22105e4bde0c6a7aa5 Author: Vaibhav Gumashta <vgumas...@apache.org> Date: 2015-04-02T20:59:42Z HIVE-9693: Introduce a stats cache for aggregate stats in HBase metastore (Vaibhav Gumashta reviewed by Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670966 13f79535-47bb-0310-9956-ffa450edef68 commit e9a7173a52a7a2bd91a6edddf54c1b354a7b101d Author: Alan Gates <ga...@apache.org> Date: 2015-04-02T23:46:04Z HIVE-10205 A few lines accidentally removed from HBaseReadWrite (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670993 13f79535-47bb-0310-9956-ffa450edef68 commit ea1fc22f6b5ee4eed728598d554348bbb77d21b1 Author: Vaibhav Gumashta <vgumas...@apache.org> Date: 2015-04-03T00:27:00Z HIVE-10207: Fix test failure in TestAggregateStatsCache git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670994 13f79535-47bb-0310-9956-ffa450edef68 commit 185908979d4e701ff0ee4988f07750dce777460c Author: Alan Gates <ga...@apache.org> Date: 2015-04-07T22:41:01Z HIVE-10090 Add connection manager for Tephra (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1671966 13f79535-47bb-0310-9956-ffa450edef68 commit f752b4ab6941d8f6907a97133a77aefb7303b4d7 Author: Alan Gates <ga...@apache.org> Date: 2015-04-08T02:29:25Z Merge from trunk to hbase-metastore branch. git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1671993 13f79535-47bb-0310-9956-ffa450edef68 commit f95254d35ddeaa0712966f22dbbdb2fa1c49d0a9 Author: Alan Gates <ga...@apache.org> Date: 2015-04-14T14:47:30Z hbase-metastore merge trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1673437 13f79535-47bb-0310-9956-ffa450edef68 commit afe1b5e3ad59474ddbcddf91865ec6b43171ee1d Author: Vaibhav Gumashta <vgumas...@apache.org> Date: 2015-04-23T21:33:24Z HIVE-10383: Add tests for partition level statistics + refactor stats tests of TestHBaseStore [hbase-metastore branch] (Vaibhav Gumashta reviewed by Alan Gates) commit 1a64664aedbf0b36544380005b19db79e5c4364c Author: Alan Gates <ga...@hortonworks.com> Date: 2015-06-05T23:07:58Z Merge branch 'master' into hbase-metastore commit 15012469afb8e0c0354b82c972f058ed3cd0d221 Author: Alan Gates <ga...@hortonworks.com> Date: 2015-06-18T00:20:19Z HIVE-10954 AggregateStatsCache duplicated in HBaseMetastore (gates) commit 4cc8c7ff674553f214324b41c93610822280507d Author: Alan Gates <ga...@hortonworks.com> Date: 2015-06-29T18:11:40Z HIVE-11057 HBase metastore chokes on partition with ':' in name (gates) commit 6ea5c0956972eb4582d9318d9866b441a92f7aab Author: Alan Gates <ga...@hortonworks.com> Date: 2015-06-29T18:32:19Z HIVE-10952 Describe a non-partitioned table fail (gates) commit 1a1c0d817da036025f1c3b953af7b52403c048ba Author: Alan Gates <ga...@hortonworks.com> Date: 2015-07-01T22:47:03Z HIVE-11061 Table renames not propagated to partition table in HBase metastore (gates) commit 738e901a5c9a69342f29fffbfc53cb53ff192694 Author: Alan Gates <ga...@hortonworks.com> Date: 2015-07-17T22:34:32Z HIVE-11294 Add new stats cache to hbase ---- > Use HBase to cache aggregated stats > ----------------------------------- > > Key: HIVE-11294 > URL: https://issues.apache.org/jira/browse/HIVE-11294 > Project: Hive > Issue Type: Improvement > Components: Metastore > Affects Versions: hbase-metastore-branch > Reporter: Alan Gates > Assignee: Alan Gates > Fix For: hbase-metastore-branch > > Attachments: HIVE-11294.patch > > > Currently stats are cached only in the memory of the client. Given that > HBase can easily manage the scale of caching aggregated stats we should be > using it to do so. -- This message was sent by Atlassian JIRA (v6.3.4#6332)