[
https://issues.apache.org/jira/browse/HIVE-18661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mahesh kumar behera updated HIVE-18661:
---------------------------------------
Status: Patch Available (was: Open)
# Removed cache invalidation during raw store operation if event based cache
update is enabled.
2. Added check to read stats directly from raw store if event based update is
enabled as events are not generated for stats update.
3. Added code to trigger cache update during commit txn time. This may cause
invalid cache read if same transaction tried to read the value from cache.
4. Need to check how to handle config change to disable/enable cache update
using events during run time after prewarm is done.
5. For catalog operation cache will not be used , if event based update is used.
[~thejas] [~daijy]
Can you please review the patch
> CachedStore: Use metastore notification log events to update cache
> ------------------------------------------------------------------
>
> Key: HIVE-18661
> URL: https://issues.apache.org/jira/browse/HIVE-18661
> Project: Hive
> Issue Type: Sub-task
> Components: Metastore
> Reporter: Vaibhav Gumashta
> Assignee: mahesh kumar behera
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-18661.02.patch, HIVE-18661.03.patch,
> HIVE-18661.04.patch, HIVE-18661.05.patch
>
>
> Currently, a background thread updates the entire cache which is pretty
> inefficient. We capture the updates to metadata in NOTIFICATION_LOG table
> which is getting used in the Replication work. We should have the background
> thread apply these notifications to incrementally update the cache.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
