[ https://issues.apache.org/jira/browse/HIVE-19975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16525857#comment-16525857 ]
Sergey Shelukhin edited comment on HIVE-19975 at 6/28/18 3:12 AM: ------------------------------------------------------------------ I found out why the tests work. in HiveMetaStore, HiveMetaStore::get_partitions_statistics_req method does not propagate write ID to the next class (they are never extracted from the request); so, it calls the overload without the stats check. Also one of my test fixes introduced another issue downstream that also disables the check silently after that is fixed. I will fix both and commit a test that shows this problem. was (Author: sershe): I found out why the tests work. in HiveMetaStore, HiveMetaStore::get_partitions_statistics_req method does not propagate write ID to the next class (they are never extracted from the request); so, it calls the overload without the stats check. Also one of my test fixes introduced another issue downstream that also disables the check silently after that. I will fix both and commit a test that shows this problem. > Checking writeIdList per table may not check the commit level of a partition > on a partitioned table. > ---------------------------------------------------------------------------------------------------- > > Key: HIVE-19975 > URL: https://issues.apache.org/jira/browse/HIVE-19975 > Project: Hive > Issue Type: Sub-task > Components: Transactions > Affects Versions: 4.0.0 > Reporter: Steve Yeom > Assignee: Sergey Shelukhin > Priority: Major > Fix For: 4.0.0 > > > writeIdList is per table entity but stats for a partitioned table are per > partition. > I.e., each record in PARTITIONS has an independent stats. > So if we check the validity of a partition's stats, we need to check in the > context of > a partiton. -- This message was sent by Atlassian JIRA (v7.6.3#76005)