Eugene Koifman created HIVE-18662: ------------------------------------- Summary: hive.acid.key.index is missing entries Key: HIVE-18662 URL: https://issues.apache.org/jira/browse/HIVE-18662 Project: Hive Issue Type: Bug Components: Transactions Reporter: Eugene Koifman
OrcRecordUpdater.KeyIndexBuilder stores an index in ORC footer where each entry is the last ROW__ID of each stripe. In acid1 this is used to filter the events from delta file when merging with part of the base. as can be seen in \{{TestTxnCommands.testVersioning()}} (added in HIVE-18659) the \{{hive.acid.key.index}} is empty. This is because very little data is written and WriterImpl.flushStripe() is not called except when \{{WriterImpl.close()} is called. In the later, \{{WriterCallback.preFooterWrite()}} is called before \{{preStripeWrite}} and so KeyIndexBuilder.preFooterWriter() records nothing in \{{hive.acid.key.index}} -- This message was sent by Atlassian JIRA (v7.6.3#76005)