Sai Hemanth Gantasala has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/21971


Change subject: IMPALA-13403: Trivial changes in StorageDescriptor of 
ALTER_TABLE event is not enough to decide file metadata reload can be skipped
......................................................................

IMPALA-13403: Trivial changes in StorageDescriptor of ALTER_TABLE
event is not enough to decide file metadata reload can be skipped

IMPALA-12487 adds an optimization that if an ALTER_TABLE event has
trivial changes in StorageDescriptor (e.g. removing optional field
'storedAsSubDirectories'=false which defaults to false), file
metadata reload will be skipped, no matter what changes are in the
table properties. This is problematic since some HMS clients (e.g.
Spark) could modify both the table properties and StorageDescriptor.
If there is a non-trivial changes in table properties (e.g. 'location'
change), we shouldn't skip reloading file metadata.

Testing:
- Added a unit test to verify the same

Change-Id: Ia969dd32385ac5a1a9a65890a5ccc8cd257f4b97
---
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M 
fe/src/test/java/org/apache/impala/catalog/events/MetastoreEventsProcessorTest.java
2 files changed, 24 insertions(+), 5 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/71/21971/1
--
To view, visit http://gerrit.cloudera.org:8080/21971
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ia969dd32385ac5a1a9a65890a5ccc8cd257f4b97
Gerrit-Change-Number: 21971
Gerrit-PatchSet: 1
Gerrit-Owner: Sai Hemanth Gantasala <[email protected]>

Reply via email to