Hello Riza Suminto, Yida Wu, Michael Smith, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/22869
to look at the new patch set (#3).
Change subject: IMPALA-14051: Use batch insert HMS API to fire insert events
......................................................................
IMPALA-14051: Use batch insert HMS API to fire insert events
Firing insert statements from Impala can be improved by leveraging the
batch insert HMS API addWriteNotificationLogInBatch() available (via
HIVE-25205) starting from Hive 4. Right now, Impala is using a single
call for each partition, so firing insert statements on a huge
partitioned table can become a performance bottleneck.
This patch addresses the above concern by leveraging
addWriteNotificationLogInBatch() API to fire batch insert partition
events.
Note: This optimization is applicable only for transactional partitioned
tables. The external partitioned table case is already handled.
Change-Id: Iff4a2691631fe9e9e1dc07714c69580a4ace6a8b
---
M fe/src/compat-hive-3/java/org/apache/impala/compat/MetastoreShim.java
M fe/src/main/java/org/apache/impala/util/MetaStoreUtil.java
2 files changed, 27 insertions(+), 18 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/69/22869/3
--
To view, visit http://gerrit.cloudera.org:8080/22869
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iff4a2691631fe9e9e1dc07714c69580a4ace6a8b
Gerrit-Change-Number: 22869
Gerrit-PatchSet: 3
Gerrit-Owner: Sai Hemanth Gantasala <saihema...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Michael Smith <michael.sm...@cloudera.com>
Gerrit-Reviewer: Riza Suminto <riza.sumi...@cloudera.com>
Gerrit-Reviewer: Sai Hemanth Gantasala <saihema...@cloudera.com>
Gerrit-Reviewer: Yida Wu <wydbaggio...@gmail.com>
