Quanlong Huang has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/21178


Change subject: IMPALA-12929: Skip loading HDFS permissions in local-catalog 
mode
......................................................................

IMPALA-12929: Skip loading HDFS permissions in local-catalog mode

HDFS file/dir permissions are not used at all in local catalog mode - in
LocalFsTable, hasWriteAccessToBaseDir() always returns true and
getFirstLocationWithoutWriteAccess() always returns null.

However, in catalogd, we still load them (in single thread for a table!)
which could dominant the table loading time when there are lots of
partitions.

This patch skips loading HDFS permissions in local catalog mode. We can
revisit it in IMPALA-7539.

Change-Id: I5baa9f6ab0d3888a78ff161ae5caa19e85bc983a
---
M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java
M fe/src/main/java/org/apache/impala/service/BackendConfig.java
2 files changed, 8 insertions(+), 0 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/78/21178/1
--
To view, visit http://gerrit.cloudera.org:8080/21178
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I5baa9f6ab0d3888a78ff161ae5caa19e85bc983a
Gerrit-Change-Number: 21178
Gerrit-PatchSet: 1
Gerrit-Owner: Quanlong Huang <[email protected]>

Reply via email to