Riza Suminto has uploaded this change for review. ( http://gerrit.cloudera.org:8080/23436
Change subject: IMPALA-14447: Parallelize table loading in getMissingTables() ...................................................................... IMPALA-14447: Parallelize table loading in getMissingTables() StmtMetadataLoader.getMissingTables() load missing tables in serial manner. In local catalog mode, large number of serial table loading can incurr significant round trip latency to CatalogD. This patch improve the table loading by using parallelStream to lookup and gather all non-null FeTables from given TableName set. Testing: Run and pass few tests such as test_catalogd_ha.py and test_concurrent_ddls.py. Change-Id: I97a5165844ae846b28338d62e93a20121488d79f --- M fe/src/main/java/org/apache/impala/analysis/StmtMetadataLoader.java 1 file changed, 24 insertions(+), 10 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/36/23436/1 -- To view, visit http://gerrit.cloudera.org:8080/23436 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I97a5165844ae846b28338d62e93a20121488d79f Gerrit-Change-Number: 23436 Gerrit-PatchSet: 1 Gerrit-Owner: Riza Suminto <[email protected]>
