Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/22559 )
Change subject: IMPALA-11402: Add limit on files fetched by a single getPartialCatalogObject request ...................................................................... Patch Set 8: (3 comments) http://gerrit.cloudera.org:8080/#/c/22559/7/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java File fe/src/main/java/org/apache/impala/catalog/HdfsTable.java: http://gerrit.cloudera.org:8080/#/c/22559/7/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java@2353 PS7, Line 2353: LOG.error("Too many files in table {}{}: {}. Current limit is {}. Try " + > Change bumping to increasing Done http://gerrit.cloudera.org:8080/#/c/22559/7/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java@2355 PS7, Line 2355: "restart catalogd. Note that this might lead to OOM of exceeding " + > wording: lead to OOM of exceeding reworded, please check again. http://gerrit.cloudera.org:8080/#/c/22559/7/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java File fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java: http://gerrit.cloudera.org:8080/#/c/22559/7/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java@1185 PS7, Line 1185: "many files. Try increasing catalog_partial_fetch_max_files to a higher " + > change bumping to increasing. Done -- To view, visit http://gerrit.cloudera.org:8080/22559 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Ibb13fec20de5a17e7fc33613ca5cdebb9ac1a1e5 Gerrit-Change-Number: 22559 Gerrit-PatchSet: 8 Gerrit-Owner: Quanlong Huang <huangquanl...@gmail.com> Gerrit-Reviewer: Daniel Becker <daniel.bec...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Kurt Deschler <kdesc...@cloudera.com> Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com> Gerrit-Comment-Date: Tue, 25 Mar 2025 11:56:40 +0000 Gerrit-HasComments: Yes
