vinothchandar commented on a change in pull request #2343:
URL: https://github.com/apache/hudi/pull/2343#discussion_r545976491
##########
File path:
hudi-client/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java
##########
@@ -51,6 +51,7 @@
import org.apache.hudi.common.util.HoodieTimer;
import org.apache.hudi.common.util.Option;
import org.apache.hudi.common.util.ValidationUtils;
+import org.apache.hudi.common.util.collection.Pair;
Review comment:
>So, what I am thinking is by default we can let
FsUtils.getAllPartitionPaths() always default to the metadata table, and
internally if the table is not present, it will use this default
parallelized/optimized listing of partition paths.
+1 on this. There is a JIRA to track this specifically
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
