yihua commented on code in PR #13007:
URL: https://github.com/apache/hudi/pull/13007#discussion_r2019337327
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/marker/WriteMarkers.java:
##########
@@ -209,6 +209,15 @@ protected StoragePath getMarkerPath(String partitionPath,
String fileName, IOTyp
*/
public abstract Set<String> createdAndMergedDataPaths(HoodieEngineContext
context, int parallelism) throws IOException;
+ /**
+ * Fetches markers for log files w/ Append IOType. Used only for table
version 6.
+ * @param context {@code HoodieEngineContext} instance.
+ * @param parallelism parallelism for reading the marker files in the
directory.
+ * @return all the log file paths of write IO type "APPEND"
+ * @throws IOException
+ */
+ public abstract Set<String> getAppendedLogPaths(HoodieEngineContext context,
int parallelism) throws IOException;
Review Comment:
Fixed by introducing `AppendMarkerHandler` interface to handle `APPEND`
markers for table version 6 only, so that in the future we can easily remove
the interface and new implementation classes for V1 only.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
