[
https://issues.apache.org/jira/browse/HUDI-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-8840:
--------------------------------------
Labels: hudi-1.0.2 pull-request-available (was: pull-request-available)
> Support custom delete marker in EVENT_TIME_ORDERING merge mode
> --------------------------------------------------------------
>
> Key: HUDI-8840
> URL: https://issues.apache.org/jira/browse/HUDI-8840
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Y Ethan Guo
> Assignee: Lin Liu
> Priority: Blocker
> Labels: hudi-1.0.2, pull-request-available
> Fix For: 1.0.2
>
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> Relevant logic of delete marker in DefaultHoodieRecordPayload
> {code:java}
> protected boolean isDeleteRecord(GenericRecord genericRecord, Properties
> properties) {
> final String deleteKey = properties.getProperty(DELETE_KEY);
> if (StringUtils.isNullOrEmpty(deleteKey)) {
> return isDeleteRecord(genericRecord);
> }
>
> ValidationUtils.checkArgument(!StringUtils.isNullOrEmpty(properties.getProperty(DELETE_MARKER)),
> () -> DELETE_MARKER + " should be configured with " + DELETE_KEY);
> // Modify to be compatible with new version Avro.
> // The new version Avro throws for GenericRecord.get if the field name
> // does not exist in the schema.
> if (genericRecord.getSchema().getField(deleteKey) == null) {
> return false;
> }
> Object deleteMarker = genericRecord.get(deleteKey);
> return deleteMarker != null &&
> properties.getProperty(DELETE_MARKER).equals(deleteMarker.toString());
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
