[ 
https://issues.apache.org/jira/browse/HUDI-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996462#comment-16996462
 ] 

Nishith Agarwal commented on HUDI-409:
--------------------------------------

No, the delta/log files can contain multiple log blocks. Each of these blocks 
contain a magic header to differentiate each other in the bytestream written to 
disk (a single file). Right now, it is possible for the magic header to clash 
with the data and hence corrupting the reader. We need a way to generate a 
secure hash to avoid that scenario

> Replace Log Magic header with a secure hash to avoid clashes with data
> ----------------------------------------------------------------------
>
>                 Key: HUDI-409
>                 URL: https://issues.apache.org/jira/browse/HUDI-409
>             Project: Apache Hudi (incubating)
>          Issue Type: Bug
>          Components: Common Core
>            Reporter: Nishith Agarwal
>            Priority: Major
>             Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to