[
https://issues.apache.org/jira/browse/HUDI-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996460#comment-16996460
]
Nishith Agarwal commented on HUDI-410:
--------------------------------------
At the moment, we can only stuff Avro inside a log block. Ideally, we want to
get to state when we can stuff file formats like parquet and hfile - both
useful for real-time queries and global index respectively. Once that’s
possible, we want to be able to have semantics to read such formats out of the
log file. A file system implementation that allows for such reading/writing to
the log file would a good abstraction - calling that an in-line file system.
@siva is working on this and has a WIP pr I believe
> HFile inlining into the log file
> --------------------------------
>
> Key: HUDI-410
> URL: https://issues.apache.org/jira/browse/HUDI-410
> Project: Apache Hudi (incubating)
> Issue Type: Sub-task
> Components: Index
> Reporter: Nishith Agarwal
> Priority: Major
> Fix For: 0.5.2
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)